I like the form, and could wish the first and last lines of stanzas rhymed better. But if used for a song, that probably makes less of a problem than if this is just a standalone poem.
The final line of the third stanza feels a bit tacked on. The “all is glory!” exclamation may or may not work out well in a strophic hymn composition. Otherwise, I think this works quite well.