Ooh, ooh! I love the album Diamanda Galas recorded with versions of gospel songs, *The Singer. * She brings a whole new dimension to the music and lyrics - her *Let My People Go * chills me to the bone.
Jerusalem is a fine hymn by Blake with a beautiful tune by Parry. Though as an atheist I am convinced that when I’m dead and gone I shall know nothing about it, if it makes my friends and relatives happy to play something I love, this is what I’d like them to play at my secular funeral.
It has huge significance to me as a critical patriot - but not a nationalist.
jjimm, my gratitude is boundless. Those last two stanzas, I have memorized, and didn’t know where they came from.
THANKYOUTHANKYOUTHANKYOU!!
I came in here to post Jerusalem. Damn you, jjimm!
Wasn’t there a story recently about a bishop who wants to ban Jerusalem from churches because he doesn’t regard it as a hymn?
We can share! 
I’m an only child - I don’t share!
Well alright then - if I must.
Dear God by XTC.
Not songs, exactly, but Ian Anderson’s Divinities: 12 Dances with God is pretty good - I especially like the “Catholic” one, In A Maternal Grace.
Christopher Tin’s Baba Yetu, the title track on Civ IV. It’s the Lord’s Prayer in Swahili.
As an American, I only learned this song when Emerson Lake & Palmer opened Brain Salad Surgery with it. I assume that’s not the version you want played?
Sampiro, it was definitely Rick Wakeman playing on Morning Has Broken. I don’t know if it was his arrangement though.
Just remember: You can’t mention Pachelbel’s Canon arund here without a reference to the Pachelbel Rant. It’s a rule, or something. 
If you like country music, I’d nominate Josh Turner’s Long Black Train. It’s rather Johnny Cash-like.
So many songs by Van Morrison. Some of them should be sung in church, in my opinion, but I think they won’t because he’s on the wrong record label. Seriously, that’s what it comes down to. If he’d released them on “Christian albums”, they might have been adopted, but instead he’s hardly even known.
“Love is Stronger Than Death” by **The The ** [Matt Johnson].
No references to gods or angels, heaven or hell, but it’s an affirmation of faith in some kind of unspecified afterlife or resurrection.
More direct is The The’s cover of Hank Williams’ “I Saw the Light”.
Pretty much anything by The Blind Boys of Alabama.
God almost certainly doesn’t exist, but I still like Handel’s Messiah (plus My Sweet Lord, Johnny Cash and a bunch of gospelly Elvis/soul numbers).
I am the kind of person who swears to her child that Santa is real but God and Jesus are just a story and yet I have How Great Thou Art by Elvis saved on my Sirius Sportster. Even though I can practically hear the casserole ladies of my youth, with their wavery sopranos, wailing away over at the East Burke Congo I still love it.
When I was an atheist long ago, I had an aversion to almost everything religious including music. But even back then, I would find myself mesmerized whenever I was near the local AME Zion church. The beauty and the power of that choir singing old negro spirituals blasted through their almost always open doors and just left me in awe. Even an atheist can get caught up in the foot stomping and hand clapping of those great old melodies and harmonies.