Tupelo Honey - the song

What the heck is Van Morrison talking about in this song?

At first I thought it might be a Who Do You Love thing but it doesn’t fit. Anyone know?
Thanks.

This source opines it is just a love song, no hidden meaning.

I’ve always through of it as three songs set to the same music.

Some variants to the lyrics which might help:

Maybe the “men in granite” is a reference to Mount Rushmore? But I don’t know what that would have to do with love in the romantic sense.