You should do what I always did - say nothing and eventually move on in your life, never knowing if you actually had a future together or if he was interested or not. No, wait, that’s what you do if you want to never get with him. 
I have no particular insight (except he doesn’t hate you if he’s willing to spend time with you socially), but I do have encouragement - try a little obvious flirting and see how it goes.
He’s not that into you. Sorry.
Guys don’t call girls they like “sweetie”. That sounds like something one of my gay friends might call a girl they are best friends with. (echoing what Stranger On A Train said). Not that he is gay (I have no idea), but “sweet” is typically how you describe someone who is into you who you don’t like in that way. As in “oh that’s sweet”.
He said that he missed you because he didn’t turn up either, and he called you “sweetie” because he can’t remember your name.
The key phrase you’re looking for is, “Would you like to go on a date sometime?” You must use the word date. Feel the fear and just do it!
I would caution you against using a deception like this, as innocent as it may seem. Those of us that have been deceived a lot in the past may see that as a red flag. It’s always better to just be honest and open, in my opinion.
I personally prefer to stand outside her window in the rain with Peter Gabriel’s “Sledgehammer” blasting out of an 'Eighties style boombox held above my head.
Let there be no doubt about it.
Stranger
So my friend knows a guy who dated a girl (and this story is far enough removed from me that I hope it’s been distorted enough through re-re-telling that it’s barely even true anymore) who was apparently a terrifying psycho, and the guy’s main reason for staying with her was fear. When they finally broke up she, according to lore, kissed his mouth, biting into his lip, asking, “Don’t you feel the passion?”
I want someone to do this to me. I’d take him back right away. That shit is romantic.
Since she’s not gauging his reactions already - why not make it more confusing? 
Another date? Oh well, she’s not interested in me then. Crash and burn? This girl is harsh about her dates.
You’re moving up my list of Doper Crushes, mang.
I will do that. he called twice while i was out today.
Well, buy a car and have sex with him in it! YOU’RE MAKING THIS TOO COMPLICATED!
Enjoy,
Steven
I would have gone with “Shock the Monkey” myself.
Wasn’t there a movie where a scene like that played out? Baby Got Back might be a better choice. heh.
Forgot, the other day; we do some volunteer work together, he commented that if we earn enough, ‘we’ could get a car. Me, I have no license and no plans to get one.
Exactly. Flirting does not make you the aggressor. It’s just a way to signal interest. And while msmith’s response that “he’s not that into you” is possibly correct, the fact that you haven’t really tried to treat him as more than a friend means that it’s possible that he would love to be in a more romantic relationship with you, but is afraid of rejection. It’s exactly how I used to react in those situations.
If you had already tried flirting with him, and he didn’t respond, then I’d be more concerned. That’s precisely how I’ve communicated my lack of interest in the past. I find it much less likely to end the friendship. (And I don’t generally find women flirting with me to be uncomfortable, no matter how much I like them, so lack of a negative response would be insufficient)
Surely I’m not that unusual.
Thanks for saying that. I’ve always felt I should Not be the pursuer. I have many times, in the past, and it never worked. The times I’ve gotten together with someone, we both were interested at the same time (very early on) and both did the subtle verbal hints.
I do not like rejction, so I think I really haven’t given him any clues, except when we met I did give him my number, but that was for a political thing we were doing.
eta: I am a bit older than him, I wonder if that would have anything to do with it. Lets just say over 10 years difference.
Ask if he wants to help you make a porno.
“You know, I like being friends with you, but I’m also kind of enamored with you, so if you’re interested in something more than friendship I would like that. And if you’re totally not, let me know now and I will transport us back in time 60 seconds so this conversation never happened.”
Well, I ran into him yesterday, he was on his way to do an odd job and told me to come along with him, then to wait while he did it. We walked him home, and i asked when I was going to see him again. he said to come over anytime; during reasonable hours, and that i have his phone number. I so just want Him to make the overtures.
Just throwing this out there.
Repeating what I wrote upthread because you obviously didn’t read it the first time:
Tell him EXACTLY what you want. Right now. Don’t wait, don’t play coy games, JUST TELL HIM.