If I remember that scene right, I interpreted that as Howard hitting on Penny (“Oh, he can’t talk about attractive women [like you]”)
Was he aware penny was there and did he have a beer? I seem to recall he spent a lot of the first 4 seasons with a beer bottle in hand so he could talk.
I think he just can’t talk to women he wants to sleep with, but since he’s ultra-desperate, that’s every woman he’s not related to.
I think that’s just that he isn’t talking TO women.
That’s for damn sure.