Male masculinity is at once terribly strong and macho to the point they cannot be expected to control their sexual urges and also incredibly fragile, so the sight of a nude male athlete on the cover of a sports magazine upsets them to the point of nausea.
OP, your mom is afraid for her future needs and asks for help and your response is to worry about your penis.
I still say, since you think this may have been a subtle pick up line, you subtly tell him you’re not interested in men (by bringing up women you are attracted to), and then get back to talking about your mom.
It seems the same subtlety of a woman mentioning a boyfriend when she thinks a guy may be hitting on her.