How do you tell people that you really hate the diminutive that they're calling you?

When my brother was little, we called him Hotrod. Being much older, and living elsewhere, I didn’t see him for several years.
When we reconnected, I called him by the name I was used to. He didn’t like it. He had a new nickname he’d aquired in the Navy; Shorty. My brother is maybe 5’1".
I hated that nickname, so I decided to call him by his given name. He was amazed at how much he liked not being addressed by his body type. His wife was the only person who refused to give up “Shorty.” It wasn’t too long before he gave her up…