I think it’s mostly to do with insulation. When I was 5’11" and 135 lbs I was constantly cold while living in LA. Now 30+ years later when I’m 5’11" and 195 lbs, even winter in the midwest snow doesn’t seem nearly as cold as a summer day in LA did.
Insulation would make sense, as I’m a small woman with little body fat and I’m always cold when others seem to be comfortable.
With no humidity, 98.6° F is pretty comfortable to me. I was in Las Vegas last weekend sitting on my dad’s patio; it was 105° F in the shade, with very low humidity. It was great. Here in Michigan I start to complain about the heat when it hits 80° F.