I have allergies, and longish hair that blows in my face. Plus I have trouble hearing conversation if there’s a decent amount of background noise, so I hate going “what?” every other sentence when I’m trying to talk to my husband and wind is blowing right in my ear.
So far, the “biggies” are allergies and not mussing the hair.
Another reason - Contact lenses. If someone’s predispoed to dry eyes, wind + contacts = misery.
And yes, that concussive throbbing from having a window down can drive you nuts. Some cars aren’t susceptible to it - others will pound your ears into mush.
When I drive with the windows down I can hear all of the scary and expensive sounding noises that my rapidly aging car is starting to make. With them rolled up and the radio on I can continue in my blissful denial.
Oh, yea, the hair thing, too. When I had hair, it was long, which meant rolling the windows down would give me a faceful of my own hair.
I still enjoy rolling down the windows and cranking the tunes from time to time, but I don’t for plenty of reasons.
Convertibles are for people who are afraid of motorcycles.
Sunroofs are for people afraid of convertibles.
Having the windows down is for people who can’t afford convertibles, but still want to be hit in the face by bees. 
That being said, I miss my motorcycle and my full-face helmet (controllable wind, and no deafening noise).
I’ll leave my windows down if I’m going under 45 mph, and I keep a hair thing in the car just for that reason. More than 45, its just too noisy, plus the kids hate it.
I am honestly stunned at the replies to the OP…
on the rare occasion that I drive my car, my arm is hanging out the window. Unless it’s under 30 degrees. If it’s over 70 or so and I still have to drive the car for some reason, I usually take the time to roll down at least one other window. If it’s over 40 degrees and I have nothing to haul around, I’m on my bike. I’ve driven my car twice in the past 6 weeks, once to pick up my mom’s lawn mower, the other to return it.
If I’m by myself, I usually have a window down if it’s over 70 or so and I’m not on the highway. I always open the passenger side windows though, I actually get more air with less noise, and still don’t have to worry about the sunlight directly shining on my arm and burning it. My car gets a nice reverse breeze on the opposite side from the open window. If I have a passenger, I let them decide on their windows, but leave mine closed or only cracked.
I drove home with my windows down today in your honor, Indygrrl.
Add me to the short list of fresh-air aficionados.
I’ve never owned a car that had functioning air conditioning, and I haven’t had long hair since that unfortunate mullet era in the early 90’s, so there go those two issues.
I only roll up the windows when it’s raining hard. Light rain and snow I leave 'em down. If you’re going to pilot a 3,000 lb. machine down the highway at 70 MPH you ought to be able to FEEL IT ! This isn’t a video game, it’s Physics On Wheels.
The added benefit of discouraging condensation is there, but mostly I like having my elbow out the window and I really like the fresh air.
Fortunately, I don’t drive with passengers much so I don’t get many complaints.
I really love having my window down whenever possible, but not if I have no way to put my hair back (it’s dangerous if I drive with the windows open and my hair down, since it tends to whip in front of my face), and not if I’m driving at highway speeds.
Interestingly enough, the paternal unit (who often drives with the windows down himself) has been getting on people’s cases for driving with them down lately because “it messes with the aerodynamics of the car and wastes gas.” I’d like to know what he thinks running the AC does. (Maybe this isn’t such a problem in most cars, but I know my last one was much, much, much less fuel efficient when the air conditioning was on.)
I smoke, so my windows are usually open. The only time they’re closed is when I’m not smoking and doing 70 or more, because you get better fuel efficiency with the windows closed and air on above 60 or so.
At the moment? That would be all the damn pollen.
I like the windows open in the autumn, though…
Summer here in Florida is just too freakin’ hot. Gotta have the A/C.
Air, like marshmallow Peeps, must be properly aged to be enjoyed.
If you introduce too much fresh air to the mix at just the wrong moment, it loses its crunchy goodness.
Roadkill skunks are even worse. All the ripeness of possum, plus their own special perfume, which just gets more powerful when it ages.
I’d have to say that I drive with the windows up all the time mostly because I have very long hair (nearly waist length) and because of allergens/pollutants. I’m miserable enough even when I don’t go outside for days at a time during the spring. Driving around with the window down would just ensure that I never breathe through my nose again. In addition, I just don’t like the wind blowing against me. I like a nice gentle CONTROLLED air flow, thank you.
The noise, which drowns out any conversation I’m having and destroys any music I’m listening to…
The wind blowing stuff into my contact-beladen eyes, making me squint and cry and have to pull over to the next grundgey gas station bathroom to fix things up (unfortunely the smeared make up can’t always be fixed up okay)
The cold, which raises goose bumps and provokes shivers at temperatures that most people find comfortable. I get really uncomfortable in the cold, and when I am cold my only thoughts are about being warm again, and I am unable to enjoy anything. I dress appropriately for the weather, but that doesn’t always include planning to spend some time in a wind tunnel.
Finally, I can’t stand the constant beaten down feeling of wind in my face. I’m always worried if it’s about to blow something horrible into my eyes, and it just makes me feel bombarded and uncomfortable. Sometimes I’ll have a stream of air blowing above my head, but if I’m full on facing the wind, I’m gonna be hating life.
Fresh air is nice.
Air coming through the windows of my car while I’m on the freeway isn’t fresh, it’s full of exhaust and pollution - that doesn’t smell good at all.
Also, your threshold for “warm” may be lower than theirs. I could drive around with the windows down right now as I’ve seen some other people do, but it would tend to counteract the heater that I’ve still got running. Stuffy isn’t the best thing in the world, but it beats being cold by a very wide margin.
Well, some people find Terry Gross’ manner offputting.
What? Oh.
Unless it’s below 20 or above 85, my windows are down. Well, they’re always cracked a little (I can’t STAND stuffy air). UNLESS I’m going more than 70. Then it’s too loud.
Thankfully, my dad will be fixing my AC before I move to TX (Mmm, June in TX), so I’ll actually have the option to have the windows up when it gets warm.
Damn! You guys are sissies with your long hair and allergies…j/k 
I guess I can understand all of those reasons, but still…the first warm day, I love that air. I know I’m a minority, but I hate a/c. I’ll take pollen, roadkill, noise, dirt, hair in the face, all day long before I’ll turn on that a/c. Maybe it’s because I freeze all day at work, I don’t know.
But thanks for answering, you’ve relieved me of my ignorance on the topic.