I read this between 1975 and 1979 in a library book - a collection of science fiction stories by various authors. I do not remember the editor or any details about any other story in the collection.
The story took place in a place where there was a city up on a hill where the special people lived. The protagonist decides that he should be a special person, too, and so drives up toward the city. He has trouble driving in the city because the other cars are going very fast and there do not seem to be traffic signals. He is pulled over by one of the special people, who explains that our hero is causing problems on the road for all the other drivers because - well, if I remember correctly, because he is just not smart enough. Everybody else on the road is making the right/logical driving maneuver all of the time and the presence of somebody who is not is dangerous. It seems that the people up on the hill are using all of their brains or something and there is no room in their society for dumbasses. The protagonist is not barred from the society on the hill, but told in no uncertain terms not to continue endangering lives with his tentative, indecisive and foolishly dangerous driving. Our hero ends up deciding that he does not want to have anything to do with the people on the hill.
I have thought about this story many times in the last 30 years and would like to find and read it again. Does this ring any bells out there?