I think you are perfectly sensible - I am pretty much the same way. I just can not understand laying out on a beach surrounded by jackasses and sweating, getting sand everywhere and then having to figure out how to change clothing or drive home on leather seats without getting them screwed up with salt and sand.
I have decided the only way I will enjoy swimming in the ocean from now on is living in a beach house, or from a personally owned/rented boat.
Don’t get me wrong, I adore swimming, diving, or even just being on the water in a boat. There is nothing better than being 20 feet underwater shadowing some tasty looking crustacean along the bottom ‘shopping’ for supper in warm water. But as i said, it is the getting between home and crustacean that is the problem.