Phrases/terms that aggravate the hell out of you

I suspect that the reason is that many states call their lower house members “Representatives” as well, so by calling them “Congressmen”, it is a one-word way to differentiate them from their state counterparts.