From the poll I started over here (thanks to all the participansts!) I guess I can say that the problem of wearing MAGA hats is not a serious one, as only two (edit: 3 of 85 now) respondents out of 84 so far wrote that they see them often, none sees them all the time, a small minority sees them every now and then, the rest (75%) sees them seldom or never.
Therefore when you actually see one, it is shown with a purpose, and that purpose is nefarious: provocation, owning them f*cking libruls, thus, yes: hate speech or on the way there.
This, or you are not representative at all. But I believe you are.