Homebrew, do you know what a phobia is?
Operating on the assumption that you do: the original meaning of the word was quite closely linked to the concept of “homosexual panic”: the unreasoning terror that would (supposedly) sweep over when they perceived suggestions that they were homosexual or when homosexual advances were directed at them. The “psychological cause” of homosexual panic was repressed homosexuality. This was once considered a valid defense for people who had committed assault/murder against a gay person, believe it or not.
Such people were considered to suffer from homophobia. Hatred went along with it, of course (how many people are terrified of spiders but don’t hate them?), but that’s not the focus.