I think what a lot of people don’t understand is that people are allowed to hate anyone for whatever reason they wish — whether it be from something as trivial as having a pencil stolen from them in nursery school, to something controversial like a person’s skin colour or sexual identity. And you’re allowed to hate those people with hateful opinions as much as you like as well.
What’s not okay is expressing those opinions in a way that’s abusive, inflicting a sense of worthlessness or shame on the people you dislike.
This means that if someone has racist opinions, or homophobic or transphobic or whatever the case might be, so long as they aren’t doing other people verbal or physical harm — you have no reason to beat them up over their views. It’s hypocritical and unfair.