My cat has bitten and scratched me too many times

He was neutered at the shelter when he was around 10 weeks old; they had me bring him in. Maybe he does have an extra gonad, but I haven’t seen any male signs like spraying or the thick jowls.
He’s up to date on all his shots but according to this thread, bites and and scratches from vaccinated cats can be dangerous too: Bitten and scratched by a cat. What to do? - Factual Questions - Straight Dope Message Board

We do have feral and/or stray cats in the neighborhood, not sure if any of them are female. I know that I’ve been attacked in the dead of winter when all the windows are closed.

I hadn’t thought about a vet visit, but I don’t think that my husband is willing to give it another chance anyway. The cat usually sleeps at our feet, or cuddled up to my husband, but he won’t even let him in our room now.

Yes, I know that being a biter will make him unadoptable, which makes me really upset.