There’s a few singers I like, mostly male, who I can only handle in small doses. I can’t explain it. There’s just some odd quality about their voices that just, well, get on my nerves.
Examples:
James Taylor
Gordon Lightfoot
Chrissie Hynde (although I could listen to “Back on the Chain Gang” over and over again)
Robin Wilson (Gin Blossoms)
Bob Dylan
Tom Petty
Anybody else have this problem?
Hootie, from Hootie & the Blowfish.
I know what you mean. I feel that way about Leonard Cohen. When I’m in the right mood, I love his songs but I can’t listen to them for very long. It’s partly because I find the music itself kind of repetitive, and his lyrics, which often feel just like random handfuls of images roped together, sometimes get on my nerves
yin? yen?
Ya gots sumtin 'gainst Japanese singers? 
To answer the OP: Freddy Fender.
Norah Jones. She has such a beautiful voice but I wouldn’t want to listen to it over and over.
The guy from the Tragically Hip has such an Anti-Good voice. I love it, but can’t listen to it for too long.
How 'bout Wittless Houston? I can’t take her screaming, IMHO. In fact, I think I needed a Rx to buy a CD of hers, and the CD had a lable saying to use only in small doses! 
- Jinx
Oh, I must add Barbara Streisand. I know, Babs, but please!
This will rub many the worng way because she is such an icon in the Arts. But, I can only take her singing in small doses, too. Sorry…
Ok, I will admit…I’ve grown a bit more tolerant in my “old” age.