Question about "The Tudors"

I’m watching season 1 currently, and I may have missed something regarding the Boleyn girls’ dad and uncle. They seem to hate Cardinal Wolsey, but I’m not exactly sure why.

I don’t watch The Tudors, but historically, both Henry VIII and Anne Boleyn disliked and distrusted Wolsey because of Clement VII’s delay in approving the annulment of Henry’s marriage to Catherine of Aragon. They both thought the delay was Wolsey’s doing because he was more loyal to the church than to England.

Given Thomas Boleyn’s ambition to get his daughter married to the king, I wouldn’t doubt that this was also their motivation for hating Wolsey.

Plus, weren’t they all starting to have Protestant leanings, at least in secret and Cardinal Wolsley was a symbol of the Pope’s power in England?

I am becoming a Tudor (history and the show) junkie but still learning :).