Well, that’s the issue, isn’t it? The basic anti-cancel-culture argument seems to be:
We mustn’t discourage speech that could have the “consequences” of insulting and offending a lot of people. And therefore we must discourage speech that could have the “consequences” of widespread disparagement or unpopularity for the authors of the insulting and offensive speech.
Who gets to “stifle” whom?