How did 'not to mention' end up meaning 'mention'?

This, from a guy who eats anything.