“That’s the esception that proves the rule.” Well, we have a name for rules which have exceptions–they’re called non-rules! I had it explained once that “prove” is used in the sense of testing the rule (and finding it wanting).
“You can’t have your cake and eat it, too.” Maybe that should be the other way around?