The Exception that Proves the Rule

The former.

This site shows the origin of the phrase. I found it very clarifying. As this phrase always confused me as well. Some of the statements of others touched on the same info.