Hawthorne quote about Andrew Jackson, where from?

I remember a quote that stood out to me years ago when I was reading some old book in a library, maybe it was a biography of Andrew Jackson, or maybe it was mentioning the early Tennessee political history, but it gave a quote about Andrew Jackson, supposedly by Nathaniel Hawthorne, and it went something like this:

Is this quote from Hawthorne? What is the exact quote? What book was I reading?

Not the source of the quote, but it’s mentioned in this bookabout FDR, though slightly different: