Bottom line, a lot of the Presidents from pioneer times lived pretty physical lives before they got to the White House. I’ll wager Andrew Jackson and even U.S. Grant could’ve whomped up on ANY President we’ve had in the last 50 years (maybe except Eisenhower.)
In the last 50 years, I have to give high marks (begrudgingly) to Reagan, who was in great shape for a man of his age. Let’s not forget that Ford, although accused of being clumsy, was also in pretty good shape. Carter was (and still is) in good condition, although he always seemed more like a long-distance runner than a one-punch type.