What are the natural strength limits for men and women?

Cap is (artificially) at peak efficiency for a human being thanks to the super-soldier serum. Not superhuman. Merely “all that he could be”.

So, not quite like the Batman - who is entirely natural (though often depicted as being a very tall and large man).

Sorry for the marginal relevance.