Oppressed by the man?

So where does the concept of using the phrase “the man” to mean oppressive or overwhelming authority come from originally?

The first time I heard it was from Stokely Carmichael, I think. He also coined “black power”.

Probably from the concept of “the man in charge,” extended to mean any people or institutions in a position of power or privilege.

It long predates Carmichael. It was used by Leadbelly (Huddie Ledbetter) in his classic blues Midnight Special. I’m not sure of the date of “Midnight Special,” but Leadbelly died in 1949.

“The man” in this case indicates prison guards.