I withdrew $ 4,000 and my bank wants to know why

That offended you?! You should be thankful they give a damn because it is HIGHLY unusual, especially considering the fact that you could have created a check for that amount or, perhaps, done a wire transfer.

Also, it’s much easier for them to duck the IRS when doing a cash transaction like that.