I’ve been a small business owner for 20+ years. I agree with everyone who says get an accountant (the right accountant) and a lawyer. We haven’t used our lawyer for much over the years but they did get our articles of incorporation set up or whatever. Then they helped us with a trademark issue at some point.
Pick a good bank for your business banking. One with a nearby branch that has services you want/need. Our bank, PNC, changes managers way more often than I’ve met with managers but I’ve still met with managers over the years. Every so often I need to turn to them for something and it’s nice to have someone’s direct email and phone number for quick questions.
I use Quickbooks to manage all my money and subscribe to their payroll service which configures my employee payroll deductions for me. They update all the time, as tax rules change. I also am able to do direct deposit through Quickbooks, which is very handy. It’s like $1200/year for Quickbooks + Payroll + payroll fees, which seems like a lot but it’s SO worth it. I’m a programmer, not a finance director!
I pay and file almost all of my payroll taxes online, quarterly. Every quarter I export reports from Quickbooks to send to my accountant, along with all the tax filing receipts for the past quarter. They look it over, send me some forms that need to be signed and sent to the tax agencies, and then send me a bill. Every February I send them a different set of info for corporate tax.
The small business association/PEO suggestion is good too. We used to belong to one (COSE in Cleveland) but when my partner moved out of state it was cheaper for us to each get our own ACA health plans.