I have lived in the inner 'burbs of Sydney for 40 years.
I have never worked in the CBD itself. For a couple of years was working on the southern edge. But for most of the period worked in the Inner West region.
I go into the city for services, entertainment etc probably every month or so. Would drive through, under or around the CBD more frequently. Parking can be an expensive pain so usually I would take a bus. The 'burg I reside is on a major arterial road (not a freeway) and it’s reliably 15-20 mins into the city at any time of the day.
It’s not a pain to do the commute.
Just most of the services I regularly consume are closer or more convenient.
… and just while you are there, a heads up that it’s the last week to join in an expression of international goodwill, both fun and harmless.