I live in a non-daylight savings state, for about 40 years now.
I never have to think about it until I’m going to call elsewhere in the US which is rare. If you don’t have to think about it often, it IS confusing. And I find the whole mess irritating. I can’t tell you how many times, after the time change people ask me to tell them what the difference in time is between their state and mine. My response is always, “No. MY time did not change, YOURS did. Therefore YOU, not ME are in charge of keeping track of this."
I find it a lot less confusing now that we have the interwebs to keep track of everything for us.