There’s rarely that much traffic on my commute, so the time of day doesn’t matter. My drive is pretty much always right at 20 minutes.
What does matter are two things, one I can anticipate, and one I cannot:
I can anticipate game days. We have a prominent college football team just up the road from where I work, and my commute travels down the major artery feeding that college (and unfortunately has to cross it - left turns) for a small while. When a game is afoot, a segment of road that normally takes less than 5 minutes is extended to about 15, sometimes 20, depending on time of day and who is playing.
What I can’t really anticipate? Slow people.
I (and most other people around here) think of our single-lane, curving country highways as having defacto 60MPH speed limits. Obviously you have to slow down for intersections and blind curves and schools, but the majority of the road (regardless of the posted speed) can be driven at about 60, and that’s what most people do. It works quite well most days. However, on occasion there will be someone who either did not get the memo, or is driving something that is unable to perform to specs:
Tractors.
Oversize tractor-trailers pulling doublewide homes.
People in trucks held together with duct tape and string. (These are great, because usually there are bonus fumes, meaning when I get to work I am not only late, but have a nasty headache.)
Old people. They don’t have anywhere to be, so obviously neither does anyone else! Their reaction times are slowed, and so is their driving speed. Makes sense, but god it’s annoying.
Student drivers. I also have a highschool on my route, and depending on the date and time, will end up behind skittish colt drivers poking down the road at the massive intimidating speed of 20 mph while they get their sea legs. Again, totally understandable, but I have to get to work!
So, my differential is between 10 and 25 minutes, turning a 20 minute drive into a half hour or 45 minute one.