Heart rate after a weekend "splurge"

I work out 4-6 days per week. I give myself leeway on the weekends to have a few drinks, to eat a bit outside of my “health plan” (nothing excessive, just splurging in moderation), and to rest. It always happens that on Monday morning, I have a hard time getting my heart rate to my goal range (which is the rather low, fat-burning range). I have to work out much harder to get it there, then Tuesday I have a little less difficulty getting to that range, and then by Wednesday I’m able to get to that range without extra effort. This does not happen after my “off days” during the week.

What is going on here? Why does it take at least a whole day to get back into the heart rate rhythm after a bit of indulgence? Is it the booze/food?