I prefer bedtime-sex; hubby prefers first-thing-in-the-morning sex; middle of the night, wake-each-other-up sex seems to be the happy medium! 
I have trouble sleeping as it is so never try to wake me up. The boyfriend should know this by now but every so often I feel him rubbing against me which either results in me hitting him in my sleep or waking up enough to tell him to leave me alone.