You could just...stay in bed and keep sleeping? XD Or can you not go back to sleep?

Can't be that detrimental if you're still together with no major issues. Though I do get preferring to be on the same schedule as well, J wants to be back on the same schedule but I don't want to go to bed at the time he wants to go to bed as that's when I'm most on fire x_x