Set in the lower kitchen somewhere is a clock that looks like this. It goes through the 21 hours that people are awake for, and doesn't become out of sync from time when people aren't.

Thanks to Elidibus/Elidibus's player for the graphic - and clock!