Time-related code cleanup

Clean up some time related code to track only in-game time for
scheduling.