Clean up some of the current time view stuff in module state. Depend more on the refresh flag.