Always set history time to the time the change came in.