Revert "timekeeping: Avoid possible deadlock from clock_was_set_delayed"

This reverts commit bcc4e1945d95ef6261f79f8787fd81adb5beaee3.