Adjust timeout for KeyWatcher

Take the time spend in the main loop into consideration when pausing
between loads.