Record idle time for workers