Delay sidekiq restart

If we restart the workers and then restart god before it's done, I'm
fairly certain that the workers won't be restarted correctly.