Fix race condition on supervisor test