Address race condition in supervisor on Illumos.

Sleep on other platforms to avoid the race.