Handle race where a service is unmonitored before it is monitored