Return 503 whenever delegate is not available
Alternative solution that avoids need for additional thread (turns out we already use a separate thread to start Jetty, but had no way to avoid waiting in the calling thread)