Poll for observatory connection until timeout