Don't add ops to the connection if the connection is down