Avoid fatal error in DESTROY with find_master and no server

If a client is created with 'find_master' true and no server is
available, the code was dying during DESTROY because that method
assumes a connection pointer is already attached to the object.

This commit lets DESTROY check the pointer without the fatal
error.