Removed peer removal code

ZeroMQ does not have invalid addresses/ports so if a server is not
connectable it will not throw errors, but wait to connect eventually.