Add method to remove the server in the cache.