Make sure REPL sockets are cleaned up no matter how the server shuts down