Fix crash on release of server with broken listeners