Correctly destroy the manager and players on disable