To remove the controllers, you should press the black button on the other side of the switch and slide the controllers.