To remove the controllers you can be pressed on the small round black button on the other side of the switch, and slide them out.