Don't hide the controller part each time one of the buttons isn't pressed.