Remove controls when you give up or win