Only toggle when buttons are pushed down.