Press removeButton only when it is needed.