Press remove button only when it is necessary.