remove button from subview before swapping them