Abstract remove methods into one remove method that removes arbitrary subviews.