Don't register subviews multiple times for remove