Update minimum size when an element is removed