Handle removal of items on drag outside of the sortable.