Don't remove on RemoveListener anymore and require to call DragSortListView.removeItem(int) for removal