SwipeDismissAdapter should not count header views into removed positions