Remove sort index when destroy