Very small performance increment by breaking the loop if we found the index to be removed.