Reuse indices passed in when possible (ie, IntegerVector case)