Yes, the class order must be known to output the precision, recall, fscore in the right order (see averaging type is equal to None).