to_annotation handles posterior probabilities for open-set identification