Use sets instead of vectors for OpInfo