PatternFeatureVectorMap uses vector of pointers now (possible memory leak
still!)