after getting matchers for pm or prefix, add in the skip_prefix matchers