Small mammals like skunks, raccoons, moles, badgers, and shrews often prey on Yellow Jackets. These small mammals have a high sense of smell and can tell if Yellow Jackets reside in a nest. They’ll dig up the nest and destroy it. They’ll then eat up the insects. In other words, if any of these rodents dominate an area, they can prey upon Yellow Jacket, destroy their nest, and eat the insect.