There are a variety of ways to rid yourself of bees in a natural way, and they are secure for the bees as well as the surrounding environment. Call a Beekeeper Get rid of bees with the smell of smoke. Moth Balls Bitter Almond oil Vinegar Spray Solution Cinnamon Garlic Spray Citronella Candles Method of trapping a single or a handful of Bees Bee Trap