Moth Balls: There are some smells that bees don't like and mothballs are one of them. To use mothballs, hang them near the bee nest or nests, and eventually, the smell will deter the bees from coming back. You can also hang mothballs in different places around your yard to keep your entire yard bee-free.