If you don't have professional termite protection around your home, you should be worried. When the termite colony in your neighbor's yard or house becomes mature, it will produce hundreds of termite swarmers. When this happens, your home is at risk of a termite infestation.