To get rid of carpenter bees, it is essential to use a combination of strategies. While citronella oil or tea tree oil may have some repellent effects, they are not as effective as other methods.