Avoid high-nitrogen fertilizers as they promote quick growth and attract pests. Don’t plant your avocado near a vegetable garden or perennial bed where bugs are most likely to be found.