Autumn olives are considered invasive because they spread rapidly and outcompete native plants for resources. They can quickly dominate an area, negatively impacting the ecosystem.