The size of an asteroid determines the potential damage it can cause upon impact. Even small asteroids can have significant local effects, while larger ones have the potential for widespread destruction.