The asteroids in the asteroid belt were in a region of space where growth into a larger body was made impossible because of repeated gravitational disruption by the mighty Jupiter. This is why these asteroids didn't end up accreted into the planets.