Ants can be damaging to block paving in yards and gardens as they burrow underneath and between them, encouraging the growth of moss and weeds in the gaps which can further disrupt the paving and make it look worn down. If this is happening in your outdoor space, it may be worth looking for some natural ways to dissuade them out of your yard before trying to make any repairs to prevent new damage from undoing your hard work.