To remove old grout, use a grout saw or utility knife to score the surface of the grout. Next, use a putty knife or screwdriver to pry the grout out of the joints. Finally, use a vacuum or damp cloth to remove any residual grout.