Replacing all of your grout normally isn't the best option. Instead, remove the top layers of grout with a chisel tool, since that’s the layer that is permanently stained. Then, apply a new layer of grout over the old. The original grout gives the new material something more to bond to, keeping it firmly together.