Yes, you can paint over grout. Use a small brush for precision and to avoid uneven coverage.