If you see mold, mildew, or discoloration along the caulk line, or if the caulk feels brittle or is peeling away from the seam, it's time to replace it. You may also notice leaks or water damage around the shower, which can be caused by faulty caulking.