Signs of a bad water heater thermostat include fluctuating temperatures, failure to heat water at all, or overheating that can lead to dangerously hot water. A multimeter can also be used to test the thermostat for continuity. Consult with a professional for an accurate diagnosis.