Installing a cover should not void your warranty as long as the cover does not modify or damage the water heater and is installed according to the manufacturer's guidelines. However, it's always a good idea to check your warranty details or consult with the manufacturer before adding a cover.