No, replacing a heater without a permit is unsafe and illegal. Replacing a heater without a permit could cost you hefty fines and heavy penalties like invalidating your home insurance. Also, your local building and safety department may require you to get the necessary permits at a higher price and ask you to undo all the work—putting you back at square one.