The drain plug of a hot water heater should be removed regularly to facilitate the flushing of any sediment or heavy metals that may have accumulated inside the tank. This helps maintain the interior of the tank and ensures the best performance of your water heater.