Propane RV water heaters take around 51 minutes to heat up a ten-gallon tank, and around 31 minutes for a six-gallon tank. However, using electrical or both elements can result in much slower or quicker heating times.