Product review (5 stars): Thermostat Kit
The thermostats were very easy to replace.  They were very inexpensive.  It turns out that it did not fix it, but at least I could rule out the thermostats.  I ended up replacing the solenoids for the gas burner which solved the problem.