A continuous heating furnace comprising: a furnace main body; a conveyance unit configured to convey a baking object in the furnace main body; one or a plurality of closed type gas heaters each having an introduction hole into which a fuel gas flows, a combustion chamber in which the fuel gas introduced from the introduction hole is combusted, a guide section configured to guide an exhaust gas generated by combustion in the combustion chamber, a first radiation surface extending in a direction perpendicular to a conveyance direction of the baking object and configured to be heated by the combustion in the combustion chamber or heat of the exhaust gas flowing through the guide section to transfer radiant heat to the baking object, and an exhaust hole through which the exhaust gas that heated the first radiation surface is discharged, and disposed in the furnace main body; and one or a plurality of exhaust heat transfer units (214, 314) juxtaposed with the closed type gas heater in the conveyance direction of the baking object, disposed in the furnace main body, and each having: a second radiation surface (214a, 314a) that is configured to be heated by the exhaust gas to transfer the radiant heat to the baking object; and a heat transfer acceleration unit (216, 316) that is configured to accelerate heat transfer from the exhaust gas to the second radiation surface (214a, 314a) at one end side in a direction perpendicular to the conveyance direction of the baking object in the second radiation surface (214a, 314a) and includes an introduction path (216a, 316a) which communicates with the exhaust hole of the closed type gas heater so that the exhaust gas from the exhaust hole flows through an interior of the exhaust heat transfer unit (214, 314). a furnace main body; a conveyance unit configured to convey a baking object in the furnace main body; one or a plurality of closed type gas heaters each having an introduction hole into which a fuel gas flows, a combustion chamber in which the fuel gas introduced from the introduction hole is combusted, a guide section configured to guide an exhaust gas generated by combustion in the combustion chamber, a first radiation surface extending in a direction perpendicular to a conveyance direction of the baking object and configured to be heated by the combustion in the combustion chamber or heat of the exhaust gas flowing through the guide section to transfer radiant heat to the baking object, and an exhaust hole through which the exhaust gas that heated the first radiation surface is discharged, and disposed in the furnace main body; and one or a plurality of exhaust heat transfer units (214, 314) juxtaposed with the closed type gas heater in the conveyance direction of the baking object, disposed in the furnace main body, and each having: a second radiation surface (214a, 314a) that is configured to be heated by the exhaust gas to transfer the radiant heat to the baking object; and a heat transfer acceleration unit (216, 316) that is configured to accelerate heat transfer from the exhaust gas to the second radiation surface (214a, 314a) at one end side in a direction perpendicular to the conveyance direction of the baking object in the second radiation surface (214a, 314a) and includes an introduction path (216a, 316a) which communicates with the exhaust hole of the closed type gas heater so that the exhaust gas from the exhaust hole flows through an interior of the exhaust heat transfer unit (214, 314).