One way to keep a cold frame warm at night is to cover it with an insulating material, such as blankets or straw. Another option is to use a heat source, such as a small electric heater, to keep the frame warm.