Yes, a liquid in glass or digital thermometer is essential to verify the bath temperature. The thermometer should conform to the specifications set out in a test method (e.g. ASTM D445, IP71, ISO3104) and be calibrated e.g. by an ISO 17025 laboratory.