A hardness testing method of a hardness tester, wherein hardness of a specimen is measured by loading a predetermined testing force from an indenter on a surface of the specimen placed on a specimen stage to form an indentation, then measuring dimensions of the indentation, the method comprising the steps of: positioning a first field lens above the specimen, then focusing on the surface of the specimen by changing a relative distance between the specimen stage and the first field lens; positioning a second field lens having a magnification power less than that of the first field lens above the specimen, then capturing a broad range image of the surface of the specimen with an image capturer; setting a test pattern comprising a plurality of test positions based on image information of the surface of the specimen captured in said broad range image; positioning the first field lens above the specimen, measuring a focus position at one or more predetermined test positions among the plurality of test positions set with said setting of the test pattern, then associating the measured focus positions with the test positions and storing the information in a memory; positioning the indenter above the specimen at each of the predetermined test positions and forming the indentation in each predetermined test position; again positioning the first field lens above the specimen, obtaining the focus position associated with each of the predetermined test positions from the memory and displacing the specimen based on the obtained focus position and the test position, and thereafter capturing with the image capturer, an image of the indentation formed in said positioning of the indenter; and measuring the hardness of the specimen based on the indentation, the image of which was captured in said again positioning of the first field lens above the specimen. positioning a first field lens above the specimen, then focusing on the surface of the specimen by changing a relative distance between the specimen stage and the first field lens; positioning a second field lens having a magnification power less than that of the first field lens above the specimen, then capturing a broad range image of the surface of the specimen with an image capturer; setting a test pattern comprising a plurality of test positions based on image information of the surface of the specimen captured in said broad range image; positioning the first field lens above the specimen, measuring a focus position at one or more predetermined test positions among the plurality of test positions set with said setting of the test pattern, then associating the measured focus positions with the test positions and storing the information in a memory; positioning the indenter above the specimen at each of the predetermined test positions and forming the indentation in each predetermined test position; again positioning the first field lens above the specimen, obtaining the focus position associated with each of the predetermined test positions from the memory and displacing the specimen based on the obtained focus position and the test position, and thereafter capturing with the image capturer, an image of the indentation formed in said positioning of the indenter; and measuring the hardness of the specimen based on the indentation, the image of which was captured in said again positioning of the first field lens above the specimen.