Patent ID: 12235425

DESCRIPTION OF EMBODIMENTS

The technical solutions in the embodiments of this disclosure are clearly described below with reference to the accompanying drawings. Apparently, the embodiments to be described are merely a part rather than all of the embodiments of this disclosure. All other embodiments obtained by a person skilled in the art based on the embodiments of this disclosure without creative efforts shall fall within the protection scope of this disclosure.

In this disclosure, unless otherwise clearly stipulated and limited, that a first feature is “above” or “below” a second feature may include that the first feature directly contacts the second feature, or may include that the first feature does not contact the second feature directly but contacts the second feature by means of another feature between them. In addition, that the first feature is “above” the second feature includes that the first feature is right above the second feature and is not right above the second feature, or merely represents that a horizontal height of the first feature is higher than the second feature. That the first feature is “below” the second feature includes that the first feature is right below the second feature and is not right below the second feature, or merely represents that a horizontal height of the first feature is lower than the second feature.

Referring toFIG.1, in the related art, a microscope100is provided. The microscope100includes a microscope body101, microscope-body-stage focus adjustment knobs102, a microscope body stage103, a sample104, a objective lens105, a trinocular tube106, a camera107, and an eyepiece108. The microscope body stage103is disposed above the microscope body101, and the sample104is placed on the microscope body stage103for be observed. The microscope-body-stage focus adjustment knobs102are disposed on one or two sides of the microscope body101, and the objective lens105is located above the microscope body stage103. The trinocular tube106is further disposed above the objective lens105, and the trinocular tube106is respectively connected to the camera107and the eyepiece108. The microscope-body-stage focus adjustment knobs102can be adjusted to adjust the microscope body stage103to rise or fall in a vertical direction, so as to change a distance between the microscope body stage103and the objective lens105to implement focus adjustment. The objective lens105may alternatively be moved to change a distance between the microscope body stage103and the objective lens105to implement focus adjustment.

A premise of performing focus adjustment on the microscope100is an assumption that an end of the eyepiece108and an end of the camera107of the trinocular tube106are parfocal. However, an image of the camera107and an image at the end of the eyepiece108may be not parfocal due to various reasons. For example, the reasons may include that objective lenses105of different magnifications are not parfocalized well, that eyes of different users of the microscope100have different diopters, or that when the user of the microscope100changes, a new user does not have the consciousness of adjusting a diopter knob of the eyepiece108and instead, directly adjusts the microscope body stage103to refocus a sample, and so on. The reasons may all cause the image at the end of the eyepiece108of the microscope100and the image at the end of the camera107to be not parfocal. As a result, when the human eye sees a clear image, the camera107acquires a defocused image. Consequently, the correctness of an analysis result of an image algorithm cannot be ensured.

To improve the focus accuracy of images acquired by a camera, the embodiments of this disclosure provide a microscope system, and the microscope system is described in detail below.

ReferringFIG.2, the embodiments of this disclosure provide a microscope system200. The microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a focusing device50. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other, the first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30is in communication with the beam splitter20, the image projector assembly30includes a first lens32and an image projection device31, and light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The focusing device50is disposed on the camera assembly40, and the focusing device50is configured to perform focus adjustment on the camera.

The objective lens10, the beam splitter20, the image projector assembly30, the camera assembly40, and the focusing device50may be mounted on the microscope body to form a whole. Correspondingly, an eyepiece70may be further disposed above the beam splitter20, and the eyepiece70is configured to observe an image of a sample80.

The first end10aand the second end10bare disposed opposite to each other, and positions of the first end10aand the second end10bcan be exchanged. In this embodiment, unless otherwise specified, the first end10ais a lower end of the objective lens10and the second end10bis an upper end of the objective lens10. The first end10aof the objective lens10faces a to-be-observed object. That is, the first end10aof the objective lens10is directed at a sample, and the sample80may be imaged by using the objective lens10.

In addition, the beam splitter20is disposed on the second end10bof the objective lens10. That is, the beam splitter20is disposed on the upper end of the objective lens10, and the beam splitter20may reflect a part of light and transmit another part of the light.

In addition, the image projection device31may project a projection of augmented reality information, and a scene in which the sample80and the augmented reality information are superimposed may be observed at the end of the eyepiece70.

In addition, the camera assembly40may receive the light reflected or transmitted by the beam splitter20. The camera41may scan the image of the sample80. Specifically, the camera41may provide a function of scanning a focal plane.

In addition, the focusing device50is disposed on the camera assembly40, and when the image scanned by the camera41is inaccurately focused, the focusing device50may cause the camera41to perform focus adjustment, thereby ensuring that the camera41obtains an accurately focused image.

The microscope system200further includes a trinocular tube60. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20, one of the channels62is in communication with the eyepiece70, and the tube lens61is located on one end proximate to the beam splitter20.

The trinocular tube60may include a plurality of channels62, that is, a plurality of light paths may be divided along the trinocular tube60. One of the channels62is in communication with the eyepiece70, and the sample80may be observed by using the eyepiece70.

The focusing device50includes, but is not limited to, a moving component51and a zoom lens52.

The focusing device50may include a moving component51, a zoom lens52, and the like. It may be understood that the moving component51may drive the camera41to move to implement zooming of the camera41. The moving component51may be a linear moving platform511, a telescopic sleeve512, or the like. The zoom lens52may be disposed in front of the camera41, and zooming of an image obtained by the camera41is implemented by using the zoom lens52. The zoom lens52may be a liquid zoom lens52, or certainly may be another zoom lens52. Therefore, there may be a plurality of structure forms of the focusing device50. Details are not described in this embodiment of this disclosure.

Referring toFIG.3, the moving component51includes a linear moving platform511. The linear moving platform511is configured to drive the camera assembly40to approach or leave the beam splitter20to perform focus adjustment on the camera41.

The linear moving platform511may be mounted on the microscope body, and the camera assembly40may be driven by the linear moving platform511to move. The linear moving platform511drives the camera assembly40to move, so as to focus the camera41. The linear moving platform511has relatively high movement accuracy. For example, the linear moving platform511may have a movement accuracy of 0.5 nm, a minimum step size of 2 nm, a movement range of 13 mm to 52 mm, and a maximum load-bearing capacity of approximately 2 kg. The linear moving platform511drives the camera assembly40to move to focus the camera41, so that the focusing accuracy of the camera41can be improved.

The microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a trinocular tube60. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other. The first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30is in communication with the beam splitter20. The image projector assembly30includes a first lens32and an image projection device31, and light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20. One of the channels62is in communication with an eyepiece70. The tube lens61is located on one end proximate to the beam splitter20, and one of the channels62in the trinocular tube60is in communication with the camera assembly40. The camera assembly40further includes a first polarizer42, and the first polarizer42is located between the camera41and the trinocular tube60. The linear moving platform511drives the camera41to approach or leave the beam splitter20.

In this embodiment, a light path of the microscope system200is as follows: light of the objective lens10is transmitted to the beam splitter20; light of the image projection device31is transmitted to the beam splitter20, and the beam splitter20transmits the light of the objective lens10and the light of the image projection device31to the trinocular tube60through the tube lens61; the trinocular tube60respectively transmits the light to the first polarizer and the eyepiece70through the two channels62, and the light passing through the first polarizer42is transmitted to a photosensitive chip of the camera41; then, an image of the sample80may be observed by using the eyepiece70.

It may be understood that the camera41is driven by using the linear moving platform511to approach or leave the beam splitter20, and when an image of the sample obtained by the camera41is out of focus, the linear moving platform511may be adjusted to drive the camera41to move, so as to focus the camera41, thereby ensuring that the image scanned by the camera41is an accurately focused image.

Referring toFIG.4andFIG.5, in this embodiment of this disclosure, the microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a trinocular tube60. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other, the first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30includes a first lens32and an image projection device31, and light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20. One of the channels62is in communication with an eyepiece70, and the tube lens61is located on one end proximate to the beam splitter20. The beam splitter20includes a first sub beam splitter21and a second sub beam splitter22. The first sub beam splitter21is in communication with the second sub beam splitter22, the first sub beam splitter21is in communication with the image projector assembly30, and the second sub beam splitter22is in communication with the camera assembly40. The camera assembly40further includes a second lens43, and the second lens43is located between the second sub beam splitter22and the camera41. The linear moving platform511drives the camera41or the second lens43to approach or leave the second sub beam splitter22.

In this embodiment of this disclosure, a light path of the microscope system200is described as follows: Light of the objective lens10is transmitted to the second sub beam splitter22, and the second sub beam splitter22reflects a part of the light to the second lens43and transmits the part of the light to a photosensitive chip of the camera41. The second sub beam splitter22transmits a part of the light to the first sub beam splitter21, and light of the image projection device31is transmitted to the first sub beam splitter21through the first lens32. The first sub beam splitter21transmits the light transmitted by the objective lens10through the tube lens61and reflects the light transmitted by the image projection device31through the tube lens61to reach the trinocular tube60. The trinocular tube60transmits the light to the eyepiece70, and an image of the sample80may be observed by using the eyepiece70.

It may be understood that the camera41or the second lens43is driven by using the linear moving platform511to approach or leave the second sub beam splitter22, and when an image of the sample obtained by the camera41is out of focus, the linear moving platform511may be adjusted to drive the camera41or the second lens43to move, so as to focus the camera41, thereby ensuring that the image scanned by the camera41is an accurately focused image.

Referring toFIG.6andFIG.7, in this embodiment of this disclosure, the microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, a trinocular tube60, and a focusing device50. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other, the first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30is in communication with the beam splitter20, and the image projector assembly30includes a first lens32and an image projection device31. Light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20. One of the channels62is in communication with an eyepiece70, and the tube lens61is located on one end proximate to the beam splitter20. The camera assembly40and the image projector assembly30are disposed opposite to each other along the beam splitter20. The image projector assembly30further includes a second polarizer33, and the second polarizer33is located between the first lens32and the beam splitter20. The camera assembly40further includes a third lens44and a third polarizer45, the third polarizer45is located between the beam splitter20and the third lens44, and the third lens44is located between the third polarizer45and the camera41. The linear moving platform511drives the camera41or the third lens44to approach or leave the beam splitter20.

In this embodiment, a light path of the microscope system200is explained as follows: Light of the objective lens10is transmitted to the beam splitter20, and light of the image projection device31is transmitted to the beam splitter20through the first lens32and the second polarizer33. The beam splitter20reflects the light of the objective lens10and transmits the light to a photosensitive chip of the camera41through the third polarizer45and the third lens44. The beam splitter20reflects the light of the image projection device31through the tube lens61, and then transmits the light to the trinocular tube60. The trinocular tube60transmits the light to the eyepiece70through the channels62, and an image of the sample80may be observed by using the eyepiece70.

It may be understood that the camera41or the third lens44is driven by using the linear moving platform511to approach or leave the beam splitter20, and that when an image of the sample obtained by the camera41is out of focus, the linear moving platform511may be adjusted to drive the camera41or the third lens44to move, so as to focus the camera41, thereby ensuring that the image scanned by the camera41is an accurately focused image.

The moving component51further includes a telescopic sleeve512. The telescopic sleeve512is connected to the camera assembly40and the telescopic sleeve512drives the camera assembly40to move forward or backward in the telescopic sleeve512to perform focus adjustment on the camera41.

The telescopic sleeve512may include a driving motor and a sleeve, and the driving motor can drive the sleeve to move forward and backward. The sleeve may be mounted on the camera41, and the sleeve may drive the camera41to move forward or backward to implement zooming of the camera41. A lens or a lens group may be mounted in the telescopic sleeve512, and the telescopic sleeve512may drive the lens or the lens group to move. For example, the driving motor may be a direct-current motor or an alternating-current motor. In another example, the driving motor may be a stepper motor, an ultrasonic motor, or the like. In this embodiment of this disclosure, a specific type of the driving motor is not described in detail.

In some embodiments, a lens assembly equipped with the telescopic sleeve512is provided. The lens assembly equipped with the telescopic sleeve512includes a sleeve and a fixed-focus lens. The fixed-focus lens is mounted on the sleeve, and the sleeve may drive the fixed-focus lens to move. When the sleeve stretches and contracts, the outside of the sleeve does not rotate but linearly advances, stretches, and contracts. Therefore, the camera41does not rotate with the sleeve. In addition, the camera41may include a processor or a single-chip microcomputer.

In addition, whether the lens or the lens group is mounted in the telescopic sleeve512may be defined according to a specific configuration of the camera41. When the tube lens61of the camera41has a relatively long working distance, a combination of the telescopic sleeve512and a lens or a sleeve assembly is not required. When the tube lens61of the camera41has a relatively short working distance, the telescopic sleeve512and the lens or the sleeve assembly need to be used in combination.

Referring toFIG.8, in this embodiment of this disclosure, the microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a trinocular tube60. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other, the first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30is in communication with the beam splitter20, and the image projector assembly30includes a first lens32and an image projection device31. Light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20. One of the channels62is in communication with an eyepiece70, and the tube lens61is located on one end proximate to the beam splitter20. The other one of the channels62in the trinocular tube60is in communication with the camera assembly40. The camera assembly40further includes a first polarizer42, the first polarizer42is located between the camera41and the trinocular tube60, and the telescopic sleeve512drives the camera41to move forward or backward in the telescopic sleeve512.

It may be understood that when an image of a sample obtained by the camera41is out of focus, the camera41may be driven by the telescopic sleeve512to move forward or backward in the telescopic sleeve512, so as to focus the camera41, thereby ensuring that the image scanned by the camera41is an accurately focused image.

Referring toFIG.9andFIG.10, in this embodiment of this disclosure, the microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a trinocular tube60. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other, the first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30includes a first lens32and an image projection device31, and light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20. One of the channels62is in communication with an eyepiece70, and the tube lens61is located on one end proximate to the beam splitter20. The beam splitter20includes a first sub beam splitter21and a second sub beam splitter22. The first sub beam splitter21is in communication with the second sub beam splitter22, the first sub beam splitter21is in communication with the image projector assembly30, and the second sub beam splitter22is in communication with the camera assembly40. The camera assembly40further includes a second lens43, and the second lens43is located between the second sub beam splitter22and the camera41. The telescopic sleeve512drives the camera41or the third lens44to move forward or backward in the telescopic sleeve512.

It may be understood that when an image of a sample obtained by the camera41is out of focus, the camera41or the second lens43may be driven by the telescopic sleeve512to move forward or backward in the telescopic sleeve512, so as to focus the camera41, thereby ensuring that the image scanned by the camera41is an accurately focused image.

Referring toFIG.11andFIG.12, in this embodiment of this disclosure, the microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a trinocular tube60. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other. The first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30is in communication with the beam splitter20, and the image projector assembly30includes a first lens32and an image projection device31. Light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20. One of the channels62is in communication with an eyepiece70, and the tube lens61is located on one end proximate to the beam splitter20. The camera assembly40and the image projector assembly30are disposed opposite to each other along the beam splitter20. The image projector assembly30further includes a second polarizer33, and the second polarizer33is located between the first lens32and the beam splitter20. The camera assembly40further includes a third lens44and a third polarizer45. The third polarizer45is located between the beam splitter20and the third lens44, and the third lens44is located between the third polarizer45and the camera41. The telescopic sleeve512drives the camera41or the third lens44to move forward or backward in the telescopic sleeve512.

It may be understood that when an image of a sample obtained by the camera41is out of focus, the camera41or the third lens44may be driven by the telescopic sleeve512to move forward or backward in the telescopic sleeve512, so as to focus the camera41, thereby ensuring that the image scanned by the camera41is an accurately focused image.

Referring toFIG.13, in this embodiment of this disclosure, the microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a trinocular tube60. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other. The first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30is in communication with the beam splitter20, and the image projector assembly30includes a first lens32and an image projection device31. Light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20. One of the channels62is in communication with an eyepiece70, and the tube lens61is located on one end proximate to the beam splitter20. The other channels62in the trinocular tube60is in communication with the camera assembly40. The camera assembly40further includes a first polarizer42, and the first polarizer42is located between the camera41and the trinocular tube60. A zoom lens52is disposed between the first polarizer42and the tube lens61.

It may be understood that the zoom lens52is disposed between the first polarizer42and the tube lens61, and the zoom lens52performs zooming, so as to focus the camera41, thereby ensuring that the image scanned by the camera41is an accurately focused imaged.

Referring toFIG.14, in this embodiment of this disclosure, the microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a trinocular tube60. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other. The first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30includes a first lens32and an image projection device31, and light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20. One of the channels62is in communication with an eyepiece70, and the tube lens61is located on one end proximate to the beam splitter20. The beam splitter20includes a first sub beam splitter21and a second sub beam splitter22. The first sub beam splitter21is in communication with the second sub beam splitter22. The first sub beam splitter21is in communication with the image projector assembly30, and the second sub beam splitter22is in communication with the camera assembly40. The camera assembly40further includes a second lens43, and the second lens43is located between the second sub beam splitter22and the camera41. The zoom lens52is located between the first sub beam splitter21and the second lens43.

It may be understood that the zoom lens52is disposed between the first sub beam splitter21and the second lens43, and the zoom lens52performs zooming, so as to focus the camera41, thereby ensuring that the image scanned by the camera41is an accurately focused imaged.

Referring toFIG.15, in this embodiment of this disclosure, the microscope system200specifically includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a trinocular tube60. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other, the first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30is in communication with the beam splitter20. The image projector assembly30includes a first lens32and an image projection device31, and light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The trinocular tube60is disposed on one end of the beam splitter20distant from the objective lens10, and the trinocular tube60includes at least two channels62and a tube lens61. The channels62are located on one end distant from the beam splitter20. One of the channels62is in communication with an eyepiece70, and the tube lens61is located on one end proximate to the beam splitter20. The camera assembly40and the image projector assembly30are disposed opposite to each other along the beam splitter20. The image projector assembly30further includes a second polarizer33, and the second polarizer33is located between the first lens32and the beam splitter20. The camera assembly40further includes a third lens44and a third polarizer45. The third polarizer45is located between the beam splitter20and the third lens44, and the third lens44is located between the third polarizer45and the camera41. A zoom lens52is located between the beam splitter20and the third polarizer45.

It may be understood that the zoom lens52is disposed between the beam splitter20and the third polarizer45, and the zoom lens52performs zooming, so as to focus the camera41, thereby ensuring that the image scanned by the camera41is an accurately focused imaged.

In the embodiments of this disclosure, the microscope system200includes an objective lens10, a beam splitter20, an image projector assembly30, a camera assembly40, and a focusing device50. The objective lens10includes a first end10aand a second end10b, which are disposed opposite to each other, the first end10afaces a sample80, and the beam splitter20is disposed on the second end10b. The image projector assembly30is in communication with the beam splitter20, the image projector assembly30includes a first lens32and an image projection device31, and light generated by the image projection device31enters the beam splitter20through the first lens32. The camera assembly40is in communication with the beam splitter20, and the camera assembly40includes a camera41. The focusing device50is disposed on the camera assembly40, and the focusing device50is configured to perform focus adjustment on the camera41. In the embodiments of this disclosure, when microscope observers with different diopters changeably use microscopes, the observers perform autofocus by using the focusing device50instead of repeating tedious trinocular parfocal adjustment every time, thereby improving the convenience of operations. In addition, even if the objective lenses10of different magnifications are not parfocal or do not complete parfocal adjustment, acquisition of a clear image by the camera is not affected, and the camera may still perform autofocus when the end of the eyepiece70is not in focus. Finally, adjustment is performed more accurately by using the adjustment method of this disclosure.

In addition, terms “first” and “second” are used merely for the purpose of description, and shall not be construed as indicating or implying relative importance or implying a quantity of indicated technical features. In view of this, a feature defined to be “first” or “second” may explicitly or implicitly include one or more features. In the descriptions of this disclosure, “a plurality of” means two or more, unless otherwise definitely and specifically limited.

Referring toFIG.16, the embodiments of this disclosure further provide an automatic focusing method for a microscope system, applicable to the microscope system. The focusing method specifically includes the following steps.

301. Obtain a plurality of images with different depths corresponding to a field of view of a target objective lens, the plurality of images with different depths being images acquired by a camera.

A sample may be scanned by using a camera of the microscope system to obtain a plurality of images with different depths. The camera may obtain the plurality of images with different depths by scanning the sample layer by layer. For example, the camera is driven by a focusing device to respectively acquire images at different preset depths, to obtain a plurality of images with different depths. Generally, three, four, or even more images with different depths can be obtained. To save resources, when three images with different depths are obtained, the requirements of the embodiments of this disclosure can be met.

302. Determine an index information value of each image in the plurality of images with different depths, and calculate a defocusing amount of each image according to the index information value.

Index information may be the sharpness or contrast of an image. The index information in this embodiment of this disclosure is not limited thereto. The index information value may be a calculated value of the sharpness or contrast of the image, and a defocusing amount of an image is obtained by using the value of the sharpness or contrast of the image.

For example, the index information is the sharpness of the image, and a possible implementation method for obtaining an index information value includes the following steps:

(1) Respectively extract, for each image in the plurality of images with different depths, size information of each image and a pixel value of a corresponding pixel.

Size information of each image in the plurality of images with different depths is extracted, the size information of each image may be represented as M*N, and a pixel value of a corresponding pixel may be understood as a pixel value at a coordinate point. For example, s(i,j) is a pixel value at coordinates (i,j).

(2) Calculate the index information value according to the size information of each image and the pixel value of the corresponding pixel.

The size information M*N of the plurality of images with different depths and the pixel value at the coordinates (i,j) are substituted into a formula, to obtain an index information value as follows:

B=∑i=1N⁢∑j=1M⁢[s⁡(i,j)-s⁡(i+2,j)]2

where B is an index information value of an image, and images with different depths correspond to different index information values.

(3) Obtain the defocusing amount based on the index information value.

Different index information values are fitted into a curve, and a vertex of the curve is a corresponding position when the defocusing amount is zero. When the defocusing amount is closer to 0, it indicates that the image is clearer, that is, the focusing device drives the camera to reach a position to which the camera needs to be adjusted.

As shown inFIG.17, for example, the camera scans five images with different depths, and calculated index information values of the five images with different depths are respectively B1, B2, B3, B4, and B5. A curve is fitted according to B1, B2, B3, B4, and B5. A vertex of the curve is determined as a position point at which a defocusing amount is zero, that is, a best imaging position, in other words, a position point that the camera needs to approach through adjustment.

303. Trigger, in a case that the defocusing amount is greater than a preset threshold, the focusing device to perform focus adjustment on the camera.

The preset threshold may be a manually specified threshold, and the threshold may be 0, 0.1, 0.5, or the like. Generally, the preset threshold of the defocusing amount is 0, and clarity of an image may be ensured by using the threshold. When the defocusing amount is greater than the preset threshold, the focusing device is caused to perform focus adjustment on the camera, and until the defocusing amount reaches the preset threshold, it is determined that the camera is focused accurately.

The microscope system in this embodiment of this disclosure is the foregoing microscope system. The microscope system is not described in detail in this embodiment of this disclosure.

According to the embodiments of this disclosure, a plurality of images with different depths corresponding to a field of view of a target objective lens are obtained, and the plurality of images with different depths are images acquired by a camera. An index information value of each image in the plurality of images with different depths is determined individually, a defocusing amount of each image is calculated according to the index information value, and in a case that the defocusing amount is greater than a preset threshold, the focusing device is triggered to perform focus adjustment on the camera. In the embodiments of this disclosure, when microscope observers with different diopters changeably use microscopes, the observers perform autofocus by using the focusing device instead of repeating tedious trinocular parfocal adjustment every time, thereby improving the convenience of operations. In addition, even if the objective lenses of different magnifications are not parfocal or do not complete parfocal adjustment, acquisition of a clear image by the camera is not affected, and the camera may still perform autofocus when the end of the eyepiece is not in focus. Finally, adjustment is performed more accurately by using the adjustment method of this disclosure.

In the embodiments of this disclosure, it is to be understood that terms such as “include” or “contain” are intended to indicate existence of features, numbers, steps, behaviors, components, parts, or combinations thereof disclosed in this specification, and are not intended to exclude a possibility of existence or addition of one or more other features, numbers, steps, behaviors, components, parts, or combinations thereof.

The embodiments of this disclosure further provide a smart medical device. In this embodiment of this disclosure, the smart medical device relates to the field of smart medical instruments in the field of artificial intelligence.

Artificial Intelligence (AI) is a theory, a method, a technology, and an application system that use a digital computer or a machine controlled by the digital computer to simulate, extend, and expand human intelligence, perceive an environment, obtain knowledge, and use knowledge to obtain an optimal result. In other words, the AI is a comprehensive technology of computer science, which attempts to understand the essence of intelligence and produce a new type of intelligent machine that can react in a similar way to human intelligence. The artificial intelligence is to study the design principles and implementation methods of various intelligent machines, so that the machines have the functions of perception, reasoning, and decision-making.

An artificial intelligence technology is a comprehensive discipline, covering a wide range of fields, including both hardware-level technologies and software-level technologies. Basic artificial intelligence technologies generally include technologies such as a sensor, a dedicated artificial intelligence chip, cloud computing, distributed storage, a big data processing technology, an operation/interaction system, and mechatronics. An artificial intelligence software technology mainly includes a computer vision technology, a speech processing technology, a natural language processing technology, and machine learning/deep learning.

In this embodiment of this disclosure, the smart medical device specifically includes an objective lens, a beam splitter, an image projector assembly, a camera assembly, and a focusing device. The objective lens includes a first end and a second end, which are disposed opposite to each other, the first end faces a sample, and the beam splitter is disposed on the second end. The image projector assembly is in communication with the beam splitter, the image projector assembly includes a first lens and an image projection device, and light generated by the image projection device enters the beam splitter through the first lens. The camera assembly is in communication with the beam splitter, and the camera assembly includes a camera. The focusing device is disposed on the camera assembly, and the focusing device is configured to perform focus adjustment on the camera.

The embodiments of this disclosure further provide a smart medical device, and the smart medical device may be configured to perform microscopic imaging on a sample.FIG.18is a schematic structural diagram of a smart medical device according to an embodiment of this disclosure. Details are provided as follows:

The smart medical device may include components such as a processor401of one or more processing cores, a memory402of one or more computer-readable storage media, a power supply403, and an input unit404. A person skilled in the art may understand that the structure of the smart medical device shown inFIG.18does not constitute a limitation to the smart medical device, and the smart medical device may include more components or fewer components than those shown in the figure, or some components may be combined, or a different component deployment may be used.

The processor401is the control center of the smart medical device, and is connected to various parts of the smart medical device by various interfaces and lines. By running or executing the software program and/or module stored in the memory402, and invoking data stored in the memory402, the processor401implements various functions and data processing of the smart medical device, thereby performing overall monitoring on intelligent the smart medical device. Optionally, the processor401may include one or more processing cores. Preferably, the processor401may integrate an application processor and a modem processor. The application processor mainly processes an operating system, a user interface, an application program, and the like. The modem processor mainly processes wireless communication. It can be understood that the foregoing modem processor may alternatively not be integrated into the processor401.

The memory402may be configured to store a software program and module. The processor401runs the software program and module stored in the memory402, to implement various functional applications and data processing. The memory402may mainly include a program storage area and a data storage area. The program storage area may store an operating system, an application program required by at least one function (for example, a sound playing function and an image display function), and the like. The data storage area may store data created according to use of the smart medical device, and the like. In addition, the memory402may include a high-speed random-access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, or another volatile solid-state storage device. Correspondingly, the memory402may further include a memory controller, to provide access of the processor401to the memory402.

The smart medical device further includes the power supply403for supplying power to the components. Optionally, the power supply403may be logically connected to the processor401by a power management system, thereby implementing functions such as charging, discharging, and power consumption management by using the power management system. The power supply403may further include one or more of a direct current or alternating current power supply, a re-charging system, a power failure detection circuit, a power supply converter or inverter, a power supply state indicator, and any other components.

The smart medical device may further include the input unit404. The input unit404may be configured to receive entered numeric or character information and generate keyboard, mouse, joystick, optical, or trackball signal input related to user settings and function control.

The smart medical device may further include a microscope system200, and the microscope system200is the foregoing microscope system200. The microscope system200is not described in detail in this embodiment of this disclosure.

Although not shown in the figure, the smart medical device may further include a display unit, and the like. Details are not described herein again. Specifically, in this embodiment, the processor401in the smart medical device loads, into the memory402according to the following instructions, executable files corresponding to processes of one or more application programs, and the processor401runs the application programs stored in the memory402to implement the following various functions:

A plurality of images with different depths corresponding to a field of view of a target objective lens may be obtained, and the plurality of images with different depths are images acquired by a camera. An index information value of each image in the plurality of images with different depths is determined individually, a defocusing amount of the each image is calculated according to the index information value, and in a case that the defocusing amount is greater than a preset threshold, the focusing device is triggered to perform focus adjustment on the camera.

For specific implementations of the foregoing operations, refer to the foregoing embodiments. Details are not described herein again.

A person of ordinary skill in the art may understand that, all or some steps of the methods in the foregoing embodiments may be implemented by using instructions, or implemented through instructions controlling relevant hardware, and the instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

Accordingly, the embodiments of this disclosure provide a storage medium, storing a plurality of instructions, the instructions being suitable to be loaded by a processor, to perform the steps in any automatic focusing method for a microscope system according to the embodiments of this disclosure. For example:

a plurality of images with different depths corresponding to a field of view of a target objective lens are obtained, and the plurality of images with different depths are images acquired by a camera. An index information value of each image in the plurality of images with different depths is determined individually, a defocusing amount of the each image is calculated according to the index information value, and in a case that the defocusing amount is greater than a preset threshold, the focusing device is triggered to perform focus adjustment on the camera.

For specific implementations of the foregoing operations, refer to the foregoing embodiments. Details are not described herein again.

The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk, an optical disc, or the like.

Since the instructions stored in the storage medium may perform the steps of any method provided in the embodiments of this disclosure, the instructions can implement advantageous effects that may be implemented by any method in the embodiments of this disclosure. Refer to the foregoing embodiments for details, and details are not described herein again.

The microscope system, the smart medical device, the automatic focusing method, and the storage medium provided in the embodiments of this disclosure are described in detail above. The principle and implementations of this disclosure are described herein by using specific examples. The descriptions of the foregoing embodiments are merely used for helping understand the method and core ideas of this disclosure. In addition, a person skilled in the art can make variations to this disclosure in terms of the specific implementations and application scopes according to the ideas of this disclosure. Therefore, the content of this specification shall not be construed as a limit on this disclosure.