Patent Description:
Surgical microscopes offer a wide range of settings and customizations allowing to be adopted to the needs and preferences of the surgeons. However, the process to adjust an appropriate operational setting and the process of customization to the needs of a specific user remain inherently complex, cumbersome, and time-consuming processes. Even after a surgical microscope has been customized to a specific user, switching and interaction between the customization profiles are still cumbersome in daily work when using the surgical microscope in an operating room (OR).

<CIT> discloses a surgical microscope comprising a database for storing user specific operating parameters, multiple user interfaces, and a processor. The user interfaces allow different users to identify themselves and the processor is configured to load operating parameters specific to the identified user. A user interface located outside an operating theater may not provide full control.

Document <CIT> discloses a surgical microscope comprising a memory for storing customization profiles and an iris identification unit. Document <CIT> discloses a medical imaging device having a database for storing user default preferences and a user identification unit. With regards to the state of the art, reference is further made to Documents <CIT> and <CIT>.

Therefore, it is an object of the present invention to provide an improved microscope system comprising a surgical microscope and a method for controlling a surgical microscope.

The afore-mentioned object is achieved by the subject-matter of the independent claims.

The proposed microscope system comprises a surgical microscope, a memory configured to store a plurality of customization profiles, each customization profile defining at least one predetermined operational setting, a user identification unit configured to detect a user identification, and a processor configured to select one of said plurality of customization profiles based on the detected user identification and to operate the surgical microscope in accordance with the at least one predetermined operational setting defined by the selected customization profile, wherein the user identification unit comprises one or more sensors configured to detect the user identification, the sensors comprise at least a first sensor and a second sensor integrated in the surgical microscope, at least one of the plurality of customization profiles includes at least a first operational setting and a second operational setting, the processor is configured to select the first operational setting if the user input is detected by the first sensor, and the processor is configured to select the second operational setting if the user input is detected by the second sensor.

The microscope system enables a user who may be a surgeon or a surgical assistant to adjust a predetermined operational setting of the surgical microscope merely by providing a user identification to the microscope system. Thus, the detection of the user identification by means of a user identification unit causes the processor of the microscope system to use a specific customization profile which is stored in a memory and assigned to the customization profile of this specific user. The selected customization profile defines the operational setting which shall be used for the specific user. Accordingly, the user does not have to do more than to input the user identification in order to put the surgical microscope into full operation, i.e. into an operating state which is adopted to the needs and preferences of the user.

The predetermined operational setting defined by a specific customization profile may comprise a plurality of setting parameters which are used to operate the surgical microscope in accordance with the user preferences. These setting parameters may e.g. include parameters directly related to the imaging of an object such as focus or zoom parameters or parameters defining the field of view to be imaged. The setting parameters may e.g. further include parameters which are related to the processing of the captured image, for example parameters determining how the captured image is to be displayed on a monitor. Needless to say that the afore-mentioned parameters are to be understood only as examples, and the operational setting may comprise any parameter suitable for operating the surgical microscope.

Preferably, the processor is configured to create at least one of the plurality of customization profiles by prompting a user input including customization information. According to this embodiment, the processor provides a setup assistance function which may guide the user to create a specific customization profile according to his or her preferences. This can be achieved by prompting the user to input a customization information into the microscope system, for example by asking questions which may be presented to the user e.g. by means of a graphical user interface.

Further, the processor may be configured to provide a sequence of queries, each query prompting said user input. Such a sequence may comprise a list of questions or options presented to the user, each prompting a corresponding user input to respond thereto choosing a specific configuration. The set of questions or options may be presented in such a way that depending on how the user responds thereto, the user is invited by the processor to set a specific preference or to proceed to the next question or option. An exemplary interaction between the processor and the user may be as follows: Initially, the user wants to know what a specific button to be operated by the user might be used for. For this, the user pushes the button, and then the processor informs the user about the functionality of the button, i.e. a set of available functions. Subsequently, the user wants to set a specific function within the functionality of the button. For example, the user might want to record a specific workflow macro which would allow the user to record a sequence of actions, e.g. switch to fluorescence mode, capture and save three images, and then switch back to the previous imaging mode.

The user identification unit comprises at least two sensors (in the following also referred to as sensor means or sensor arrangement) configured to detect the user identification. Such sensor means provide a physical interface between the processor on the one hand and an interface medium on the other hand, wherein said interface medium comprises identification means which are configured to be recognized by the sensor means in order to identify the user before the surgical microscope is put into operation.

The afore-mentioned sensor means may comprise at least one sensor selected from a group including a radio-frequency identification sensor, a code reader, an optical sensor, a microphone, a tactile sensor, a camera, and a touch sensitive screen. In such an embodiment, a suitable interface medium identifying the specific user may be selected dependent on the type of the sensor used for providing the physical interface. For example, an RFID chip may be used as an interface medium in a case in which the sensor is formed by a radio-frequency identification sensor. An RFID chip may be implemented in form of a card permanently used by the specific user, such as a hospital identifier (ID) or an ID specifically issued for an operating room and/or the use of specific medical devices. Alternatively, single use RFID chips may be attached on bracelets which can be worn by the user together with OR clothes which usually are single use articles likewise. As a further alternative, an RFID chip could be embedded within the clothes. In such a case, the user would have to inform the microscope system once that this specific RFID chip is the identifier of the user.

Correspondingly, a QR code may be used as an interface medium in connection with a code reader, e.g. a camera. If the interface medium is formed by a QR code, the latter may already be printed on a hospital ID or attached on the ID in form of a sticker. The QR code may be recognized by a camera on the control panel side of the surgical microscope. Alternatively, the QR code may be printed on the user's clothes on the spot by a printer connected to the surgical microscope.

In case that a microphone is used as the physical interface, the user's voice or the user's hand or finger generating a knock pattern may be used as an interface medium identifying the specific user. The user's hand or finger may be used likewise when the physical interface is formed by a tactile sensor or a touch sensitive screen.

A kind of knocking pattern may also be used by means of keys dedicated to this specific purpose. For instance, keys or buttons located on a handle of the surgical microscope may be clicked simultaneously several times in order to recognize a specific user.

If an optical recognition of the user's hospital ID is applied, the recognition may be performed at the very beginning of the commissioning of the surgical microscope to put the specific user on a list of recent users. When using e.g. a microphone or a tactile sensor, a knock pattern performed by the user on the microscope may be detected likewise. For instance, a user might perform a multiple and then a single knock, and every time the ID is detected, the customization profile changes accordingly.

In a preferred embodiment, the sensor means comprises an optical eye recognition means. Such an optical eye recognition means may be formed e.g. by a camera.

For example, the optical eye recognition means may be included in an optical eyepiece of the surgical microscope. By integrating the optical eye recognition means into the eyepiece, whenever the user approaches the eyepiece of the surgical microscope to look through, the user's eye is recognized thereby identifying the user so that the customization profile associated with the specific user can be selected immediately. Thus, the user does not feel as being forced to take any action in order to be recognized. Operating the surgical microscope becomes very convenient.

The sensor means comprises at least a first sensor and a second sensor, wherein at least one of the plurality of customization profiles includes at least a first operational setting and a second operational setting. Further, the processor is configured to select the first operational setting if the user input is detected by the first sensor and to select the second operational setting if the user input is detected by the second sensor. In such an embodiment, the surgical microscope may have multiple sensors such as RFID (contactless) readers, cameras, and microphones. Depending on which sensor is used to be recognized, a different operational setting within the customization profile associated with the specific user will be selected. For example, the surgical microscope may have two RFID readers on both sides of an optics carrier, and the customization profile may be programmed for the specific user such that by identifying the user by means of the RFID reader located on the right side, a first operational setting may be selected which is e.g. the default setting of the recognized user. In contrast, if the user is identified by the RFID reader on the left side, a current operational setting may be applied for the recognized user, i.e. the user adopts the current setting. Needless to say that a plurality of different combinations of recognition actions may be programmed to perform specific functions or macros.

According to a preferred embodiment, the processor is configured to create the at least one of the plurality of customization profiles based on a machine learning algorithm. The machine learning algorithm may be programmed such that the microscope system successively learns with continued use enabling the microscope system to offer options which are likely to be selected based on previous use. For instance, the microscope system may use the machine learning algorithm to learn that certain users work together. Thus, when a specific user is already working with the surgical microscope, the customization profile of another user may be offered. According to another example, the microscope system may learn that in case a specific user tries to focus longer than a typical duration, it is likely that the user might also want to capture and save images. Accordingly, an option to capture and save images may be offered automatically to the user.

Preferably, the processor may be configured to merge at least two of the plurality of customization profiles, which are assigned to different user information, into a common customization profile. In such a manner, a team of users may be defined wherein each user of the team is allowed to rely on all customization profiles which have been created for other users of the team. This embodiment may be advantageously combined with the machine learning algorithm based on which the team of users may be composed.

Preferably, the processor may be configured to detect a user actuation during operation of the surgical microscope and to modify the at least one of the plurality of customization profiles based on the detected user actuation. Also such an embodiment may be advantageously combined with the machine learning algorithm. According to another aspect, a method and corresponding computer program for controlling a surgical microscope is provided, as defined in claims <NUM> and <NUM>.

Hereinafter, specific embodiments are described referring to the drawings wherein:.

<FIG> is a schematic diagram showing a microscope system <NUM> according to an embodiment. The microscope system <NUM> comprises a surgical microscope <NUM> typically operated by a surgeon and/or an assistant in an operating room to perform surgery on a patient, such as brain, eye or spine surgery. The microscope system <NUM> further comprises a processor <NUM> and a memory <NUM> which may be part of control unit <NUM>. The control unit <NUM> may be formed by a computer device.

The control unit <NUM> comprising the processor <NUM> and the memory <NUM> is coupled to a user identification unit <NUM> which is configured to detect a user identification authorizing the user (e.g. a surgeon or nurse) designated by <NUM> in <FIG>. The user identification unit <NUM> comprises sensor means e.g. in form of a plurality of sensors <NUM>, <NUM>, <NUM>, <NUM>, <NUM>. The user identification unit <NUM> further comprises identification means e.g. in form of a plurality of interface media <NUM>, <NUM>, <NUM>, <NUM>, <NUM>. According to the present embodiment, each of the plurality of sensors <NUM> to <NUM> is configured to interact with one of the interface media <NUM> to <NUM> as illustrated by arrows P in <FIG>. As described later in detail, each interface medium <NUM> to <NUM> comprises an identification means which is configured to be recognized by the associated sensor <NUM> to <NUM> in order to identify the user before the surgical microscope <NUM> is put into operation. Generally speaking, the sensor means formed by the plurality of sensors <NUM> to <NUM> provides a physical interface between the control unit <NUM> on the one hand and the associated interface media <NUM> to <NUM> on the other hand.

The memory <NUM> is configured to store a plurality of customization profiles. Each of the customization profiles stored in the memory <NUM> defines at least one predetermined operational setting according to which the surgical microscope <NUM> operates once the surgical microscope <NUM> is put into operation after the user <NUM> has been identified by means of the user identification unit <NUM>. For illustrative purposes only, the different operational settings are referred to with reference sign <NUM> in <FIG>.

The processor <NUM> is configured to select one of the plurality of customization profiles based on the user identification which is provided by one of the interface media <NUM> to <NUM> and detected by the associated sensor <NUM> to <NUM>. Among the plurality of customization profiles stored in the memory <NUM>, the processor <NUM> selects the one profile which belongs to the specific user recognized by the user identification. With selecting this customization profile, the user is enabled to operate the surgical microscope <NUM> in accordance with the operational setting defined by the selected customization profile.

<FIG> illustrates a modification of the embodiment shown in <FIG>. Whereas according to the embodiment in <FIG>, the control unit <NUM> including the processor <NUM> and the memory <NUM> is formed by a component physically separated from the surgical microscope, the modified configuration of <FIG> includes a control unit <NUM> which is integrated with the surgical microscope <NUM>. Again, the control unit <NUM> includes the processor <NUM> and the memory <NUM>. Apart from the afore-mentioned modification, the configurations illustrated in <FIG> and <FIG> are identical.

<FIG> shows an exemplary configuration which is based on the embodiment of <FIG>. This exemplary configuration shall illustrate which types of sensors and associated interface media may be used to form the sensor means for identifying the user. Thus, the sensor means of the user identification unit <NUM> may comprise a touch sensitive screen <NUM> (corresponding to sensor <NUM> in <FIG>) interacting with a hand or a finger <NUM> of the user (corresponding to interface medium <NUM> in <FIG>). Further, the sensor means may comprise a first camera <NUM> (corresponding to sensor <NUM> in <FIG>) interacting with a QR code <NUM> (corresponding to interface medium <NUM> in <FIG>). The sensor means may further comprise a second camera <NUM> (corresponding to sensor <NUM> in <FIG>) interacting with a user's eye <NUM> (corresponding to interface medium <NUM> in <FIG>). The sensor means may further comprise an RFID (contactless) reader <NUM> (corresponding to sensor <NUM> in <FIG>) interacting with an RFID (contactless) chip <NUM> (corresponding to interface medium <NUM> in <FIG>).

Needless to say that the sensors <NUM> to <NUM> are merely examples, and any other types of sensors and interface media may be used provided that these sensors and interface media are suitable to detect a user identification based on which the specific user can be recognized. Further, it goes without saying that the configuration shown in <FIG> may also be based on the embodiment of <FIG>.

Further, according to <FIG>, the sensors <NUM> to <NUM> and <NUM> to <NUM>, respectively, are illustrated as being physically separated from the surgical microscope <NUM>. However, this illustration serves only to simplify the diagrams. At least two of the sensors <NUM> to <NUM>, <NUM> to <NUM> are integrated with the surgical microscope <NUM>. For example, the camera <NUM> recognizing the user's eye <NUM> may be integrated into an eyepiece <NUM> of the surgical microscope.

Further, the sensor means shown in <FIG> comprises a plurality of sensors <NUM> to <NUM>, <NUM> to <NUM> and associated interface media <NUM> to <NUM>, <NUM> to <NUM>. However , in an example not falling under the scope of the claims, it is also possible to use one single sensor as well as one single interface medium associated therewith, though providing more than one of the afore-mentioned components may have some benefits. For instance, in an embodiment of claim <NUM>, assumed that the sensor means comprises at least a first sensor and a second sensor, both of which being formed by an RFID chip, the processor <NUM> is configured to select a first operational setting if the user input is detected by the first sensor, and to select the second operational setting if the user input is detected by the second sensor. The first and second operational settings may be included in a single customization profile belonging to the specific user. Thus, by selecting one of the two RFID readers, the user is enabled to select the corresponding operational setting associated with the selected RFID reader.

As explained above, the processor <NUM> serves to select the customization profile based on an identification of the user <NUM> and to operate the surgical microscope <NUM> in accordance with the operational setting which is defined by the selected customization profile. However, the processor <NUM> may not be limited to the afore-mentioned function. For example, the processor <NUM> may further be configured to provide a setup assistance function guiding the user <NUM> in a process for creating a specific customization profile according to his or her preferences, this profile being storable in the memory <NUM>. For this, the processor <NUM> may be configured to prompt the user <NUM> to input customization information. For instance, the processor <NUM> may cause a display device (not shown in the Figures) to present questions or options to which the user <NUM> can respond to in order to create the desired profile. The processor <NUM> may e.g. provide a sequence of queries, each query prompting a user input based on which the customization profile can be created.

The processor <NUM> may further be configured to apply a machine learning algorithm. Using such a machine learning algorithm, the processor <NUM> may create the customization profiles to be stored in the memory <NUM>. The processor <NUM> may also be configured to merge at least two customization profiles, which are assigned to different user information, i.e. to different users, into a common customization profile to be stored in the memory <NUM>. Such a configuration has its benefits in case that a team of users is working with the surgical microscope <NUM>, and each user of the team shall have the possibility of using also the profiles of the other users.

Further, the processor <NUM> may be configured to detect a user actuation during operation of the surgical microscope <NUM> in order to modify the customization profile belonging to this user based on the detected user actuation. Also for such a configuration, the processor <NUM> may advantageously use the machine learning algorithm.

Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that the method according to claim <NUM> is performed on the surgical microscope according to any one of the claims <NUM> to <NUM>.

Generally, embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing the method according to claim <NUM> on the surgical microscope according to any one of the claims <NUM> to <NUM> when the computer program product runs on a computer.

Other embodiments comprise the aforementioned computer program, stored on a machine readable carrier.

In other words, an embodiment of the present invention is, therefore, a computer program according to claim <NUM>.

A further embodiment of the present invention is, therefore, a storage medium (or a data carrier, or a computer-readable medium) comprising, stored thereon, the computer program of claim <NUM>.

A further embodiment of the invention is, therefore, a data stream or a sequence of signals representing the computer program according to claim <NUM>.

A further embodiment comprises a processing means, for example, a computer or a programmable logic device, configured to, or adapted to, perform the method according to claim <NUM> on the surgical microscope according to any one of the claims <NUM> to <NUM>.

A further embodiment comprises a computer having installed thereon the computer program of claim <NUM>.

Claim 1:
A microscope system (<NUM>), comprising:
a surgical microscope (<NUM>),
a memory (<NUM>) configured to store a plurality of customization profiles, each customization profile defining at least one predetermined operational setting (<NUM>),
a user identification unit (<NUM>) configured to detect a user identification, and
a processor (<NUM>) configured to select one of said plurality of customization profiles based on the detected user identification and to operate the surgical microscope (<NUM>) in accordance with the at least one predetermined operational setting (<NUM>) defined by the selected customization profile,
wherein the user identification unit (<NUM>) comprises one or more sensors (<NUM> - <NUM>, <NUM> - <NUM>) configured to detect the user identification,
the sensors (<NUM> - <NUM>, <NUM> - <NUM>) comprise at least a first sensor and a second sensor integrated in the surgical microscope (<NUM>),
at least one of the plurality of customization profiles includes at least a first operational setting and a second operational setting,
the processor (<NUM>) is configured to select the first operational setting if the user input is detected by the first sensor, and
the processor (<NUM>) is configured to select the second operational setting if the user input is detected by the second sensor.