Patent Description:
Commonly, slit lamps are used for delivering the laser energy to the patient's eye. In these systems, the patients sit up in an examination chair, rest their chin on a chin rest, and place their forehead against a forehead band, both of which keep the patient's head in place during the procedure. <CIT> discloses an apparatus for photothermal ophthalmic treatment, in particular photocoagulation or photo-thermal stimulation. This prior art apparatus includes a uer interface which allows the user to select the desired parameters, either by voice command or direct selection via e.g. knobs or a touchscreen interface.

Another common device is a Laser Indirect Ophthalmoscope (LIO), which is a head mounted device, worn by the doctor to deliver laser energy into a patient's eye. Current systems use a laser console for generating the laser light and a long fiber optic umbilical coupled to the LIO. The laser console includes a laser source, a power source (for example, providing AC/DC conversion), laser drive and parameter control systems, and a user interface. The user interface comprises physical knobs and switches or a touchscreen and can be part of the laser console itself or a remote control device that communicates with the laser console. Activation devices (e.g. footswitches) connect to the laser consoles and activate the laser emission, for example, by sending an activation signal to the laser console in response to engagement of an activation mechanism (e.g. compression of the footswitch).

During procedures using the LIO, the doctor moves the laser console, which is positioned on a cart or table, to be in the proximity of the patient who is usually in a supine position. The doctor then walks around the patient to deliver the laser energy to the desired portions of the retina. If a parameter change is needed, the doctor physically returns to the laser console to make the change or has an assistant, for example, standing next to the laser console, make the change.

The present invention includes a voice control system for ophthalmologic laser treatment systems that is robust against operator mistakes and misunderstood commands, for example, by replaying and confirming voice commands, evaluating desired parameters against a predetermined safety policy, and providing incremental parameter adjustment and restricting the amount by which the parameters can be increased and/or decreased for each executed voice command. The voice control system includes a voice control module for recognizing spoken commands and a parameter regulation module for generating parameter information based on the spoken commands and a predetermined safety policy. Audible feedback of current and updated parameters is also provided.

In one example, a microphone first detects a wake word (which is a special phrase to indicate that verbal commands follow). The wake word provides a two-step recognition requirement for voice commands in order to make a parameter change, decreasing the likelihood of an erroneous parameter change. In one embodiment, a tone is played after the wake word is detected to prompt the user to provide the voice command.

In response to detecting the wake word, and after the tone is played, the microphone captures audio data, and the voice control module recognizes in the audio data a spoken command (in any multitude of languages) from a predetermined set of commands. The parameter regulation module then generates the parameter information based on which commands and other spoken information were recognized by the voice control module.

In one example, the parameter regulation module only increases the power and duration set points by <NUM>% or less of the current set points, and the valid voice commands are limited to indicating which parameter to adjust and whether to adjust the parameter up or down. These voice commands can include "Power up," "Power down," "Duration up," "Duration down," "Interval up," "Interval down," "Aiming beam up," and "Aiming beam down," to list a few examples. The amount by which the parameters can be increased or decreased can be restricted based on multiple considerations, including, for example, a prescribed tolerance band for set parameters according to industry regulations.

Additionally, the voice control functionality can be selectively executed under certain conditions to further enhance the safety of the laser treatment system. In one example, voice commands to change the interval parameter are not executed when it is determined that the user had not previously specified a repeat interval for the current laser treatment session.

In general, according to one aspect, the invention features a system for delivering laser energy to an eye of a patient comprising a microphone, a voice control module, an parameter regulation module, and a control module. The microphone captures audio data. The voice control module receives the captured audio data and generates voice command information based on the captured audio data. The parameter regulation module generates parameter information based on the voice command information. The control module receives the parameter information and sets the parameters for the delivered laser energy based on the parameter information.

In embodiments, the voice control module generates the voice command information by recognizing spoken language in the captured audio data, which can indicate the parameters to be adjusted, values for the parameters and/or whether values for the parameters should be increased or decreased. The microphone captures the audio data in response to detecting a predetermined wake word, and audible feedback confirming the parameter information and/or the voice command information is provided via speakers. Both the voice control module and the parameter regulation module can execute on a mobile computing device of a body-mounted laser-indirect ophthalmoscope system, a laser console of a laser-indirect ophthalmoscope system, and/or a user terminal of an ophthalmic laser treatment system. The parameter regulation module generates the parameter information based on current values for the parameters to be set and/or a predetermined safety policy, which can indicate maximum values and/or percentages by which the parameters can be increased and/or decreased, predetermined sequences of possible values for the parameters, whether setting of parameters in response to voice commands is selectively executed based on the current parameters, and/or other criteria indicating that the parameters are potentially unsafe.

Also described is a method for delivering laser energy to an eye of a patient using an ophthalmic laser treatment system. Audio data is captured, and voice command information based on the captured audio data is generated. Parameter information is then generated based on the voice command information. The parameters for the delivered laser energy are set based on the parameter information.

The above and other features of the invention including various novel details of construction and combinations of parts, and other advantages, will now be more particularly described with reference to the accompanying drawings and pointed out in the claims. It will be understood that the particular device embodying the invention are shown by way of illustration and not as a limitation of the invention. The principles and features of this invention may be employed in various and numerous embodiments without departing from the scope of the invention. The scope of the invention is defined by the claims which follow. Surgical and/or therapeutic methods described are not part of the claimed subject-matter and given for illustrative purpose only.

The present invention concerns a voice control system for different ophthalmic laser treatment devices. In general, <FIG> concern exemplary ophthalmic laser treatment systems that have been augmented according to the present invention.

<FIG> is an illustration of a body-mounted LIO system <NUM>-<NUM>. In general, the body-mounted LIO system <NUM> delivers laser energy to an eye of a patient. A user of the LIO system <NUM>-<NUM> is typically a doctor such as an ophthalmologist.

The body-mounted LIO system <NUM>-<NUM> includes a binocular indirect ophthalmoscope <NUM>, a control module <NUM>, a power module <NUM>, a laser module <NUM> and a mobile computing device <NUM>.

The binocular indirect ophthalmoscope <NUM> is an optical device for examining the inside of the eye of the patient. The binocular indirect ophthalmoscope <NUM> includes an illumination unit <NUM> for providing white light and an optical system including a viewing aperture <NUM> and an exit aperture <NUM> from which the laser energy is emitted (which is also an entrance aperture for image information e.g. for viewing the patient's eye).

In general, the power module <NUM> provides power to the control module <NUM> and the laser module <NUM>. In one embodiment, the power module <NUM> also provides power to the illumination unit <NUM> of the binocular indirect ophthalmoscope <NUM>.

The laser module <NUM> produces and emits the pulsed laser energy according to certain user-provided parameters such as pulse envelope duration, peak power, and micropulse duration and interval, among other examples.

The activation device <NUM>, which is part of the user interface of the body-mounted LIO system <NUM>-<NUM>, is a device that receives user input via an activation mechanism (e.g. a switch or button) and in response sends activation signals to the control module <NUM> indicating that the laser energy should be emitted. The activation device <NUM> is typically a footswitch, and engagement with the activation mechanism includes compression of the footswitch by the user's foot, for example.

Preferably, the mobile computing device <NUM> is a tablet computer. Alternatively, the mobile computing device <NUM> could be a smartphone device, laptop computer, or phablet computer (i.e., a mobile device that is typically larger than a smart phone, but smaller than a tablet), to list a few examples. In general, the mobile computing device <NUM> provides additional components of the user interface and generates parameter information indicating the user-provided parameters based on input received via the user interface and sends the parameter information to the control module <NUM>.

In the illustrated example, the user interface further includes a voice control interface that allows the user to indicate parameter information using verbal commands. In one example, the user provides a verbal command (e.g. "Power <NUM>", "Power up"), and the mobile computing device provides audible feedback confirming the command, for example, by calling out the parameter being adjusted. In one example, if the "power" is currently set at <NUM>, and a voice command of "Power up" is given, the audible feedback calls out the name of the parameter and the next highest increment from the starting point (e.g. "Power at <NUM>").

The control module <NUM> controls the laser energy delivered by the laser module <NUM> based on parameter information received from the mobile computing device <NUM> and activation signals received from the activation device <NUM>. In the illustrated example, the control module <NUM> communicates with the activation device <NUM> and the mobile computing device <NUM> wirelessly. In response to receiving the parameter information from the mobile computing device <NUM>, the control module <NUM> sets the parameters for the laser energy. In response to receiving activation signals from the activation device <NUM>, the control module <NUM> sends control signals reflecting the user-provided parameters to the laser module <NUM> activating the laser module and causing it to produce and/or emit the laser energy.

The body-mounted LIO system <NUM>-<NUM> includes a wearable assembly <NUM>, which secures the body-mounted LIO system <NUM>-<NUM> to the user's body via one or more wearable objects such as a headset, a utility belt, or a backpack, among other examples. In the illustrated example, the wearable assembly <NUM> comprises only a headset <NUM>-<NUM>, which is worn on the user's head.

<FIG> is a block diagram of the body-mounted LIO system <NUM>-<NUM> according to the preferred embodiment showing the components of the system in more detail. Specifically, internal components of the headset <NUM>-<NUM>, the activation device <NUM>, and the mobile computing device <NUM> are shown.

The mobile computing device <NUM> includes a central processing unit (CPU) <NUM>, a touchscreen display <NUM>, a wireless interface <NUM> and antenna <NUM>, a microphone <NUM> and speakers <NUM>.

The CPU <NUM> executes firmware/operating system instructions and sends instructions and data to and receives data from the wireless interface <NUM>, the microphone <NUM>, the speakers <NUM>, and the display <NUM>. Executing on typically an operating system (OS) <NUM> of the CPU <NUM> are a mobile application <NUM>, a voice control module <NUM>, and an parameter regulation module <NUM>. The mobile application <NUM> renders a graphical user interface (GUI) <NUM> on the touchscreen display <NUM>. The GUI <NUM>, which is part of the user interface of the body-mounted LIO system <NUM>-<NUM>, displays and receives information such as parameter information, for example, by detecting contact between the user and the touchscreen display <NUM> in certain regions of the touchscreen display <NUM>. The mobile application <NUM> also performs functions related to configuring the LIO system <NUM> such as pairing the mobile computing device <NUM> with the control module <NUM> and/or setting a wake word, which is a selected phrase for indicating that verbal commands follow.

The microphone <NUM> captures sound including the wake word and voice commands indicating parameter information provided by the user, which the mobile computing device <NUM> converts to audio data.

The speakers <NUM> produce sound based on instructions from the parameter regulation module <NUM>, for example, in order to provide audible feedback confirming parameter information and/or voice commands.

The voice control module <NUM> generates voice command information based on the captured audio data. In one example, the voice control module <NUM> recognizes spoken language in the audio data and translates the spoken language to commands that can be interpreted by the parameter regulation module <NUM> and/or executed by the control module <NUM>.

The parameter regulation module <NUM> generates parameter information based on the voice command information generated by the voice control module <NUM>, current parameters for delivering the laser energy, and/or a predetermined safety policy. In generating the parameter information, the parameter regulation module <NUM> also controls and limits the ability of voice commands generated by the voice control module to enact changes to the parameters for the delivered laser energy.

The parameter regulation module <NUM> maintains a set of voice commands that are recognized and translated to parameter information. These valid voice commands might include indicating which parameter to set or adjust and what value to set for the parameter or whether to adjust the parameter up or down in order to provide incremental voice command functionality. These voice commands can include "Power <NUM>," "Power up," "Power down," "Duration up," "Duration down," "Interval up," "Interval down," "Aiming beam up," "Aiming beam down," "Pulse duration up," "Pulse duration down," to list a few examples.

The parameter regulation module <NUM> further provides the audible feedback confirming the voice command information and/or parameter information by sending instructions to the speakers <NUM> to produce sound, for example, repeating back the voice commands interpreted by the parameter regulation module <NUM> and/or parameter information. Additionally, the parameter regulation module <NUM> evaluates the generated parameter information against a predetermined safety policy (for example, based on predetermined criteria in the safety policy for determining when parameters are potentially unsafe) and seeks extra confirmation of the voice command information and/or the parameter information if the parameter information is determined to be unsafe based on the safety policy.

In one example, the parameter regulation module <NUM> provides audible feedback repeating the voice command and then waits for input from the user interface (e.g. further voice command information generated by the voice control module <NUM> based on sound detected by the microphone <NUM>) before proceeding to generate the parameter information.

In another example, the parameter regulation module <NUM> determines that the parameters indicated by the parameter information generated based on the voice command information are unsafe and alerts the user (e.g. via sound produced by the speakers <NUM>) that the parameters are unsafe and/or requires extra confirmation from the user (e.g. via sound captured by the microphone <NUM>) before proceeding to send the parameter information to the control module <NUM>.

Additionally, in some embodiments, the parameter regulation module <NUM> generates the parameter information, for example, by increasing or decreasing current parameter values by predetermined values or percentages. In one example, the parameter regulation module <NUM> calculates an adjusted parameter value that is no more than a predetermined percentage of the current value. The predetermined percentage for setting the power parameter might be <NUM>%, meaning that the power parameter can only be increased and/or decreased by <NUM>% of the current value in response to voice commands. Similarly, the voice commands "aiming beam up" or "aiming beam down" results in no greater than a <NUM>% change in intensity.

In some embodiments, the parameter regulation module <NUM> iterates through sequences of predetermined values for particular parameters, selecting from the predetermined sequence a value that is higher or lower than the current parameter value in response to the voice command information. For example, a finite set of all possible power settings indicated by the predetermined safety policy might include <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> milliwatts (mW), continuing in 50mW increments to <NUM> mW. If the current power setting is at <NUM> mW, the parameter regulation module <NUM> would generate parameter information indicating that the parameters should be set to <NUM> mW in response to the voice command "power up" and <NUM> mW in response to the voice command "power down. " In this way, the parameter regulation module <NUM> prevents the parameters from being inadvertently adjusted from <NUM> mW to <NUM> mW, for example, in response to a misspoken or misunderstood voice command. In a similar example, a finite set of all possible duration settings indicated by the predetermined adjustment criteria might include <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> milliseconds (ms).

The parameter regulation module <NUM> also determines whether particular parameters can or can not be set in response to voice commands based on the current parameter information. For example, the parameter regulation module <NUM> might determine that the interval setting was set to "OFF", or that no interval parameter value was initially provided, and automatically ignore voice commands for the interval parameter in order to prevent the interval parameter from being accidentally set. In this way, the module <NUM> applies a safety policy that prevents the operator from changing the parameters in a way that could be detrimental to patient health.

In the illustrated example, the voice control module <NUM>, microphone <NUM>, speakers <NUM>, GUI <NUM> rendered on the touchscreen display <NUM>, and the activation device <NUM> provide a general user interface (UI) for the LIO system <NUM>. However, in other embodiments (not illustrated) the UI for the LIO system <NUM> can also include other user interface elements <NUM> such as physical input mechanisms such as knobs or buttons, which can be part of the mobile computing device <NUM> itself or part of peripheral devices connected to the mobile computing device <NUM> via the wireless interface <NUM> and/or a physical interface (e.g. data port). In general, the parameter information can be generated by the mobile computing device <NUM> based on any user engagement with the mobile computing device <NUM> and/or peripheral devices.

The wireless network interface <NUM> facilitates sending the parameter information to the control module <NUM> via the antenna <NUM> through a wireless communication link with the control module <NUM> according to wireless personal area network (WPAN) or wireless local area network (WLAN) protocols such as Bluetooth Low Energy (BLE) or WiFi, among other examples.

The headset <NUM>-<NUM>, as previously discussed, includes the control module <NUM>, the power module <NUM>, the laser module <NUM>, the binocular indirect ophthalmoscope <NUM> and the illumination unit <NUM>.

The power module <NUM> includes a battery <NUM>, which supplies the power provided to the control module <NUM>, laser module <NUM> and illumination unit <NUM>. Among other functions, the power module <NUM> performs the functions of a battery management system (e.g. preventing the battery from operating outside its Safe Operating Area, monitoring its state, etc.).

The laser module <NUM> includes a fiber optic cable <NUM> for emitting the laser energy. The fiber optic cable <NUM> is routed through the binocular indirect ophthalmoscope <NUM> such that the laser energy is emitted from the exit aperture <NUM>.

The control module <NUM> includes a CPU <NUM> and a wireless interface <NUM>. The CPU <NUM> directs the functionality of the control module <NUM> such as receiving parameter information from the mobile computing device <NUM> and activation signals from the activation device <NUM> via the wireless interface <NUM> and an antenna <NUM>, as well as sending control signals to the laser module <NUM>.

Finally, the activation device <NUM> includes a wireless interface <NUM> and an antenna <NUM> through which activation signals are sent to the control module <NUM>. In another embodiment of the body-mounted LIO system <NUM>-<NUM> (not illustrated), the activation device <NUM> is a wired foot switch with a wired interface through which activations are sent to the control module <NUM>.

In some embodiments, the voice control module also performs the functions of user interface associated with the activation device. For example, in response to a voice command such as "execute", the device could activate the laser.

<FIG> is an illustration of a table-top LIO system <NUM>-<NUM> to which the present invention is applicable.

The table-top LIO system <NUM>-<NUM> includes a laser console <NUM> and a headset <NUM>-<NUM>. The headset <NUM>-<NUM> includes the binocular indirect ophthalmoscope <NUM> and the illumination unit <NUM> as before. Now, however, the laser console receives the user input via a user interface of the laser console <NUM>, which can include a graphical user interface <NUM>, or other input and display elements such as knobs, dials, keypads and/or buttons generates the parameter information, and drives the laser via a longer fiber optic cable <NUM> which is routed to the laser console <NUM>. The laser console <NUM> receives input from the activation device <NUM> via a wired connection.

<FIG> is a schematic diagram of the table-top LIO system <NUM>-<NUM>. Here, the laser console <NUM> includes the control module <NUM>, the power module <NUM> and the laser module <NUM>. Additionally, the activation device <NUM> includes a wired interface <NUM>, and likewise the control module <NUM> includes a wired interface <NUM>. Instead of sending the activation signals wirelessly to the control module <NUM>, the activation device <NUM> sends the signals via a wired connection between the two devices.

Additionally, the laser console <NUM> now includes the microphone <NUM> and the speakers <NUM>. The laser console <NUM> receives the user input via the graphical user interface <NUM> and/or an additional physical user interface <NUM>, which can include input and display elements such as knobs, dials, keypads and/or buttons.

The control module <NUM>, as before, sets the parameters for the delivered laser energy based on parameter information. Now, additionally, the voice control module <NUM> and the parameter regulation module <NUM> execute on the CPU <NUM> of the control module <NUM>.

<FIG> schematically shows a slit lamp device <NUM> to which the present invention is applicable. The figure schematically shows the previously described laser module <NUM>-a that produces the pulsed laser energy and that is attached to the slit lamp <NUM> via a tonometer mount. The slit lamp includes a magnifying optical device <NUM>, such as a microscope or zoom telescope, configured to receive light at a viewing input <NUM> along a viewing path <NUM> from a target area. The central part of the slit lamp <NUM> includes a white light source <NUM> that is used to illuminate a target area in the eye <NUM> of the patient. This white light is directed, by means of a mirror <NUM>, onto an illumination output path <NUM> that coincides with the optical viewing path <NUM> of the operator at the designed focal point of the diagnostic instrument at the target area. In the same fashion, the light <NUM> from the laser is directed towards the target area along a treatment beam path such that it coincides with the viewing path, at least at the target area.

<FIG> is a schematic diagram of the slit lamp device <NUM>. The slit lamp device <NUM> comprises a diagnostic instrument <NUM> and an adapter unit <NUM>-a mounted to the diagnostic instrument <NUM>.

The system further comprises a user terminal <NUM> in wireless communication with the adapter unit <NUM>-a, and the power module <NUM> electrically coupled to the adapter unit <NUM>-a.

In the illustrated embodiment, the power module <NUM> provides DC operating power to the adapter unit <NUM>-a and the user terminal <NUM> provides the user interface <NUM> to the operator and communicates control commands to the adapter unit <NUM>-a. The power module <NUM> may be battery-powered or configured to receive external power, e.g. AC power. The power module <NUM> may also be integrated into or directly attached to the housing of the adapter unit <NUM>-a; for example, the adapter unit <NUM>-a may comprise a replaceable, e.g. rechargeable, battery. The user terminal <NUM> may further receive values of operational parameters such as performance parameters from the adapter unit. The power module <NUM> and the user terminal <NUM> may be embodied as separate units or as a single control unit. The user terminal <NUM> provides a voice interface allowing for a hands-free control of performance parameters of the adapter unit <NUM>-a. To this end, the user terminal <NUM> includes the microphone <NUM>, and speakers <NUM> and the voice control module <NUM> and parameter regulation module <NUM> execution on the CPU <NUM>. Preferably, the voice recognition system is a self-contained system that operates without the need to communicate with a remote host. However, in alternative embodiments, the voice recognition system may be a distributed system where at least a part of the voice recognition process is performed by a remote host system. Alternatively or additionally, the user terminal may comprise one or more other user interface devices <NUM>, such as knobs, switches, a display, a touch screen and/or the like. The user terminal may further comprise, or be coupled to, the activation device <NUM>.

The diagnostic instrument comprises a power supply <NUM>, a control unit <NUM> and an operating console <NUM>, e.g. embodied as separate units or as a single, integrated unit. The user terminal <NUM> for controlling the adapter unit <NUM>-a may be integrated into or separate from the operating console of the diagnostic instrument. Similarly, the power supply unit <NUM> and the power supply unit <NUM> may be embodied as separate units or as a single, integrated power supply.

<FIG> is a sequence diagram illustrating the process by which the parameters for delivered laser energy are set based on the captured audio data.

First, in step <NUM>, the control module <NUM> sets initial parameters for the laser energy delivered by the laser module <NUM> based on the last used parameters, input detected via the GUI <NUM> or user interface <NUM>, or predetermined default parameters.

In step <NUM>, the activation device <NUM> detects engagement of the activation mechanism. In one example, the user's foot compresses a footswitch. In response, in step <NUM>, the activation device <NUM> sends an activation signal to the control module <NUM>.

In response to receiving the activation signal, the control module <NUM> in step <NUM> sends a control signal to the laser module <NUM>.

In step <NUM>, in response to receiving the control signal, the laser module <NUM> generates and emits the laser energy according to the parameters set by the control module <NUM>.

In step <NUM>, the voice control module <NUM> detects activation of a voice control mode based on configuration information and/or the predetermined safety policy which might specify situations in which voice control should be selectively executed.

In step <NUM>, the voice control module <NUM> receives captured audio data. In one example, the mobile computing device <NUM>, the laser console <NUM> or the user terminal <NUM>, which continuously and in real time monitors audio data captured via the microphone <NUM> for a predetermined wake word programmed, detects the wake word and, in response, plays a tone through the speakers <NUM> prompting the user to say the voice command. The voice control module <NUM> then generates audio data based on sound that was captured after the wake word was detected and tone was played and sends the audio data to the voice control module <NUM>.

In step <NUM>, the voice control module <NUM> generates voice command information based on the captured audio data. In one example, the audio data includes spoken language such as the phrase "power up". The voice control module <NUM>, for example via speech recognition processes, recognizes the phrase "power up" and translates the phrase into parameter information indicating that the power parameter should be incremented. The voice control module <NUM> sends the voice command information to the parameter regulation module <NUM> in step <NUM>.

In step <NUM>, the parameter regulation module <NUM> generates parameter information based on the voice command information, the current parameters, and/or the predetermined safety policy. In one example, the parameter regulation module <NUM> increases or decreases the current parameter value by a predetermined threshold and generates parameter information reflecting the higher or lower value. In another example, the parameter regulation module <NUM> selects the next highest or lowest value with respect to the current value from a predetermined sequence of possible parameter values. In another example, the parameter regulation module <NUM> determines whether setting of the particular parameters indicated in the voice command information should be allowed based on, for example, whether voice control of particular parameters is selectively executed.

In step <NUM>, the parameter regulation module <NUM> sends the parameter information and instructions to set the required parameters to the control module <NUM>.

Steps <NUM> through <NUM> then repeat as previously described, with the laser module <NUM> delivering laser energy based on the parameters.

<FIG> is a flow diagram illustrating the process by which the parameter regulation module <NUM> generates parameter information based on the voice command information and the predetermined safety policy, which corresponds to the previously described step <NUM>, for example.

In step <NUM>, the parameter regulation module <NUM> receives the voice command information from the voice control module <NUM>.

In step <NUM>, the parameter regulation module <NUM> provides audible feedback repeating the voice command information (e.g. via the speakers <NUM>) and prompts the user to confirm that the voice command information generated by the voice control module <NUM> and received from the parameter regulation module <NUM> accurately reflects the voice commands spoken by the user.

In step <NUM>, it is determined whether a positive confirmation was received from the user (e.g. based on the voice control module <NUM> detecting a predetermined confirmation word via the microphone <NUM>). If confirmation was not received after a predetermined time period, the process ends in step <NUM>, and the parameter regulation module <NUM> does not proceed to change the parameters. In an alternative embodiment, the parameter regulation module <NUM> does not perform the confirmation of step <NUM> and simply proceeds after providing the audible feedback.

On the other hand, if confirmation was received within the predetermined time period, in step <NUM>, the parameter regulation module <NUM> identifies the particular parameter (e.g. power, duration, interval, aiming beam, pulse duration, pulse interval) to be set or adjusted based on the voice command information. The parameter to be set/adjusted is based on, for example, which of a predetermined set of words associated with the parameters was detected and recognized by the voice control module <NUM>.

Similarly, in step <NUM>, the parameter regulation module <NUM> then identifies whether the parameter value is being set directly (e.g. based on recognized phrases corresponding to numerical values such as "<NUM>") or incrementally (e.g. based on recognized phrases corresponding to whether the value should be increased or decreased such as "up" or "down").

In step <NUM>, it is determined whether the parameter is being set incrementally. If not, in step <NUM>, the parameter regulation module <NUM> generates the parameter information based on the parameter being set and the value indicated by the voice command information.

On the other hand, if the parameter is being set incrementally, conditions such as the currently set parameters are evaluated to determine whether voice control should be selectively executed or whether the voice command should be ignored. For example, in step <NUM>, it is determined whether the interval is the parameter being set, and if so, in step <NUM>, it is determined whether the current setting for the interval parameter is "OFF" (or some other indication that an initial value for the interval has not been provided). If the interval parameter is set to "OFF", no change is made, the voice command is ignored, and the process ends in step <NUM>.

On the other hand, if the interval is "ON" and is being adjusted, or if some other parameter value is being set or adjusted incrementally, in step <NUM>, the parameter regulation module <NUM> retrieves or calculates a value for the parameter based on the predetermined safety policy. In one example, the policy sets a maximum increase or decrease value or percentage by which the current value is adjusted to calculate the new value. In another example, the policy provides a predetermined sequence of allowed values according to which the current value is incremented or decremented to the next value in the sequence. The parameter regulation module <NUM> then generates the parameter information.

Whether the parameter was set directly or incrementally, in step <NUM>, the parameter regulation module <NUM> evaluates the parameter information based on the predetermined safety policy (for example, based on predetermined criteria in the safety policy for determining when parameters are potentially unsafe). This might include confirming that a parameter value set directly is within a certain difference threshold of the current value or that the value is within a predetermined range, among other examples.

In step <NUM> it is determined whether the parameters, including the parameter currently being set combined with the other parameters, create a potentially unsafe situation for the patient. If so, in step <NUM>, the parameter regulation module <NUM> provides audible feedback repeating the generated parameter information (e.g. via the speakers <NUM>) and prompts the user to confirm the parameter being set, possibly with a message informing the user that the parameters are potentially unsafe. In step <NUM>, if no confirmation is received within a predetermined time period, no parameter changes are made, and the process ends in step <NUM>.

On the other hand, if the parameters are not determined to be potentially unsafe, or if the user confirms the potentially unsafe parameters within the predetermined time period, in step <NUM>, the parameter regulation module <NUM> sends the parameter information to the control module <NUM>, which corresponds to previously described step <NUM>.

Finally, the process ends in step <NUM>. However, the process repeats continually, as the voice control module <NUM> continually generates voice command information based on audio data from the microphone <NUM> and sends the voice control information to the parameter regulation module <NUM>.

In general, the following table includes a set of exemplary voice commands interpreted by the voice command module <NUM>, along with the appropriate action taken in response to the voice commands by the parameter regulation module <NUM>. For these examples, the value N represents the current parameters, "N+<NUM>" and "N-<NUM>" are understood to denote the value N incremented or decremented, respectively, according to the safety policy. Similarly, the word "[TONE]" in the "Full Command Set" column indicates where in the sequence of spoken voice commands an audible tone would be played through the speakers <NUM> (e.g. a sound resembling a beep, chime) to prompt the user to proceed to say the rest of the voice command. The word "[MODE]" in the Audible Response column indicates where in the phrase a word corresponding to the current mode of the laser treatment system <NUM>, such as "Treat" mode or "Standby" mode, among other examples.

More specifically, the Command column includes different voice commands (e.g. phrases spoken by the user) which are recognized by the voice control module <NUM>. The Full Command Set column includes full sequences of wake words, audible tone prompts, and voice commands. The Audible Response column includes audible feedback (e.g. phrases) played through the speakers <NUM> in response to the voice control module <NUM> recognizing and interpreting the voice commands. Finally, the System Action column includes actions performed, for example, by the parameter regulation module <NUM> in response to the voice control module <NUM> recognizing the voice commands in the Commands column.

In one example, in order to execute the "Enter Treat" voice command, the user speaks the wake word "OK Norlase. " An audible tone is then played through the speakers <NUM>, after which the user speaks the voice command "Enter Treat. " In response to the voice control module <NUM> recognizing and interpreting the voice command, the parameter regulation module <NUM> plays the audible feedback phrase "Treat Mode Selected" and then proceeds to place the system into the "Treat" mode, during which parameters can be adjusted and laser energy can be delivered.

In another example, in order to execute the "Power Up" voice command, the user speaks the wake word "OK Norlase. " An audible tone is then played through the speakers <NUM>, after which the user speaks the voice command "Power Up. " In response to the voice control module <NUM> recognizing and interpreting the voice command, the parameter regulation module <NUM> plays the audible feedback phrase "Power at [N+<NUM>]", referring to the new value of the power parameter and increases the power one increment from the current setting, according to the safety policy and other processes described, for example, with respect to <FIG>. For example, if the power is currently set at <NUM>, the audible response would be "Power at <NUM>" to indicate that the power parameter has been increased to <NUM>.

Finally, in yet another example, in order to execute the "System Status" voice command, the user speaks the wake word "OK Norlase. " An audible tone is then played through the speakers <NUM>, after which the user speaks the voice command "System Status. " In response to the voice control module <NUM> recognizing and interpreting the voice command, the parameter regulation module <NUM> plays the informational audible feedback phrase "[Mode] Mode selected, Power at [N], Duration at [N], Interval at [N], Pulse Count at [N]," referring respectively to the current mode setting and the current values of the power, duration, interval and pulse count.

Claim 1:
A system for delivering laser energy to an eye of a patient, the system comprising:
a microphone (<NUM>) for capturing audio data;
a voice control module (<NUM>) for receiving the captured audio data and generating voice command information based on the captured audio data;
a parameter regulation module (<NUM>) for generating parameter information based on the voice command information; and
a control module (<NUM>) for receiving the parameter information and setting the parameters for the delivered laser energy based on the parameter information;
characterized in that the parameter regulation module (<NUM>) is for generating the parameter information based on the voice command information and a predetermined safety policy; and that the voice control module (<NUM>) generates the voice command information by recognizing spoken language indicating <NUM>) whether a pulse duration should be incrementally increased or decreased; and <NUM>) whether a power level should be incrementally increased or decreased, wherein the safety policy indicates maximum percentages by which the parameters can be increased and/or decreased, wherein the parameter regulation module is configured to generate the parameter information based on whether the voice command information indicates that current parameters should be changed incrementally and to calculate new values for the parameters being changed based on the maximum percentages according to the safety policy.