Visualization system for deep brain stimulation

A system, method, and apparatus for a visualization system for deep brain stimulation. The visualization system comprises a camera system, a display system, and an information analyzer. The information analyzer is configured to display a group of electrodes for the deep brain stimulation on a head of a patient on the display system such that a visualization of the group of electrodes is displayed overlaid on the head of the patient in real time in a position corresponding to an actual position of the group of electrodes in a brain in the head of the patient. An operation of the group of electrodes sending an electrical signal into the head of the patient is displayed in the visualization, enabling visualizing a physical reaction of the patient to the deep brain stimulation in conjunction with the visualization of the operation of the group of electrodes.

BACKGROUND INFORMATION

The present disclosure relates generally to biomedical systems and, in particular, to a visualization system for deep brain stimulation.

As people age, their brains become less efficient at managing the electro-chemical nervous signals it generates, sometimes leading to decreased motor function capabilities. In some extreme cases, such as Essential Tremors and Parkinson's disease, the brain effectively “short circuits” resulting in chronic, uncontrollable, spasmodic musculoskeletal movements. These conditions increasingly incapacitate the patient over time, if left untreated.

These disorders are often treated using medications. The medications do not always work as desired. Other types of treatment are also present. One type of treatment is deep brain stimulation (DBS), which can provide relief and restore a great degree of motor function.

Deep brain stimulation uses a medical device called a neurostimulator, which sends electrical impulses through implanted electrodes to specific targets in the brain for the treatment of movement and neuropsychiatric disorders. These electrodes transmit low-level electrical pulses that effectively buffer and normalize neurological misfiring in the brain.

Deep brain stimulation in select brain regions has provided therapeutic benefits for otherwise treatment-resistant disorders. Deep brain stimulation directly changes brain activity in a controlled manner.

Although deep brain stimulation may be effective in treating these disorders, the underlying principles and mechanisms are still not clear. The pulse generator may be programmed by sending electrical signals through electrodes in the brain that have a selected pulse width, voltage amplitude, and frequency. Adjustments to these parameters may be made to obtain desired results in a patient, such as a reduction in tremors.

As high tech as this technology is, it has been in use since the 1930's, and the standard interface used today in programming neurostimulators for deep brain stimulation is at least 15 years old, cumbersome, awkward, and requires undue cognitive overhead for an operator, such as a doctor or technician, to translate 3-dimensional anatomical positions into a series of numbers.

Therefore, it would be desirable to have a method and apparatus that take into account at least some of the issues discussed above, as well as other possible issues. For example, it would be desirable to have a method and apparatus that overcome a technical problem with managing medical device systems, and in particular, to more effectively making adjustments to the operation of a neurostimulator for deep brain stimulation.

SUMMARY

An aspect of the present disclosure provides a visualization system for deep brain stimulation. The visualization system comprises a camera system, a display system, and an information analyzer. The information analyzer is configured to communicate with the camera system and the display system. The information analyzer is configured to display a group of electrodes for the deep brain stimulation on a head of a patient on the display system such that a visualization of the group of electrodes is displayed overlaid on the head of the patient in real time in a position corresponding to an actual position of the group of electrodes in a brain in the head of the patient. An operation of the group of electrodes sending an electrical signal into the head of the patient is displayed in the visualization, enabling visualizing a physical reaction of the patient to the deep brain stimulation in conjunction with the visualization of the operation of the group of electrodes.

Another aspect of the present disclosure provides a method for visualizing deep brain stimulation. The method comprises receiving stimulation information about an operation of a group of electrodes in a brain of a patient for the deep brain stimulation. The stimulation information is received in real time during the operation of the group of electrodes. The method displays the group of electrodes on a head of the patient on a display system such that a visualization of the group of electrodes is displayed overlaid on the head of the patient in real time in a position corresponding to an actual position of the group of electrodes in the brain in the head of the patient. The method displays the visualization of the operation of the group of electrodes sending an electrical signal into the head of the patient, enabling a view of a physical reaction of the patient to the deep brain stimulation in conjunction with the visualization of the operation of the group of electrodes.

Yet another aspect of the present disclosure provides a visualization system for a medical device system. The visualization system comprises a camera system, a display system, and an information analyzer. The information analyzer is in communication with the camera system and the display system. The information analyzer is configured to display the medical device system on a body of a patient on the display system such that a visualization of the medical device system is displayed overlaid on the body of patient with the visualization in real time in a position corresponding to an actual position of the medical device system and an operation of the medical device system is displayed in real time.

The features and functions can be achieved independently in various examples of the present disclosure or may be combined in yet other examples in which further details can be seen with reference to the following description and drawings.

DETAILED DESCRIPTION

The illustrative examples recognize and take into account one or more different considerations. For example, the illustrative examples recognize and take into account that current techniques for programming a neurostimulator using a data processing system, such as a computer, a tablet, a mobile phone, or some other device that can use wired or wireless connections. The illustrative examples recognize and take into account that the interface currently provided through the data processing system enables an operator to enter values to control parameters of electrical signals that are generated by the neurostimulator and emitted through the electrodes. The current interface used by an operator to see information and program the neurostimulator is extremely complex and receives user input in the form of alphanumeric data. The operator may be a doctor, a technician, a nurse, or other person that can monitor and adjust the operation of the neurostimulator.

Further, the illustrative examples recognize and take into account that this interface does not provide the operator any feedback as to the results of changes in the electrical signals generated by the neurostimulator. The illustrative examples recognize and take account that the operator is currently required to observe the patient in which the deep brain stimulation system is implanted and analyze the electrical signals being generated to determine if changes may be needed to obtain desired results using an interface on a data processing system, such as a handheld device.

For example, the illustrative examples recognize and take into account that an operator, such as a doctor, observes as the patient performs a battery of motor function tests while making adjustments, via the interface on the hand-held device, to program the neurostimulator. The illustrative examples recognize and take account that the doctor simultaneously watches the patient, the patient's vitals, the patient's response, directs actions for the patient to take, inquires about sensations perceived by the patient, imagines the location of embedded electrodes in the brain, imagines which station along the electrode is being activated, imagines how much current is being administered, considers which brain structures are being affected from the electrical pulse, watches the hand held device to keep in mind what impulses are being administered to which electrodes and at which electrode stations, considers all interactions that can occur from the multiple impulses being given at each location, as well taking into account as other factors. These examples recognize and take into account that these actions require large amounts of concentration and focus by the doctor.

The illustrative examples recognize and take account that would be useful to have an improved user interface allowing an operator to more easily program a neurostimulator. Thus, the illustrative examples provide a method and apparatus for visualizing deep brain stimulation. In one illustrative example, stimulation information about an operation of a group of electrodes in the brain of a patient for deep brain stimulation is received. The stimulation information is received in real time during operation of the group of electrodes. The process displays the group of electrodes on a head of a patient on the display system such that the group of electrodes is displayed overlaid on a view of the head of the patient in real time in a position corresponding to the actual position of the group of electrodes in a brain in the head of the patient. The process also displays a visualization of an operation of the group of electrodes sending an electrical signal into the head of the patient.

This visualization enables a view of a physical reaction of the patient to the deep brain stimulation, in conjunction with the visualization of the operation of the group of electrodes. For example, the visualization of the signals being generated are displayed in a manner that augments the view of the patient seen by the operator. In this manner, the operator may visualize the generation of electoral signals and how those signals change or reduce physical manifestations of a disorder being treated using the brain stimulation. This type of visualization aids an operator in focusing on the task of analyzing, and potentially modifying, the operation of a neurostimulator more easily as compared to currently used techniques.

With reference now to the figures, and in particular, with reference toFIG. 1, an illustration of a block diagram of a visualization environment for medical devices is depicted in accordance with an illustrative example. As depicted, visualization environment100includes visualization system102. In this illustrative example, visualization system102is utilized to manage the operation of medical device system104, which takes the form of deep brain stimulation system106, in this particular example.

As depicted, deep brain stimulation system106comprises a number of different components. As illustrated in this example, deep brain stimulation system106comprises neurostimulator108, wires110, and electrodes112.

Neurostimulator108is a device that generates electrical signals114. Neurostimulator108may be implanted in body116of patient118. Patient118is a person in which neurostimulator108is implanted. Patient118could also be an animal in other illustrative examples. Electrodes112are implanted in brain120in head122of patient118. Wires110connect neurostimulator108and electrodes112to each other. Wires110also may be located within body116of patient118.

In this illustrative example, visualization system102includes a number of different components. As depicted, visualization system102comprises information analyzer124, camera system126, and display system128.

As depicted, camera system126is comprised of a group of cameras130. As used herein, “a group of” when used with reference to items means one or more items. For example, a group of cameras130is one or more of cameras130. Camera system126can generate images142for a video to provide a live view of patient118.

Display system128is a physical hardware system and includes one or more display devices on which graphical user interface132may be displayed. The display devices can include at least one of a light emitting diode (LED) display, a liquid crystal display (LCD), an organic light emitting diode (OLED) display, or some other suitable device on which graphical user interface132can be displayed.

The components in visualization system102can be implemented in a number different ways. For example, these components can be located in computer system148. Computer system148is a physical hardware system and includes one or more data processing systems. When more than one data processing system is present, those data processing systems are in communication with each other using a communications medium. The communications medium may be a network. The data processing systems can be selected from at least one of head mounted display system, a computer, a server computer, a tablet, or some other suitable data processing system.

As depicted, computer system148can take the form of or include head mounted display (HMD) system134in which these components are integrated in head mounted display system134. Head mounted display system134may take a number of different forms. For example, head mounted display system134can be selected from a group comprising smart glasses, hololens, or some other type of display system that may be worn on the head of operator136.

In one illustrative example, display system128and camera system126are located in head mounted display system134. Information analyzer124is located in at least one of a head mounted display system or a remote data processing system in computer system148.

In this illustrative example, operator136is a person. Operator136can be a doctor, a technician, or some other person that utilizes visualization system102.

As depicted, information analyzer124in visualization system102is configured to communicate with camera system126, display system128, and neurostimulator108in deep brain stimulation system106. As depicted, the communication with these components are performed using a physical or wireless communications link. A physical communications link can be established using at least one of a wire cable, an optical cable, or some other physical medium that may allow for an exchange of information between information analyzer124in visualization system102and at least one of camera system126, display system128, and neurostimulator108. Wireless communication can be performed using a wireless link that employs at least one of radiofrequency signals, magnetic signals, or some other type of wireless signal.

Information analyzer124is configured to receive stimulation information138from neurostimulator108regarding the operation of neurostimulator108. Information analyzer124is configured to receive stimulation information138about operation156of the group of electrodes112in brain120of patient118for deep brain stimulation. As depicted, stimulation information138is received in real time during operation156of the group of electrodes112.

Stimulation information138is an example of information146and can include operational parameters, information about electrical signals114generated by neurostimulator108, and other suitable types of data.

As depicted in this illustrative example, information analyzer124transmits programming140from information analyzer124to neurostimulator108. Programming140can include commands, program code, parameters, or other information that may be used to access stimulation information138, control, or modify the operation of neurostimulator108.

Information analyzer124also can receive images142from camera system126. Images142can be used by information analyzer124to identify position144of head122or other portions of body116of patient118. In this illustrative example, position144includes the location in three-dimensional space. Further, position144also includes identification of the orientation of head122or other portions of body116.

In this illustrative example, position144can be used to determine where to display information146in association with patient118from the view of camera system126in visualization154.

In the illustrative example, information146is any information relating to patient118, which includes information about medical device system104. For example, information146includes at least one of stimulation information138, patient information176, or other suitable information related to patient118. Information146can be displayed in layers155in graphical user interface132as part of visualization154. Each of these types of information146can be displayed as a layer in layers155for visualization154in graphical user interface132. In this illustrative example, patient information176about patient118includes at least one of an image, a patient record, an x-ray, a computer aided tomography (CAT) scan, a thermal map, a magnetic resonance imaging (MRI) scan, or some other type of information.

The use of layers155can allow for easier manipulation of at least one of different types of information146or different pieces of the same type of information146displayed in graphical user interface132. For example, different ones of layers155can be selected for display in visualization154in graphical user interface132. By using layers155, at least one of different types of information146or different pieces of the same type of information146can be displayed, removed, moved, or otherwise manipulated in visualization154displayed in graphical user interface132. The manipulation of the types of information146can be performed at the same time, in a particular order, or both.

Information146is displayed in layers155in association with the view of patient118by being displayed on body116of patient118or in a location proximate to body116in visualization154in a manner that information146is considered to be for patient118. Each layer in layers155displayed in visualization154in graphical user interface132may be manipulated independently of another layer in layers155.

Images142also can be displayed in graphical user interface132as part of visualization154. For example, images142can be utilized to provide a live view of patient118. Images142also can be displayed in layers155.

During operation of visualization system102, information analyzer124is in communication with camera system126and display system128. Information analyzer124also communicates with neurostimulator108.

As depicted, information analyzer124is configured to display a group of electrodes112for a deep brain stimulation on head122of patient118on display system128such that visualization154of the group of electrodes112is displayed overlaid on head122of patient118in graphical user interface132in real time in position corresponding to the actual position of the group of electrodes112in brain120in head122of patient118. The display of the group of electrodes112is also made within a layer in layers155. The display in a layer allows for the display of the group of electrodes112to be manipulated separate from other items in other layers. For example, the group of electrodes112may be manipulated to control the manner in which signals are emitted by the group of electrodes112.

Information analyzer124is also configured to display operation156of the group of electrodes112sending electrical signal158into head122of patient118is displayed in real time. As depicted visualization154of operation156of the group of electrodes112comprises information analyzer124displaying graphic indicators168in graphical user interface132on display system128indicating at least one of a current flow or a voltage from the group of electrodes112into brain120.

A graphic indicator in the group of graphic indicators can be selected from at least one of an icon, an image, an animation, or some other suitable graphic to indicate a flow of current, voltage, or both into the brain of a patient. In this manner, the group of graphical indicators168allow the group of electrodes112to be visualized. For example, information relating to the operation of the group of electrodes112can be visualized by lighting up individual electrodes with different colors. The signals emitted by the individual electrodes can be represented by size, shape, amplitude, and pulse rate, current flow, and other information that can be displayed visually through changes in color, flat-rate, element size, pattern, correction of a moving pattern, and other types of graphical indicators168may be used.

In this manner, operator136is able to visualize physical reaction162of patient118to the deep brain stimulation using electrical signal158in conjunction with operation156of the group of electrodes112in visualization154generated by information analyzer124. Electrical signal158is a selected from at least one of a continuous signal and a pulsed signal.

In this illustrative example, information analyzer124displays map170of brain120in a layer in layers155in graphical user interface132for visualization154of head122or on some other part of body116of patient118. This display may be made during at least one of before, during, or after application of electrical signal158. Map170of brain120is another example of information146.

As depicted, map170of brain120in visualization154in graphical user interface132may include regions selected from at least one of a hindbrain, a midbrain, a forebrain, a cerebral hemisphere, a cerebral lobe, a frontal lobe, a temporal lobe, an occipital lobe, a parietal lobe, a cerebral cortex, or some other region in the brain. As another example, map170of brain120displayed in graphical user interface132for visualization154may be a map of regions identified by functions selected from at least one of hearing, sight, emotion, speech, pain, hunger, smell, or some other suitable function.

Map170may be generated any number different ways. For example, map170may be generated from at least one of a computer tomography (CT) scan, a computerized axial tomography (CAT) scan, a positron-emission tomography (PET) scan, a magnetic resonance imaging (MRI) scan, an x-ray, or some other suitable imaging technique.

Visualization system102also can include sensor system172. Sensor system172is utilized with patient118to detect a group of physiological parameters174for patient118.

The group of physiological parameters174is another example of information146. With the detection of the group of physiological parameters174, additional information may be visualized in visualization154displayed in graphical user interface132. The group of physiological parameters174can be displayed in one or more of layers155in visualization154in graphical user interface132.

For example, information analyzer124can be configured to display the group of physiological parameters174in a layer in layers155as part of visualization154of head122of patient118in graphical user interface132on display system128.

As depicted, information analyzer124can display patient information176about patient118in association with the view of patient118on display system128as part of visualization154. In this manner, visualization154of information146overlaid on or near head122of patient118provides an augmented reality visualization. This information can be displayed by identifying patient118.

Further, operator136can interact with graphical user interface132through user input164generated by input system166for computer system148. Input system166is a physical hardware system and may be selected from at least one of a mouse, a keyboard, a trackball, a touchscreen, a stylus, a motion sensing input device, a cyber glove, or some other suitable type of input device.

For example, operator136can use gestures to select one or more of electrodes112and manipulate the operation of electrodes112. As depicted, input system166can detect gestures made by operator136to generate user input164. As depicted, operator136may use gestures to change parameters about the generation of electrical signals114. For example, the size or extent to which electrical signals114travel into brain120can be changed in size through gestures made by operator136. For example, parameters, such as the magnitude of the current, the magnitude of the voltage, the distance the current travels, the distance the voltage travels, or some other premature about the effects of electrical signals114in brain120may be visualized. These gestures made by operator136can change, for example, a voltage, a current, a pulse width, a frequency, or some other parameter relating to electrical signals114.

Additionally, operator136also may use gestures to select information146for display in visualization154in graphical user interface132. For example, gestures can be made by operator136to display desired pieces of patient information176. The display of information146can be managed by operator136manipulating layers155displaying information146in visualization154in graphical user interface132.

One or more examples are present that overcome issues with managing medical device systems, and in particular, to more effectively making adjustments to the operation of a neurostimulator for deep brain stimulation. As a result, a simultaneous visualization of a patient and patient information in real time is provided in a manner that enables an operator, such as a doctor or technician, to manage the operation of a medical device system, such as deep brain stimulation, more easily through a graphical user interface that displays an augmented reality view of the medical device system with a patient in which the medical device system is implanted.

As a result, computer system148operates as a special purpose computer system in which information analyzer124in computer system148enables visualizing the operation of medical device system104, and in particular, deep brain stimulation system106. In particular, information analyzer124transforms computer system148into a special purpose computer system as compared to currently available general computer systems that do not have information analyzer124.

For example, information analyzer124displays graphical user interface132in a manner to provide visualization154of the operation of deep brain stimulation system106within head122of patient118. In this manner, graphical user interface132is a visual tool provided through information analyzer124in computer system148to operator136in managing deep brain stimulation system106. Visualization154in graphical user interface132can be provided through program code, hardware, or some combination thereof in information analyzer124that configures information analyzer124to display graphical user interface132on display system128.

For example, although display system128is described as a component of head mounted display system134, display system128can take other forms. For example, display system128can be selected from at least one of a display for a tablet display system, a touch screen, pico projector, a holographic projector, or some other suitable type of display system that projects light onto a surface, such as that on head122or some other portion of body116of patient118. With a pico projector or a holographic projector, graphical user interface132can be displayed directly on head122of patient118. For example, graphical user interface132provides visualization154by displaying electrodes112on head122of patient118. Further, operation156of electrodes112can be visualized using graphic indicators168. The display system can be a wireless contact lens display in which images and information may be displayed using light projected through the center of the pupil working with optics in the eye to focus the display on the retina in the art. As a result, two separate images can be superimposed on the retina to create one integrated image for an augmented reality visualization.

Other types of user input can be used, in addition to or in place of gestures, to generate user input164by input system166. For example, user input164can be generated through gaze, voice, or other types of input, in addition to or in place of gestures. Video, audio, or other information also can be part of information146that is displayed in visualization154in graphical user interface132.

As another example, medical device system104may take other forms for purposes other than for deep brain stimulation. For example, the generation of electrical signals114may be initiated through medical device system104in the form of a pacemaker, a defibrillator, or some other suitable type of device that generates electrical signals114within body116. In this manner, the visualization of the manner in which other medical devices generating electrical signals114also may be visualized by an operator for use in managing medical device system104. As another example, medical device system104may be a memory, an image processor, or some of suitable device that may be implemented within body116that generates electrical signals114. As yet another illustrative example, medical device system104may generate electrical signals114to stimulate muscle contraction.

With reference next toFIG. 2, an illustration of a graphical user interface used to provide a visualization in the form of an augmented reality visualization is depicted in accordance with an illustrative example. In this illustrative example, graphical user interface200is an example of one implementation for graphical user interface132shown in block form inFIG. 1that is displayed on display system128in visualization system102to provide an augmented reality visualization.

Patient202may be displayed in graphical user interface200from images generated of patient202. In other illustrative examples, patient202in graphical user interface200may be seen through lenses or other optical elements in a visualization system in which graphical user interface200is displayed to provide an augmented reality visualization. In these examples, a live view of patient202is presented in the visualization system.

In this illustrative example, graphical user interface200shows deep brain stimulation system201. These components include neurostimulator204, wires206, and electrodes207. As shown in this particular example, electrodes207include electrode208, electrode210, electrode212, and electrode214. The display of electrodes207may be within a layer that is displayed within graphical user interface200.

As depicted, neurostimulator204is shown in graphical user interface200as an actual component in a live view of patient202. Wires206and electrodes207are implanted inside of patient202and are shown using graphical indicators. The different components are shown in the locations where the components are actually located in patient202. The location includes a position identified using three-dimensional components and an orientation of the components.

In this illustrative example, graphical user interface200provides an augmented reality visualization in a manner that allows for more efficient analysis of the operation of deep brain stimulation system201. By overlaying the components in deep brain stimulation system201onto patient202, the visualization of these components and the location can aid in managing the operation of deep brain stimulation system201.

With reference next toFIG. 3, an illustration of a graphical user interface used to provide a visualization in the form of an augmented reality visualization is depicted in accordance with an illustrative example. In this example, graphical user interface304is an example of one implementation for graphical user interface132shown in block form inFIG. 1that is displayed on display system128in visualization system102to provide an augmented reality visualization.

In this illustrative example, a live view of patient300is shown with deep brain stimulation system302in graphical user interface304. As depicted, deep brain stimulation system302includes neurostimulator306, wires308, and electrodes310. Electrodes310comprise electrode312and electrode314. In this illustrative example, these different components of deep brain stimulation system302are displayed using graphical indicators overlaid on a live view of patient300to provide an augmented reality visualization. The different components in deep brain stimulation system302can be displayed in a layer within graphical user interface304.

In this depicted example, additional information is also displayed in graphical user interface304. For example, brain316is displayed on head318of patient300. The display of brain316along with deep brain stimulation system302provides additional information in the augmented reality visualization of deep brain stimulation system302. In this example, the display of brain316can be made using a different layer from the display of components in deep brain stimulation system302.

Additionally, graphical indicator320displayed in graphical user interface304and represents a voltage signal. The display voltage signal using graphical indicator320provides a visualization of the operation of deep brain stimulation system302. This display can indicate the station on electrode314in electrodes310. The station indicates where along the electrode314voltage signal322propagates from electrode314. This type of information provides an augmented reality view that is more intuitive and efficient for programming or quantifying the program of deep brain stimulation system302.

With reference next toFIG. 4, an illustration of a graphical user interface used to provide a visualization in the form of an augmented reality visualization is depicted in accordance with an illustrative example. In this illustrative example, graphical user interface400is an example of one implementation for graphical user interface132shown in block form inFIG. 1that is displayed on display system128in visualization system102to provide an augmented reality visualization. In this illustrative example, a live view of patient402is displayed in graphical user interface400.

In this illustrative example, graphical user interface400depicts deep brain stimulation system404. These components include neurostimulator406, wires408, and electrodes410. As shown in this particular example, electrodes410include electrode412, electrode414, and electrode416. The display of electrodes410can be within a layer that is displayed within graphical user interface400.

As depicted, voltage signal417is displayed as being emitted from electrode412. The display of voltage signal417can be performed as an animation to show the extent to which voltage signal417travels within patient402. Animation can be used to also show the frequency, duration, and other parameters of voltage signal417.

Further, patient information418is displayed in graphical user interface400. In this illustrative example, patient information418is displayed as an icon indicating that information about patient402is available for viewing within graphical user interface400. In other words, patient information418can be selected to obtain more detailed information about patient402. As depicted, X-ray420is also displayed in graphical user interface400.

Physiological parameters422are also displayed in graphical user interface400. These parameters are shown in real time as a sensor system detects the parameters.

As depicted in this particular example, all information is displayed on a live view of patient402. The different types of information can be displayed in layers in these illustrative examples.

In this manner, a human operator may more easily visualize information about patient402to determine whether adjustments are needed and what adjustments should be made to the operation of deep brain stimulation system404.

With reference now toFIG. 5, an illustration of a graphical user interface used to provide a visualization in the form of an augmented reality visualization is depicted in accordance with an illustrative example. In this figure, user input has been applied to graphical user interface400as shown inFIG. 4.

In this example, patient information418has been selected through user input. As a result, menu500is displayed. Menu500shows five records, record502, record504, record506, record508, record510, which are present for patient402. User input may be employed to select different records from patient information418.

In this illustrative example, record506has been selected through user input. The selection of record506results in pop-up window512being displayed in graphical user interface400. Pop-up window512shows bloodwork for patient402.

In this manner, the operator viewing graphical user interface400may view the bloodwork for patient402while seeing other information for patient402all within the same view. In this manner, looking at different screens, closing and opening files, and other operations that may distract or require additional concentration can be avoided. As a result, the human operator can focus on viewing patient402and determining whether changes are needed to deep brain stimulation system404.

The illustrations of graphical user interfaces inFIGS. 2-5are provided as examples of some implementations for graphical user interface132shown in block form inFIG. 1. These examples not meant to limit the manner in which other illustrative examples can be implemented. For example, other illustrative examples can display other types of information in addition to or in place of information displayed inFIGS. 2-5. For example, other illustrative examples can provide for a live view of a torso of the patient in addition to the head of the patient.

In another illustrative example, graphical controls can be displayed in the graphical user interface for manipulation by an operator to change the operation of a deep brain stimulation system. The manner in which information is displayed in the different graphic user interfaces can be performed using techniques in addition to or in place of the ones illustrated in these figures. For example, instead of using pop-up window512inFIG. 5, a tooltip or other type of presentation mechanism can be used. Further, windows can be outlined or can be transparent such that only information is displayed.

Turning next toFIG. 6, an illustration of a flowchart of a process for visualizing deep brain stimulation is depicted in accordance with an illustrative example. The process depicted inFIG. 6can be implemented in visualization environment100inFIG. 1. For example, the process can be implemented in information analyzer124within visualization system102to provide visualization154for the operation of medical device system104.

In this example, as shown inFIG. 1, visualization154is provided through the display of graphical indicators168in graphical user interface132. This visualization can include a live view of head122of patient118in which information146displayed using graphical indicators168augments the live view of head122to generate an augmented reality visualization. This visualization includes the operation of medical device system104and also can include information146regarding the effects of the operation of medical device system104.

The process begins by receiving stimulation information about an operation of a group of electrodes in a brain of a patient for deep brain stimulation (operation600). The stimulation information is received in real time during operation of the group of electrodes.

The process displays the group of electrodes on a head of a patient in a graphical user interface on a display system (operation602). The display provides a visualization of the group of electrodes displayed overlaid on the head of the patient in the graphical user interface in real time. The group of electrodes is displayed in a position corresponding to an actual position of the group of electrodes in the brain in the head of the patient.

The process displays the operation of the group of electrodes sending an electrical signal into the head of the patient in a visualization (operation604). The process terminates thereafter. In operation604, displaying the operation of the group of electrodes comprises displaying a group of graphic indicators indicating at least one of a current flow or a voltage from the group of electrodes into the brain. Operation604enables a view of a physical reaction of the patient to the deep brain stimulation in conjunction with the visualization of the operation of the group of electrodes.

With reference now toFIG. 7, an illustration of a flowchart of a process for displaying information for a visualization of deep brain stimulation is depicted in accordance with an illustrative example. The process inFIG. 7may be performed in conjunction with the process inFIG. 1to display information relating to the operation of the group of electrodes. This information may be obtained from a database, sensors, or other suitable sources.

The process begins by displaying a map of the brain of the patient on the graphical user interface overlaid on the view of the head of the patient (operation700). In this manner, the view of the group of electrodes displayed in the process inFIG. 7, may be seen in conjunction with the regions of the brain in which the electrodes are located.

The process displays a group of physiological parameters in association with a live view of the head of the patient in the graphical user interface presenting visualization (operation702). The process displays patient information about the patient in association in the visualization of the patient on the display system (operation704). The process terminates thereafter. The information about the patient includes at least one of an image, a patient record, an x-ray, a computer aided tomography (CAT) scan, or a magnetic resonance imaging (MRI) scan.

The process inFIG. 7may be repeated any number of times. For example, the displayed patient information can change as physiological parameters detected by sensor systems associated with the patient change.

Turning next toFIG. 8, an illustration of a flowchart of a process for visualizing deep brain stimulation is depicted in accordance with an illustrative example. The process depicted inFIG. 8can be implemented in visualization environment100inFIG. 1. For example, the process may be implemented in information analyzer124within visualization system102to provide visualization154for the operation of medical device system104. Medical device system104is any device that can be implanted in the human body performing physiological processes for to performing an action to obtain at least one of a pharmacological, immunological, or metabolic response.

In this example, medical device system104can take forms other than a deep brain stimulation system. For example, medical device system104may be a drug pump, a shunt, a pacemaker, a defibrillator, or some other suitable device.

The process begins by generating a view of a patient (operation800). The view can be generated through images of the patient displayed in a graphical user interface or can be a view through lenses in a head mounted device.

The process identifies medical device information for the medical device system (operation802). The medical device information includes information about the location of one or more components in the medical device system. Further, the medical device information also can include information regarding the operation of the medical device system. For example, electrical signals, magnetic signals, drugs, chemicals, or other items that may be injected into, propagated through, or introduced into the body of the patient as the medical device system operates are examples of medical device information. Other types of medical device information include parameters such as voltage, pulse width, timing, dosage, type of medication, and other suitable types of information relating to the medical device system.

The process displays medical device information about the medical device in the graphical user interface to supplement the view of the patient (operation804). The supplementation provides an augmented reality visualization in this illustrative example. The medical device information can be a group of graphical indicators identifying the location of the medical device in the patient.

In this manner, the location, including three-dimensional position and orientation, of the medical device system in the patient can be seen through this visualization provided through the view of the patient with the medical device information. Additionally, the medical device information can include using a group of graphical indicators to provide a visualization of the operation of the medical device system. For example, electrical signals, magnetic signals, drugs, chemicals, or other items that can be injected into, propagated through, or introduced into the body the patient as the medical device system operates. This information is displayed in real time in this illustrative example.

The process also displays patient information on the graphical user interface (operation806). The process terminates thereafter. This patient information can include information about the patient obtained from various records or database. The patient information also can be real-time information about physiological parameters measured using a sensor system associated with the patient.

With the visualization, an operator, such as a doctor, technician, or other person, can make adjustments to the operation of the medical device system. The visualization is provided through augmented reality visualization in which a view of the patient with the medical system in the operation of the system is seen. This visualization allows the operator to more easily focus on changes that can be needed in the operation of the medical device system.

In some alternative implementations of an illustrative example, the function or functions noted in the blocks can occur out of the order noted in the figures. For example, in some cases, two blocks shown in succession can be performed substantially concurrently, or the blocks may sometimes be performed in the reverse order, depending upon the functionality involved. Also, other blocks can be added in addition to the illustrated blocks in a flowchart or block diagram.

Turning now toFIG. 9, an illustration of a block diagram of a data processing system is depicted in accordance with an illustrative example. Data processing system900may be used to implement computer system148inFIG. 1. In this illustrative example, data processing system900includes communications framework902, which provides communications between processor unit904, memory906, persistent storage908, communications unit910, input/output unit912, and display914. In this example, communications framework902can take the form of a bus system.

Processor unit904serves to execute instructions for software that can be loaded into memory906. Processor unit904can be a number of processors, a multi-processor core, or some other type of processor, depending on the particular implementation.

Memory906and persistent storage908are examples of storage devices916. A storage device is any piece of hardware that is capable of storing information, such as, for example, without limitation, at least one of data, program code in functional form, or other suitable information either on a temporary basis, a permanent basis, or both on a temporary basis and a permanent basis. Storage devices916can also be referred to as computer-readable storage devices in these illustrative examples. Memory906, in these examples, can be, for example, a random-access memory or any other suitable volatile or non-volatile storage device. Persistent storage908can take various forms, depending on the particular implementation.

For example, persistent storage908may contain one or more components or devices. For example, persistent storage908can be a hard drive, a solid state hard drive, a flash memory, a rewritable optical disk, a rewritable magnetic tape, or some combination of the above. The media used by persistent storage908also can be removable. For example, a removable hard drive can be used for persistent storage908.

Communications unit910, in these illustrative examples, provides for communications with other data processing systems or devices. In these illustrative examples, communications unit910is a network interface card.

Input/output unit912allows for input and output of data with other devices that can be connected to data processing system900. For example, input/output unit912can provide a connection for user input through at least one of a keyboard, a mouse, or some other suitable input device. Further, input/output unit912can send output to a printer. Display914provides a mechanism to display information to a user.

Instructions for at least one of the operating system, applications, or programs may be located in storage devices916, which are in communication with processor unit904through communications framework902. The processes in the different examples can be performed by processor unit904using computer-implemented instructions, which can be located in a memory, such as memory906.

These instructions are referred to as program code, computer usable program code, or computer-readable program code that can be read and executed by a processor in processor unit904. The program code in the different examples can be embodied on different physical or computer-readable storage media, such as memory906or persistent storage908.

Program code918is located in a functional form on computer-readable media920that is selectively removable and can be loaded onto or transferred to data processing system900for execution by processor unit904. Program code918and computer-readable media920form computer program product922in these illustrative examples. In one example, computer-readable media920can be computer-readable storage media924or computer-readable signal media926. In these illustrative examples, computer-readable storage media924is a physical or tangible storage device used to store program code918rather than a medium that propagates or transmits program code918.

Alternatively, program code918may be transferred to data processing system900using computer-readable signal media926. Computer-readable signal media926can be, for example, a propagated data signal containing program code918. For example, computer-readable signal media926can be at least one of an electromagnetic signal, an optical signal, or any other suitable type of signal. These signals can be transmitted over at least one of communications links, such as wireless communications links, optical fiber cable, coaxial cable, a wire, or any other suitable type of communications link.

The different components illustrated for data processing system900are not meant to provide architectural limitations to the manner in which different examples may be implemented. The different illustrative examples can be implemented in a data processing system including components in addition to or in place of those illustrated for data processing system900. Other components shown inFIG. 9can be varied from the illustrative examples shown. The different examples can be implemented using any hardware device or system capable of running program code918.

Thus, the illustrative examples provide one or more technical solutions that overcome a technical problem with managing medical device systems and in particular to more effectively making adjustments to the operation of a neurostimulator for deep brain stimulation.

As a result, one or more technical solutions may provide a technical effect in which a visualization is provided in a manner that enables an operator, such as a doctor or technician, to manage the operation of a medical device system, such as deep brain stimulation, more easily. One or more technical solutions provide a technical effect in the visualization that is provided through a graphical user interface that displays an augmented reality view of the medical device system with a patient in which the medical device system is implanted.

In this manner, a newer and more intuitive and efficient mechanism is provided to visualize information relating to the operation of medical devices. For example, stimulation information for a deep brain stimulation system can be displayed in a graphical user interface to provide a visualization including an augmented reality view that decreases the cognitive workload required for an operator such as a doctor managing the deep brain stimulation system. With the augmented reality view, the visualization allows the doctor to perform work more easily, intuitively, and with better focus to address the effectiveness of the treatment provided by the deep brain stimulation system, making adjustments, and performing other operations.

The description of the different illustrative examples has been presented for purposes of illustration and description and is not intended to be exhaustive or limited to the examples in the form disclosed. The different illustrative examples describe components that perform actions or operations. In an illustrative example, a component can be configured to perform the action or operation described. For example, the component can have a configuration or design for a structure that provides the component an ability to perform the action or operation that is described in the illustrative examples as being performed by the component.

Many modifications and variations will be apparent to those of ordinary skill in the art. Further, different illustrative examples may provide different features as compared to other desirable examples. The example or examples selected are chosen and described in order to best explain the principles of the examples, the practical application, and to enable others of ordinary skill in the art to understand the disclosure for various examples with various modifications as are suited to the particular use contemplated.