Wearable interface for remote monitoring and control of a medical device

A wearable interface device, such as a head-mounted display, provides an augmented reality and/or display system and may be used in accordance with medical devices and the performance of medical treatments, particularly a dialysis machine and a dialysis treatment. The wearable interface device may be worn by a user, such as a health care practitioner (HCP), in connection with remotely monitoring and/or controlling the dialysis machine during the dialysis treatment. The HCP may receive alerts and/or other information concerning the dialysis treatment from the dialysis machine that are displayed on the wearable interface device and may use the wearable interface device to control the dialysis machine via the exchange of wireless signals with the dialysis machine. The wearable interface device may recognize commands from the HCP, such as gestures, to provide non-contact operation of the wearable interface device and remote control of the dialysis machine by the HCP.

TECHNICAL FIELD

This patent application is related to processing devices and interfaces in the medical device area.

BACKGROUND OF THE INVENTION

Hemodialysis is a process which employs a machine that includes a dialyzer to aid patients whose renal function has deteriorated to the point where their body cannot adequately rid itself of toxins. The dialyzer may include a semi-permeable membrane, the membrane serving to divide the dialyzer into two chambers. Blood is pumped through one chamber and a dialysis solution through the second. As the blood flows by the dialysis fluid, impurities, such as urea and creatinine, diffuse through the semi-permeable membrane into the dialysis solution. The electrolyte concentration of the dialysis fluid may be set so as to maintain electrolytic balance within the patient. Other purification techniques and processes may additionally be used. Hemodialysis may be generally referred to herein as “dialysis,” although it is noted that other types of dialysis exist, such a peritoneal dialysis, and it is noted that the system described herein may be used in connection with any appropriate dialysis system or similar treatment system.

Since dialysis involves removing blood from and returning blood to a patient, performing a dialysis procedure carries a degree of risk. Dialysis treatment requires monitoring of several patient vital signs and dialysis parameters during the dialysis process in order to optimize the overall efficacy of the dialysis procedure, to assess the condition of a fistula (the access to the patient's blood) and to determine the actual purification achieved. Some examples of parameters monitored and analyzed by a dialysis machine or equipment include the blood access flow rate or the rate at which blood flows out of the patient to the dialyzer, a critical parameter; and the ratio Kt/V to measure dialysis efficiency, where K is the clearance or dialysance (both terms representing the purification efficiency of the dialyzer), t is treatment time and V is the patient's total water value.

A processing device coupled to the dialysis machine may be used to manage and oversee the functions of the dialysis process and to, for example, monitor, analyze and interpret patient vital signs and dialysis parameters during a dialysis procedure. The processing device may include a display that displays information concerning the dialysis procedure and include an interface that enables configuration and control of the dialysis machine. A health care practitioner such as a nurse or a patient care technician may oversee the dialysis treatment sessions. Data provided by the dialysis machine and the processing device may aid the health care practitioner in performing his or her duties.

For various descriptions of dialysis systems and components, reference is made, for example, to U.S. Pat. No. 8,110,104 B2 to Crnkovich et al., entitled “Dialysis Systems and Related Components,” and U.S. Pat. No. 6,775,577 B2 to Crnkovich et al., entitled “Method and System for Controlling a Medical Device,” which are incorporated herein by reference. For a description of a sensor system that may be used in connection with monitoring and issuing alerts during a dialysis procedure, reference is made, for example, to U.S. Pat. No. 7,973,667 B2 to Crnkovich et al., entitled “Wetness Sensor,” which is incorporated herein by reference. For various descriptions of interfaces for dialysis systems, reference is made, for example, to U.S. Pat. No. 8,323,503 B2 to Levin et al., entitled “User Interface Processing Device” and U.S. Patent App. Pub. No. 2007/0112603 A1 to Kauthen et al., entitled “Digital Data Entry Methods and Devices,” which are incorporated herein by reference.

In a clinic environment, there may be one health care practitioner for multiple patients, so it is often the case that while the health care practitioner is helping one patient, an alarm may go off for another patient that requires the health care practitioner to investigate and/or attend. In such cases, the health care practitioner may often need to leave a current duty to go to the source of the alarm. Further, where one or more patients are undergoing a dialysis treatment, the health care practitioner may need to adjust the dialysis machine in response to an alarm and/or alert and, in so doing, may often need to re-glove from any prior patient interaction.

Accordingly, it would be desirable to facilitate improvements in the efficient and effective monitoring and control of a dialysis treatment by a health care practitioner overseeing the dialysis treatment, in particular, to enable remote monitoring and control by the health care practitioner of the dialysis treatment and/or dialysis machine and without requiring the health care practitioner to physically contact or even, in some cases, be physically present at the dialysis machine.

SUMMARY OF THE INVENTION

According to the system described herein, a method of remotely interfacing with a medical device includes providing a wearable interface device that enables remote interfacing with the medical device by a user wearing the wearable interface device. Signals are wirelessly exchanged between the wearable interface device and the medical device. The signals corresponds to a treatment performed using the medical device. At least one of the signals at the wearable interface device is used to generate information corresponding to the treatment performed using the medical device. The information is displayed on a screen of the wearable interface device. The medical device may be a dialysis machine. The method may further include recognizing, at the wearable interface device, at least one non-contact command input by the user. The non-contact command may be used to remotely control the medical device during the treatment. The non-contact command may include a command to remotely control the medical device during the treatment by modifying at least one parameter of the medical device from a position in which the wearable interface device is out of visual line-of-sight of the medical device. The wearable interface device may be a head-mounted device, and the information displayed on the screen of the wearable interface device includes dialysis treatment information. The dialysis treatment information may include an alert concerning the dialysis treatment. The method may further include augmenting a real view through the wearable interface device with information corresponding to the dialysis treatment information.

According further to the system described herein, a non-transitory computer-readable medium stores software that remotely interfaces with a medical device. The software includes executable code that operates a wearable interface device that enables remote interfacing with the medical device by a user wearing the wearable interface device. Executable code is provided that wirelessly exchanges signals between the wearable interface device and the medical device, wherein the signals corresponds to a treatment performed using the medical device. Executable code is provided that processes at least one of the signals at the wearable interface device to generate information corresponding to the treatment performed using the medical device. Executable code is provided that displays the information on a screen of the wearable interface device. The medical device may include a dialysis machine. Executable code may be provided that recognizes, at the wearable interface device, at least one non-contact command input by the user. The non-contact command may be used to remotely control the medical device during the treatment. The non-contact command includes a command to remotely control the medical device during the treatment by modifying at least one parameter of the medical device from a position in which the user is out of visual line-of-sight of the medical device. The wearable interface device may be a head-mounted device, and the information displayed on the screen of the wearable interface device includes dialysis treatment information. The dialysis treatment information may include an alert concerning the dialysis treatment. Executable code may be provided that augments a real view through the wearable interface device with information corresponding to the dialysis treatment information.

According to the system described herein, a system is provided for enabling remote interfacing with a dialysis machine. The system includes at least one sensor of the dialysis machine that receives and transmits signals corresponding to a dialysis treatment performed by the dialysis machine. A wearable interface device is provided that is worn by a user and that is wirelessly coupled to the at least one sensor. The wearable interface device includes at least one processor that processes received signals into information corresponding to the dialysis treatment and transmits signals used to control the dialysis machine. At least one screen is provided that displays the information corresponding to the dialysis treatment. At least one command recognition component is provided that recognizes a non-contact command input by the user to the wearable interface device. A camera may be provided that captures an image being viewed using the wearable interface device. The wearable interface device controls the dialysis machine when the wearable interface device is out of a visual line-of-sight with the dialysis machine during the dialysis treatment. The screen of the wearable interface device may include a head-mounted display, and the wearable interface device may include a non-transitory computer readable medium storing software that enables control of the dialysis machine during the dialysis treatment using at least one dialysis treatment screen displayed on the head-mounted display.

DETAILED DESCRIPTION OF VARIOUS EMBODIMENTS

FIG. 1is a schematic illustration of an example of a patient care environment10in which a patient4seated in a chair6receives medical treatment from a treatment station22and which may be used in connection with an embodiment of the system described herein. The medical treatment is, for example, dialysis. The treatment station22may be a dialysis treatment station or dialysis machine. A tube or blood line8transports blood from the patient4to the dialysis machine22and back again to the patient4after processing and treatment in the dialysis machine22. The dialysis machine22with display20may be connected via cabling18to controller device30that may include a processor14which controls a touch screen display12. In various embodiments, the display20may display information corresponding to a dialysis treatment being performed by the dialysis machine22. The touch screen display12may be mounted on a movable stand16of the controller device30. The touch screen display12may include a touch screen that permits a health care practitioner (HCP), such as a nurse, a patient care technician (PCT), or even a patient, to press the display12to, for example, to interface with and/or control the dialysis machine22and/or to enter patient or other data.

According to various embodiments of the system described herein, a sensor40may be coupled to the controller device30that may be used to control the dialysis machine22in connection with transmitting and/or receiving signals to or from a remote or external interface device, as further discussed in detail elsewhere herein. The sensor40may be wirelessly coupled to one or more wireless interface devices that may be used by a PCT to monitor and/or control a dialysis treatment being performed by the dialysis machine22. Various embodiments for the one or more wireless interface devices and for the actions and functions of the sensor40in connection with control of the dialysis machine22are further discussed in detail elsewhere herein. It is noted that the system described herein may be used with any appropriate wireless communication technology, including, for example, IEEE 802.11b/g, 802.11b/g/n, and/or Bluetooth, having appropriate security and encryption standards, and used in conjunction with appropriate wireless networks, with hardware and software components, that support such wireless communication technologies.

FIG. 2is a schematic illustration of another example of a patient care environment100that may be used in connection with an embodiment of the system described herein. In the patient care environment100, the patient4is seated in the chair6and receives medical treatment from a treatment station, such as a dialysis machine102. The tube or blood line8is used for transporting blood from the patient4to the dialysis machine102and back again to the patient4after processing and treatment of the blood in the dialysis machine102. The dialysis machine102may be configured to communicate with an external network120, such as a local-area network or the Internet, via a wired or wireless connection124. The network120may include one or more databases or other stores of information that securely contain medical information that may be accessed in connection with operation of the system described herein. It is noted that the system described herein may be used in connection with dialysis products produced by Fresenius Medical Care North America of Waltham, Mass., including, for example, Fresenius hemodialysis systems (e.g., a 2008T system).

In an embodiment, the dialysis machine102may include a display112with touch screen features. The dialysis machine102may centralize and consolidate dialysis functions and data entry functions in a single device102, without, e.g., the use of a separate, external display (e.g., display12ofFIG. 1) or a separate, external processor (e.g., processor14) with associated equipment (e.g., movable stand16). In an embodiment, the dialysis machine102may include one or more processors114, like the processor14, that may be used in connection with interfacing with, and control of, the dialysis machine102, for example, by an HCP during a dialysis treatment. Consolidation of functions in a single dialysis machine102may advantageously reduce the amount of external cabling (e.g., cabling18) to the device102. The dialysis machine102may further reduce the amount of space needed for dialysis treatment and present less crowding of the patient care environment100. An HCP may be able to focus solely on the dialysis machine102, or the display112of the dialysis machine102, without the HCP's attention being diverted to, e.g., another external display. The dialysis machine102may reduce power consumption and cost as compared to other, non-centralized implementations.

In an embodiment, a sensor140may be coupled to the dialysis machine102. As noted in connection with the sensor40ofFIG. 1, and as discussed in detail elsewhere herein, the sensor140may be used in connection with receiving external or remote signals that may be used to control the dialysis machine102and/or may be transmit signals in connection with operation of the dialysis machine102. In another embodiment, a sensor140′, that may be like the sensor140, but may be separate from the dialysis machine140and coupled wirelessly thereto. Further, the sensor140′ may also be wireless coupled to the network120. Accordingly, in various embodiments, functions of the sensor140′ may include control of and/or information chance with the dialysis machine102via direct communication therewith and/or the sensor140′ may interface with the dialysis machine102via the network120. Further discussions of the features and functions of the sensor140and140′ are discussed in detail elsewhere herein.

FIG. 3is schematic illustration of an example implementation200of the dialysis machine102according to an embodiment of the system described herein. A user interface processing device (UIP)206may be configured to share user interface resources, i.e., user interface devices208-1,208-2,208-3. . . ,208-N, between a first processing device202and a second processing device204. Both the first and the second processing devices202,204may be connected to the UIP206via respective connections210,212, while the user interface devices208-1,208-2,208-3. . . ,208-N are connected to the UIP206via connections214-1,214-2,214-3. . . ,214-N. Although one UIP206is shown inFIG. 3, several user interface processing devices may be used to implement the functionality of the UIP206. The UIP206is connected to memory216via a connection218. Other memory (not shown) may be connected to, and, used by, e.g., the first processing device202and/or the second processing device204.

The user interface devices208-1,208-2,208-3. . . ,208-N may include any of a variety of user interface devices known in the art, such as an alphanumeric keyboard or a keypad, a pointing device (e.g., a touchpad, a mouse, or a trackball), a display, and a display with a touch screen. In an implementation, one or more of the user interface devices208-1,208-2,208-3. . . ,208-N may be located external to the HD device200, specifically user interface device208-3is shown remotely located and wirelessly coupled, via wireless connection214-3, to the HD device200. Various embodiments for a user interface device, like that of user interface device208-3, being used to wirelessly monitor and/or control the dialysis machine102are further discussed in detail elsewhere herein.

The second processing device204of the HD device200may be configured to communicate with the external network120, such as a local-area network or the Internet, via a wired or wireless connection124(and, e.g., via a network interface (not shown)). In other implementations, other processing devices such as the UIP206or the first processing device202may communicate with an external network such as the external network120.

As described herein, the UIP206may be configured to share the user interface devices208-1,208-2,208-3. . . ,208-N between the first processing device202and the second processing device204. The UIP206may switch focus from the first processing device202to the second processing device204. The UIP206may likewise switch focus from the second processing device204to the first processing device202. Specifically, a processing device, such as the first or the second processing device202,204ofFIG. 3, may be said to have focus when the processing device has control of, and/or is controlled by, one or more user interface devices connected to, or communicating with, the processing device (e.g., via one or more user interface processing devices). That is, in this example, when a processing device has focus, a user interface device connected to, or communicating with, the processing device (e.g., via one or more user interface processing devices) will generally affect operation of the processing device, and thereby the dialysis machine102. User interactions with a user interface device will likewise generally affect operation of the processing device in this instance. Likewise, in this example, when a processing device has focus, the processing device may control a user interface device (such as a video display) connected to, or communicating with, the processing device (e.g., via one or more user interface processing devices).

When a processing device, such as the first or the second processing device202,204ofFIG. 3, does not have focus, then, for example, the processing device may not have control of and/or be controlled by one or more user interface devices connected to, or communicating with, the processing device (e.g., via one or more user interface processing devices). Rather, another processing device may have been given focus. One or more user interface processing devices such as the UIP206may send protocol data to the processing device, even when the processing device does not presently have focus, so that the processing device may be configured to maintain connections with one or more user interface devices. That is, from the perspective of the processing device, even when the processing device does not have focus, the processing device may have a connection maintained with a user interface device that the processing device does not control and/or that is not controlled by the processing device when the processing device does not have focus. The UIP206may therefore send protocol data related to the one or more user interface devices to the first and the second processing devices202,204, irrespective of which processing device202,204has focus.

When a processing device (such as the first processing device202or the second processing device204) has focus, one or more user interface processing devices (such as the UIP206) may manage communications between one or more user interface devices (such as the user interface devices208-1,208-2,208-3. . . ,208-N) and the processing device. The UIP206may, when the processing device has focus, permit the user interface devices208-1,208-2,208-3. . . ,208-N to affect operation of the processing device. The UIP206may switch between modes. The modes may be exclusive of one another and may include a mode in which the first processing device202has focus, and a mode in which a second processing device204has focus.

According to various embodiments of the system described herein, one or more of the interface devices208-1to208-N, such as the device208-3, may include one or more remote interface devices wireless coupled to the dialysis machine102via a sensor, such as the sensor40,140or140′ discussed inFIG. 1and/orFIG. 2. The remote interface device(s)208-3may include various embodiments and implementations of devices that may be used by a user (such as an HCP) in connection with the monitoring and/or control of the dialysis machine102, as further discussed in detail elsewhere herein.

FIG. 4is a schematic illustration of a more detailed implementation300of the dialysis machine102according to an embodiment of the system described herein. A UIP306is configured to share user interface resources, e.g., a keyboard308, a pointing device310(such as a touchpad), a display312with a touch screen, and/or a remote interface device400, between a first processing device302and a second processing device304. The first processing device302may be a functional dialysis processing device (FHP)302that may be configured to monitor dialysis functions of the HD device300. The second processing device304may be a microprocessor, such as a standard personal computer (PC) processor, embedded within the HD device300, and may be referred to as an embedded processing device (EP)304. The FHP302is connected to the UIP306via connections322,324,326,328, and the EP304is connected to the UIP306via connections330,332,334,336.

The keyboard308is connected to the UIP306via connection338. The pointing device310is connected to the UIP306via connection340. The display312is connected to a digital video switch316via connection342, which is in turn connected to the UIP306, the FHP302, and the EP304via respective connections344,346,348. A touch screen controller314is connected to the display312via connection350, and to the UIP306via connection352. Although one UIP306is shown inFIG. 4, several user interface processing devices may be used to implement the functionality of the UIP306. The UIP306is connected to memory358via a connection360. Other memory (not shown) may be connected to, and, used by, e.g., the FHP302and/or the EP304. The EP304, for example, may utilize a flash memory rather than a conventional hard drive. The HD device300also includes an audio device362. The audio device362is connected to the EP304via connection364and the UIP306via connection366.FIG. 4is intended to show functional connections between devices of the HD device300, so more or fewer connections may be used than are shown inFIG. 4.

As described above, the UIP306may switch focus from the FHP302to the EP304. The UIP306may likewise switch focus from the EP304to the FHP302. When the FHP302has focus, one or more of the keyboard308, the pointing device310, the display312with a touch screen will generally affect operation of the FHP302. When the EP304has focus, the keyboard308, the pointing device310, the display312with a touch screen, and/or the remote interface device400may generally affect operation of the EP304. User interactions with the devices308,310,312,400will likewise generally affect operation of whichever processing device (the FHP302or the EP304) has focus. The processing device that has focus (the FHP302or the EP304) may control, e.g., the display312in certain circumstances.

In various implementation, one or more of the user interface devices may be located external to the HD device300. In this example implementation, when the EP304has focus, the FHP302does not have focus, and the FHP302may not have control of and/or be controlled by the devices308,310,312,400. When the FHP302has focus, the EP304does not have focus, and the EP304may not have control of and/or be controlled by the devices308,310,312,400. The UIP306may send protocol data relating to the devices308,310,312to the EP304and the FHP302, even when one of these devices does not have focus, so that the EP304and the FHP302may maintain connections with the devices308,310,312. That is, from the perspective of the processing device (EP304or FHP302) that does not have focus, a connection at least appears to be maintained with the devices308,310,312,400, even though these devices308,310,312,400are not controlled by, and do not control, the processing device that does not have focus. The UIP306may therefore send protocol data related to the devices308,310,312,400to the FHP302and the EP304, irrespective of which processing device302,304has focus. The UIP306may switch between modes. The modes may be exclusive of one another and may include a mode in which the first processing device302has focus, and a mode in which the second processing device304has focus.

In accordance with the system described herein, it is noted that systems and techniques are known for enabling wearable displays, such as glasses, that may provide a controllable display to provide information and a controllable interface to a user wearing the display, and which are sometimes referred to as wearable “augmented reality” systems. For example, “Project Glass” is a research and development program by Google Inc. of Mountain View, Calif., to develop augmented reality head-mounted displays. Reference is made, for example, to U.S. Pat. No. 8,223,088 B1 to Gomez et al., entitled “Multimode Input Field for a Head-Mounted Display,” and U.S. Pat. No. 8,228,315 B1 to Starner et al., entitled “Methods and Systems for a Virtual Input Device,” both assigned to Google, Inc., that disclose systems for wearable displays and/or augmented reality systems. Other companies have also developed wearable displays and/or augmented reality systems (see, e.g., U.S. Patent App. Pub. No. 2012/0293548 A1 to Perez et al., entitled “Event Augmentation with Real-Time Information,” assigned to Microsoft Corporation of Redmond, Wash., and U.S. Pat. No. 8,212,859 B2 to Tang et al., entitled “Peripheral Treatment for Head-Mounted Displays,” assigned to Apple Inc. of Cupertino, Calif.). The system described herein may be used in connection with any appropriate wearable display and/or augmented reality system as implemented in accordance with the features and processing discussed herein.

FIG. 5is a schematic illustration of an interface device401for a head-mounted display that may be a wearable augmented reality system and may be used in accordance with an embodiment of the system described herein. The interface device401may be an embodiment of the device400described inFIG. 4. The interface device401may be worn by a user, such as an HCP, in connection with remotely monitoring and/or controlling a dialysis machine or component, such as the dialysis machines22,102and/or the controller device30, during a dialysis treatment, as further discussed in detail elsewhere herein. The interface device is principally shown and described herein in connection with an implementation of the interface device as glasses. However, other head-mounted display implementation may be used in connection with the system described herein. Further, wearable implementations other than head-mounted displays may also be used in connection with the system described herein, including, for example, a wrist watch-style implementation.

The interface device401may include two sides with screens405,410that may be used and function independently of each other. For example, in an embodiment, the screen405may be clear to enable a user to perform duties remote from the dialysis machine and unobstructed by any visual display during use of the interface device401, and the screen410may display information411used in connection with monitoring and/or controlling the dialysis machine102and/or component thereof. Alternatively, for example, the screen405may include a symbol406that indicates an alert and is presented in a manner that does not obstruct a view through the interface device401. In other embodiments, different types of information sent to, or generated by, the interface device401may be displayed on either of the screens405,410and, when not in use, both of the sides may be transparent, for example.

In an embodiment, the interface device401may be communicationally paired with the dialysis machine102to provide that only the interface device401is wirelessly controlling the dialysis machine102. The interface device401may receive certain information wirelessly transmitted by the sensor140or the sensor140′, for example, in connection with pairing or authenticating the interface device401with the dialysis machine102, and/or in connection with acknowledging control signals sent by the interface device401to the dialysis machine102to control the display112thereof, as discussed herein. In an embodiment, the symbol406on the screen405may indicate a successful pairing of the interface device401with the dialysis machine102. In other embodiments, the screen405may also display identification information in connection with the symbol406to help ensure the HCP is matching the patient being treated with the proper dialysis machine information being viewed on the interface device401.

In an embodiment, the information411may be a screen similar to that being displayed on the display112of the dialysis machine102and/or may present other information in connection with the dialysis treatment and/or other functions performed by the HCP for monitoring and/or controlling the dialysis machine102, as further discussed in detail elsewhere herein. In various other embodiments, the information411displayed on the interface device401may include an alert when the an alarm of the dialysis machine102is triggered, an alert when a patient requests help (nurse call), and/or an alert when the dialysis machine102nears the end of the dialysis treatment. Other types of information may also be displayed including, for example, presenting to the HCP a schedule of patients expected for the dialysis machine102for the day and/or an alert when a patient does not arrive as expected. According to the system described herein, in a clinical or dialysis setting, while an HCP is performing other duties, including duties for other patients, remote from the dialysis machine102and dialysis treatment being monitored by the HCP, using the interface device401, the HCP may remotely monitor and control the dialysis treatment without having to physically contact the dialysis machine102and/or even without having to be physically present at the dialysis machine102.

In an embodiment, in connection with the information411displayed on the interface device401, the interface device401may receive information wirelessly transmitted by the sensor140or the sensor140′ and/or alternatively, may receive information wireless transmitted via the network120, for example, acting as conduit for information received from the sensor140, the sensor140′ and/or other component of the dialysis machine102that is then transmitted to the interface device401(see, e.g.,FIG. 2). The interface device401may include a transceiver device420that receives and/or transmits signals according to the functionality discussed herein. The transceiver device420may include one or more processors to process the signals in connection with the display of the information411and in connection with the transmission of instructions for remotely controlling the dialysis machine102. The transceiver device420may further include a memory, and/or other non-transitory computer-readable media, to store data in connection with the information transmitted and/or received by the interface device401and in connection with the execution of software or other executable code in connection with the operations of the interface device401.

For example, the interface device401may include a command recognition device430that recognizes and interprets commands in connection with operation of the interface device401, specifically in connection with selection, control and activation of elements on the screens405,410of the interface device401. In various embodiments, the commands may be gestures recognized and used by a gesture-recognition module of the command recognition device430in connection with the operation of the interface device401may include, for example, hand gestures, head gestures and/or eye gestures of the user. In other embodiments, the command recognition device430may include a voice recognition module that enables voice-based control of the interface device401. The command recognition capability thereby enables hands-free, non-contact operation of the interface device and remote control of the dialysis machine according to the system described herein. Multiple techniques and systems are known for providing non-contact command recognition capability, including gesture and/or voice based command recognition, and reference is made, for purposes of illustrative and descriptive example only, to U.S. Pat. No. 8,228,315 to Starner et al., entitled “Methods and Systems for a Virtual Input Device,” and U.S. Pat. No. 8,223,088 to Gomez et al., entitled “Multimode Input Field for a Head-Mounted Display,” which are incorporated herein by reference.

The interface device401may further include a camera440that may be used in connection with capturing images that may be displayed and/or used by the interface device401, as further discussed in detail elsewhere herein. In various embodiments, the camera440may also include video capabilities. It is noted that although the devices420,430and440are shown as separate devices, in other embodiments, the functionalities of these devices may be incorporate into one integral device disposed on the interface device401. Further, the interface device401may include a power source450, such as a battery.

The interface device401may further include an audio input/output device460that may include a speaker component and a microphone component. The audio device460may enable the user to hear audible signals that may be transmitted by the sensor40,140or140′. For example, warning or alarm sounds of the dialysis machine102may be transmitted to interface401that are heard by the user via the audio device460. In other embodiments the sensor40,140or140′ may also include a speaker and/or a microphone component, such that an intercom-type verbal exchange may be enabled between the user wearing the interface device401and a patient at the dialysis machine102. In various embodiments, the audio device460may also operate in connection with voice command recognition capability of the command recognition device430, as further discussed elsewhere herein. It is also noted that the processing of the interface device401may enable the interface device to recognize a verbal communication from the patient that is then converted into text and displayed on one or more of the screens405,410. In connection therewith, the processing of the interface device401may enable translation capabilities. For example, a patient may make a verbal communication at the dialysis machine102in one language (such as Spanish) and the verbal communication is transmitted as a signal via the sensor40,140or140′ to the interface device401, where the verbal communication is converted into text and then translated into another language (such as English) via processing capabilities of the interface device401and the translated text displayed on one or more of the screens405,410of the interface device401.

FIG. 6is a schematic illustration showing an embodiment of information500, like that discussed in connection with the information411, that may be displayed on the interface device401according to an embodiment of the system described herein. The illustrated embodiment of the information500is presented by way of example only, and other information, particularly other operational functions and features for controlling and/or monitoring a dialysis treatment, may be displayed and/or controlled in accordance with the system described herein. In the illustrated embodiment, the information500may include a treatment screen in the display112of the dialysis machine102that incorporates the methods and systems for monitoring and/or controlling functions of the dialysis machine102that are discussed herein. Other systems and interfaces may also be used for controlling a dialysis machine and/or other medical device, and reference is made, for example, to U.S. Pat. No. 6,775,577 to Crnkovich et al., entitled “Method and System for Controlling a Medical Device,” which is incorporated herein by reference.

Screen access buttons502(main access),504(trends),506(dialysate),508(test options),510(heparin),512(Kt/V),514(BTM), and516(blood pressure) may be used to access the various treatment screens in a manner that may be similar to that accessed at the display112, for example, via touch screen functionality of the display112. For example, as shown inFIG. 6, the main access button502has been activated using the interface device401, revealing a main treatment access screen501that may be displayed on the interface device401and on the display112of the dialysis machine. It is noted that, in other embodiments, different and/or summarized versions of the information displayed on the display112of the dialysis machine102may be displayed on the interface device401. A different treatment access screen may be displayed, for example, by pressing the different screen access buttons. The main treatment access screen501provides a general overview of the status of the current treatment. Other treatment screens may offer a more in-depth view of specific aspects of the current treatment, though some treatment screens may have some of the same information displayed as found on other treatment screens.

A status box518appears at the top left corner of the treatment screen being displayed in the information500. During normal operation it displays the operation mode of the machine, which in this case is “Dialysis.” During alarm situations, a warning message may be displayed in the status box518. The message displayed in the status box518may also prompt the operator for a specific action in situations when the treatment parameters are being set. During normal treatment, a box520displays the current time and the box522displays the time of the last blood pressure reading and the patient's blood pressure and pulse rate at that time. Arterial pressure in mmHg is displayed numerically in a meter box524, and graphically in a bar graph526. Similarly, venous pressure in mmHg is displayed numerically in a meter box528and graphically in a bar graph530, and transmembrane pressure (TMP) in mmHg is displayed numerically in a meter box532and graphically in a bar graph534.

A Tx clock button536may be activated start, or to pause or suspend, the treatment. The Tx clock button536controls multiple functions of the hemodialysis machine when it is activated. A UF-goal button538displays the desired ultrafiltration (UF) in milliliters to be removed during the dialysis treatment. This is typically the difference between the patient's pre and dry weight plus saline or fluid intake during treatment. The UF-time button540acts as a countdown timer displaying the remaining time in hours and minutes that ultrafiltration will be performed. The timer stops during a blood alarm or whenever the UF pump is stopped. During treatment, A UF-rate button542displays the current rate of ultrafiltration in milliliters per hour. The rate ultrafiltration occurs is determined by the values entered in a UF-goal button538and a UF-time button540and the profile selected with a UF-profile button546. A UF-removed button544keeps a running total in milliliters of the fluid drawn from the patient through ultrafiltration. When the value displayed in the UF-Removed button544is equal to the value entered in the UF-goal button538, an alarm sounds and the message, “UF GOAL REACHED” is displayed in the status box518. A UF-profile button546when touched brings up the UF Profile selection screen. Once a profile is selected, and the operator pushes the main access button502, the profile selected is displayed in the UF-profile button546.

A dialysate flow button548displays the current dialysate flow rate in milliliters per minute. A temperature button550displays the current temperature in degrees centigrade of the dialysate. Pressing the temperature button550allows the operator to set the desired temperature, and thereafter the actual temperature is displayed. If the temperature varies too far from the set point, an alarm sounds, a warning message is displayed in the status box518, and the dialysate goes into bypass. A conductivity button552displays the current conductivity in millisiemens per centimeter of the dialysate. An RTD (Remaining Time of Dialysis) button554acts as a countdown timer displaying the amount of treatment time remaining. At the end of treatment (RTD=0:00) an alarm sounds and the message “RTD ZERO” is displayed in the status box518. An SVS profile button556when touched brings up the Sodium Variation System (SVS) profile selection screen. Once a profile is selected, and the operator pushes the main access button502, the profile selected is displayed in the SVS profile button556.

In various embodiments, commands recognized by the interface device401, such as gesture and/or voice commands, may be used to control functionality of the treatment screen being displayed as information500on the interface device401. Accordingly, the mechanism of control of the treatment screen may deviate from control of the treatment screen that is being displayed on the display112of the dialysis machine102. For example, whereas the display112on the dialysis machine102is controlled by touch screen functionality, treatment screen displayed on the screen410of the interface device401may be controlled, for example, by the command-based recognition that may be used to iterate through and/or highlight different buttons of the information500for the treatment screen that is being displayed on the screen410. As discussed elsewhere herein, in other embodiments, the information500being displayed on the interface device401may present a treatment screen that is somewhat different from the treatment screen presented on the display112of the dialysis machine102in a manner that facilitates that command-based recognition control enabled by the interface device401.

FIG. 7is a schematic illustration600showing a gesture431by a user that may be used to control an interface device401′, that is like the interface device401and having similar components thereof but showing a different operational state, according to an embodiment of the system described herein. The screen410of the interface device401′ shows information411′ in which a section401ahas been activated by the gesture431, as recognized by the command recognition device430. The activated section401amay be a button, such as the main access button502(seeFIG. 6) that activates the providing of a main access treatment screen501to provide a general overview of the status of a current dialysis treatment being performed. The providing of the main access treatment screen501may be performed by the activation instruction of the button401abeing processed by the transceiver device420and wirelessly transmitted via a signal421to the sensor140of the dialysis machine and/or the sensor140′ either directly or via the network120(seeFIG. 2). Updated information concerning the result of the activated section401a, such as the information for the main access treatment screen501, may be wirelessly transmitted to the interface device401′ from the dialysis machine102, which is used by the transceiver device420to update the screen410with updated information.

FIG. 8is a schematic illustration showing an HCP650wearing the interface device401in connection with the monitoring and/or control of a dialysis treatment being performed in the patient care environment100(see, e.g.,FIG. 2). The interface device401enables the HCP650to remotely monitor and/or control the dialysis machine102during the dialysis treatment. Information is exchanged among the interface device401and the dialysis machine102in a manner as discussed elsewhere herein, and particularly including wireless signal transfers, shown schematically as signals421from the interface device401and signal141or signal141′ from the sensor140or the sensor140′, respectively. It is noted that the signals421,141and141′ are shown schematically and may also include the transfer of information via components of the network120. Using the interface device401, the HCP650may remotely receive alerts and/or other information during the dialysis treatment and may remotely control the dialysis machine102using, for example, gestures and/or voice in a manner that enables the HCP650to control, remotely from the patient care environment100, the dialysis machine102without being in a visual line-of-sight with the dialysis machine102, and, of course, without having to touch the dialysis machine102. The system described herein advantageously enables the HCP650to perform other duties while also monitoring and/or controlling the dialysis machine102.

FIG. 9is a schematic illustration of an interface device402′, similar to the interface device401, that is like the interface device401and having similar components thereof but showing a different functionality and/or operational state, in which the patient care environment100is being viewed by the HCP through the interface device401′ according to an embodiment of the system described herein. In connection with augmented reality capabilities of the interface device402, information412displayed on the interface device402may be shown in connection with the real time viewing of the patient care environment100. For example, the information412may display the station number of the dialysis machine102and/or may display patient information of the patient4, such as patient name, age and/or other patient information (e.g., birthdays, etc.). In other embodiments, the interface device402may be used to document real-time events in connection with treatment, such as emergencies and/or rare or abnormal alarm conditions.

FIG. 10is a schematic illustration of an interface device403, that is like the interface device401and having similar components thereof but showing a different functionality and/or operational state, in which an image700has been captured by the camera440of the interface device403and displayed on the screen410of the interface device403according to an embodiment of the system described herein. Information413concerning the image700may be displayed on the screen410of the interface device401. For example, the image700may be of items, supplies and/or medications, such as item701, and the interface device403may be used to document the items, supplies and/or medications. In other embodiments, the information413displayed on the interface device403may include alerts or warnings concerning the item701in the image700. In an embodiment, the item701may include a matrix or 2D bar code702(such as a Quick Response (QR) code) that may be captured by the camera440and processed by the interface device403.

FIG. 11is a flow diagram800showing processing steps in connection with receipt and display of information on an interface device, like that described herein, for example, in connection with the interface device401,401′,402or403, according to an embodiment of the system described herein. At a step802, the interface device receives a wireless signal, transmitted, for example, from a dialysis machine, like the dialysis machine22or102, that is performing a dialysis treatment on a patient. The interface device may be worn by a user, such as an HCP who is remotely monitoring the dialysis treatment. After the step802, processing proceeds to a step804where the wireless signal is processed by one or more components of the interface device. In an embodiment, the processing of the wireless signal may be in connection with information of the dialysis treatment, including treatments screens and/or other information of the dialysis treatment and/or the dialysis machine.

After the step804, processing proceeds to a step806where processed information from the wireless signal is displayed on a display of the dialysis device in connection with navigation of information displayed on the screens of the dialysis device. After the step806, processing is complete for the described processing iteration of the interface device and dialysis device. It is noted that the processing of the flow diagram800may be an on-going process in which the interface device repeatedly transmits wireless signals in response to user actions which are then repeatedly received by the dialysis machine. It is noted that the processing steps performed in the flow diagram800may be performed in connection with the execution of software on a non-transitory computer-readable medium of the interface device by one or more processors of the interface device. In an embodiment, the software may correspond to software that facilitates and/or otherwise interfaces with the dialysis machine in connection with the performance of the dialysis treatment, such as by providing one or more dialysis treatment screens.

FIG. 12is a flow diagram820showing processing steps in connection with command recognition and information transmission in connection with the use of an interface device, like that described herein, for example, in connection with the interface device401,401′,402or403, according to an embodiment of the system described herein. For example, in an embodiment, the processing of the flow diagram820may follow the processing of the flow diagram800. At a step822, one or more components of the interface device recognizes a input command by the user (HCP) who is wearing the interface device. In various embodiments, the input command may be a gesture and/or a voice command that is recognized by the one or more components of the interface device. After the step822, processing proceeds to a step824where the input command recognized by the interface device is processed in connection with the information being displayed on the display screen of the interface device.

After the step824, processing proceeds to a test step826where it is determined whether the input command corresponds to a control activation of one or more parts of the information being displayed on the interface device that requires transmission from the interface device. For example, the control activation may be in connection with a button being displayed on the interface device. If, at the test step826, it is determined that the input command is not a control activation command that requires transmission, then processing proceeds to a step828where the input command is performed at the interface device. For example, in various embodiments, the input command may correspond to scrolling through multiple screens of the information being displayed on the interface device and/or may correspond to the capturing of an image by a camera component of the interface device. After the step828, processing proceeds to a step834where updated information is displayed on the interface device.

If, at the test step826, it is determined that input command corresponds to a control activation command that involves transmission of a wireless signal from the interface device, then processing proceeds to a step830where the input command is wirelessly transmitted from the interface device. For example, the control activation command may involve activation of a button that controls the dialysis machine and/or dialysis treatment that is being performed and which is being remotely monitored by the HCP wearing the interface device. In such a case, the input command is being wirelessly transmitted to the dialysis machine to control the treatment, such as to adjust a parameter of the dialysis treatment and/or to stop the dialysis treatment, for example. After the step830, processing proceeds to a step832where the interface device receives a confirmation that the control activation command has been received and processed by the dialysis machine. The confirmation may be in the form of updated information transmitted to the interface device in processing like that discussed in connection with the flow diagram800. After the step832, processing proceeds to the step834, where updated information is displayed on the interface device. The updated information displayed on the interface device may indicate appropriate processing of the control activation command at the dialysis machine.

After the step834, processing is complete for the described processing iteration of the interface device. It is noted that the processing of the flow diagram820may be an on-going process in which the interface device continuously monitors for processes for receipt of input commands. It is noted that the processing steps performed in the flow diagram820may be performed in connection with the execution of software on a non-transitory computer-readable medium of the interface device by one or more processors of the interface device.

In an embodiment, the software may correspond to software that facilitates and/or otherwise interfaces with the dialysis machine in connection with the performance of the dialysis treatment, such as by providing one or more dialysis treatment screens.

FIG. 13is a flow diagram900showing processing in connection with wirelessly transmitting and/or receiving information from the dialysis machine in connection with the dialysis treatment according to an embodiment of the system described herein. In various embodiments, a sensor of the dialysis machine, like that of the sensor40,140or140′ discussed herein, may process wireless signals received and/or transmitted in connection with the operation of the dialysis machine and/or dialysis treatment. At a step902, information of a dialysis treatment being performed by the dialysis machine is wirelessly transmitted from the dialysis machine. In various embodiments, the wireless transmission may include direct broadcast from the sensor of the dialysis machine and/or may include use of one or more components of a network (see, e.g.,FIG. 2). After the step902, processing proceeds to test step904where it is determined whether a wireless signal has been received at the dialysis machine. For example, the wireless signal may be received from an interface device, like the interface device401,401′,402or403, in connection with processing like that discussed in connection with the flow diagram820. If no wireless signal has been received at the test step904, processing returns to the step902.

If, at the test step904, it is determined that a wireless signal has been received, then processing proceeds to a step906where the received wireless signal is processed. In various embodiments, the received wireless signal may be a control activation command received from an interface device, like that interface device401,401′,402or403, in connection with the remote control of the dialysis machine by a user (HCP) wearing the interface device. After the step906, processing proceeds to a step908where the dialysis machine, e.g., via the sensor40,140or140′, transmits a wireless signal that confirms receipt and processing of the received control activation command. For example, the received control activation command may have adjusted a parameter of the dialysis treatment being performed and the confirmation is updated information of the dialysis treatment that is transmitted to the interface device. The updated information may therefore correspond to a treatment screen of the dialysis treatment displayed on the dialysis machine.

After the step908, processing is complete for the described processing iteration of the interface device. It is noted that the processing of the flow diagram900may be an on-going process in which the dialysis continuously processes monitors for input commands and/or signals in connection with the system described herein. It is noted that the processing steps performed in the flow diagram900may be performed in connection with the execution of software on a non-transitory computer-readable medium of the dialysis machine by one or more processors of the dialysis machine, including, in particular, one or more processors of a sensor of the dialysis machine. In an embodiment, the software may correspond to software that facilitates and/or otherwise interfaces with an interface device specifically in connection with remote monitoring and/or control of the dialysis treatment, such as in connection with the providing of dialysis treatment screens. It is noted that the processing of the flow diagram900may be performed in conjunction with other processing of the dialysis machine, including for example, input of commands directly to the dialysis machine via a touch screen display, for example.

It is noted that the system described herein is discussed principally in connection with the use of dialysis machines and treatments. It is noted that, in other embodiments, the system described herein may also be used in connection with other medical devices where monitoring and/or control of such devices may be appropriately performed remotely. It is also noted that the system described herein may be used in connection and conjunction with the features and functions of a system like that described in US Publication No. 2014/0267003 A1 to Wang et al., entitled “Wireless Controller to Navigate and Activate Screens on a Medical Device,” which is assigned to the same assignee as that of the present application and which is incorporated herein by reference.

Various embodiments discussed herein may be combined with each other in appropriate combinations in connection with the system described herein. Additionally, in some instances, the order of steps in the flowcharts, flow diagrams and/or described flow processing may be modified, where appropriate. Further, various aspects of the system described herein may be implemented using software, hardware, a combination of software and hardware and/or other computer-implemented modules or devices having the described features and performing the described functions. Software implementations of the system described herein may include executable code that is stored in a computer-readable medium and executed by one or more processors. The computer-readable medium may include volatile memory and/or non-volatile memory, and may include, for example, a computer hard drive, ROM, RAM, flash memory, portable computer storage media such as a CD-ROM, a DVD-ROM, a flash drive and/or other drive with, for example, a universal serial bus (USB) interface, and/or any other appropriate tangible or non-transitory computer-readable medium or computer memory on which executable code may be stored and executed by a processor. The system described herein may be used in connection with any appropriate operating system.