Patent ID: 12232691

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS

A medical scope or endoscope as provided herein is a thin, elongated, flexible instrument that can be inserted into a body cavity for exploration, imaging, biopsy, or other clinical treatments, including catheters, narrow tubular instruments, or other types of scopes or probes. Endoscopes may be navigated into the body cavity (such as a patient's airway, gastrointestinal tract, oral or nasal cavity, or other cavities or openings) and be steered by the user via advancement of the distal end to a desired position and, in certain embodiments, biomimetic motion of the endoscope. Endoscopes may be tubular in shape.

Advancement of long, flexible medical devices into patient cavities is typically via force transferred from a proximal portion of the device (outside of the patient cavity), that results in advancement of the distal tip within the patient cavity. For example, a doctor or other caregiver holding a proximal portion (such as a handle) of the medical device outside of the patient cavity pushes downward or forward, and the resulting motion is transferred to the distal tip, causing the tip to move forward within the cavity. Similarly, a pulling force applied by the caregiver at the proximal portion may result in retreat of the distal tip or movement in an opposing direction out of the patient cavity. However, because patient cavities are not regularly shaped or sized, the endoscope moves through a tortuous path, and the transferred force in a pushing or pulling motion from the proximal end may not result in predictable motion at the distal tip. Further, navigation of the endoscope through a curved passage may involve multiple rotations or turns of the distal and, and it can be difficult for the user to keep track of the changed orientation of the distal tip during and after the navigation. Subsequently, the user may inadvertently bend or turn the endoscope in the wrong direction. For example, a user may intend to steer the endoscope to the user's right, but because the endoscope is rotated from its default position, the result of this command is for the endoscope to bend to the user's left. As a result, it can be difficult for the user to anticipate how the endoscope will respond to steering instructions during a medical procedure.

Provided herein is a graphic user interface (UI) for a steerable endoscope, with one or more graphical orientation indicators that indicate a current orientation or articulation of the endoscope. According to an embodiment, an endoscope system includes an endoscope with a steerable distal end and a camera, and a control wand with a display screen and user input (such as a touch screen). The display screen displays the view from the camera, along with graphical indicators that show how the endoscope has been turned or rotated, to help the user manipulate the endoscope during medical procedures.

An endoscope system100according to an embodiment is shown inFIGS.1-2. The system includes an endoscope12and a controller14with a display screen16. The endoscope12includes a steerable distal end24that carries a camera and an orientation sensor. The controller14is coupled to the endoscope12to provide power and/or control instructions to the steerable endoscope12and to receive data from the camera and the orientation sensor. In this embodiment, the controller14is implemented as a video laryngoscope.

A user interface (UI)18, e.g., a graphical UI (GUI), is presented on the display screen16. The UI18includes a view20from the endoscope (such as a video feed or still image from the endoscope camera), a touch screen interface, and three graphical orientation indicators30,32,34. The endoscope view20is presented in a circular shape, inside a circular outline22. In the example shown, the view is pointed at the user's vocal cords and trachea26.FIGS.2A-Einclude five different presentations of the UI18, in five views A, B, C, D, and E. This figure also shows the endoscope12connecting to the laryngoscope14, such as by connecting the proximal end of the endoscope12to a port on the back of the laryngoscope screen16. The opposite distal end24of the endoscope is inserted into the patient. The distal end24is actively steerable and includes a camera and an orientation sensor, as described below.

It should be understood that the disclosed techniques may support visualization and navigation of orientation for a blind steerable introducer, i.e., an elongated flexible instrument that does not include a camera or for which the camera is not activated.

The three orientation indicators30,32,34are shown in a close-up view of the UI18inFIG.1. The orientation indicator30is a roll indicator, which graphically depicts the current roll orientation of the distal end24of the endoscope12. In the embodiment ofFIG.1, the roll indicator30includes a horizon indicator represented by two markers30a,30bplaced 180 degrees apart on or near the circular outline22. The markers30a,30bare shown as small solid squares, but can be other shapes and sizes. For example, in another embodiment, the horizon indicator is a dashed line that is shown across the view20from marker30ato marker30b. When the markers30a,30bare horizontal on the screen, the distal end24is in its default or resting position, meaning it has not been actively steered to rotate.

The roll indicator30moves when the distal end24of the endoscope rotates within the patient cavity. This rolling movement is shown in views A and D ofFIG.2. In views A and D, the distal end24has rotated clockwise about 20 degrees compared to its default position. To indicate this rotation, the markers30a,30bhave been moved proportionately, about 20 degrees, around the image view20. Notably, inFIG.2, the image view20itself has not rotated. In this embodiment, the endoscope system includes an image correction or adjustment feature that counter-rotates the image to keep the image upright (with the posterior direction of the patient, toward the patient's chest, maintained in the “up” direction on the screen16), even when the endoscope is actively steered and rotated. This type of image adjustment can be accomplished by counter-rotating the image proportionately based on an amount of rotation detected by the orientation sensor at the distal end of the endoscope, as more fully described in Applicant's U.S. Provisional App. No. 62/812,678, filed Mar. 1, 2019, and U.S. patent application Ser. No. 16/802,242, published as U.S. Patent Publication No. 20200275824, the entire contents of which are hereby incorporated by reference.

Referring again to the views ofFIG.2, the user can actively steer the endoscope, such as rotating the distal end24, while the image is kept stable in the image view20. In this case, the user could lose track of the steering inputs that have been given to the endoscope, and could have difficulty remembering how the endoscope is currently rotated or positioned within the patient cavity. The roll indicator30provides the user with a visible graphic representation of the current rotational orientation of the endoscope, so that the user can easily keep track of that orientation.

InFIGS.1and2A-E, the roll indicator30also includes a working channel indicator30W. The working channel indicator is a shown as a transparent shaded region overlaid onto the image20. This indicator shows the rotational location of a working channel on the endoscope12. A working channel can be an open lumen formed longitudinally in the endoscope to allow for the passage of tools or fluids, such as biopsy tools, atomizing catheters, saline, and fluids to be evacuated from the body. The working channel may be formed off-set from the center axis of the endoscope, in which case it will move rotationally when the endoscope is rotated. The indicator30W visually represents on the UI18where the working channel is currently located, so that the user can anticipate where a tool, fluid, or other instrument will enter the image20when it emerges from the working channel. If the working channel is not aligned with the anatomical area that it needs to access (for a particular clinical procedure), the user can steer the endoscope to move the working channel into the desired position.

A second orientation indicator32is a pitch/yaw indicator, which indicates the amount and direction that the endoscope has been curved, bent, or turned. In the embodiment shown, the pitch/yaw indicator32is depicted by bracket lines32a,32b,32c, and32dformed around the outline22of the image20. When the endoscope is turned left or right (yaw) or up or down (pitch), the bracket lines grow and shrink, as shown inFIG.2in views B, C, D, and E. In view B, the distal end24has been turned to the right, and the brackets32aand32dhave grown bigger, while brackets32band32chave been made smaller, to show that the endoscope has turned to the right. The lines that grew (32a,32d) also have arrows on the end in the direction that the endoscope turned. In view B, the endoscope has turned to the right part of the way through its range of motion. In view C, the endoscope has turned all the way to the limit of its range of motion, and thus the lines32a,32dhave come all the way around the image view20, and lines32b,32care removed entirely or shown only as small dashed lines or markers. With these changes, the yaw/pitch indicator32shows the user which direction the endoscope has turned, and how far within its range of motion. The user can then appreciate, by viewing the UI18, how the endoscope is turned or bent, and how much further it can still turn from there.

Pitch is indicated in view E ofFIG.2. In this view, lines32c,32don the bottom side of the image view20have grown, and lines32a,32bon the top have shrunk, so that the lines show the user that the endoscope is bent upward. The lines32c,32dhave arrows pointing upward in that same direction, toward the top of the screen, to further reiterate the direction that the endoscope is turned.

A third orientation indicator34is a graphical representation of the distal end24of the endoscope12. For example, this indicator34can be a cartoon graphic or icon representing an endoscope tip end. As shown in views A-E ofFIG.2, the icon curves and turns in coordination with the distal end24of the endoscope. This indicator34provides another way to visually represent on the screen16the current orientation of the endoscope.

Views A, B, C, D, and E inFIG.2show the UI18in various states based on active movement of the endoscope12. In view A, the endoscope has been rotated about 20 degrees clockwise, as shown by the clockwise rotation of the roll indicator30(markers30a,30b, and working channel indicator30W). In view B, the endoscope is rolled back to neutral, and turns partway to the right, as shown by the indicators32(the bracket lines) and34(the tip icon). The thumb-prints in view B show an example of a user input to steer the endoscope to turn it to the right; in this case, the user taps or drags/swipes a thumb to the right to instruct the endoscope to bend to the right. In view C, the user taps or drags/swipes further to the right (as shown by the thumbprints), to instruct the endoscope to continue to bend to the right. In this example, in view C the endoscope reaches the limit of its range of motion to the right. In view D, the endoscope is rolled to the right (clockwise). In an embodiment, rotational movement of the endoscope is accomplished by the user manually twisting the endoscope. In view E, the endoscope pitches upward, based on a user input to move the view upward (such as moving the thumb up as shown by the thumbprints in view E). Although these views are shown as snapshots, the indicators30,32,34are dynamic and change in real-time along with the position of the distal end24. The indicators may be moved between discrete configurations, or may continually change shapes, colors, or forms, or may be animated.

Orientation indicators may be presented within the clinical view from the endoscope camera, outside of the clinical view on the display screen, or overlapping both the clinical view and other areas of the screen. Another endoscope system300according to an embodiment is shown inFIGS.3A-D. In this embodiment shown inFIG.3D, an endoscope312connects to a video laryngoscope314with a display screen316. A graphical user interface (UI)318is presented on the display screen. The UI318includes two orientation indicators330,336. The first orientation indicator330includes a roll indicator, which indicates a rotational position of the distal end324of the endoscope312. The roll indicator includes two triangular horizon indicators330a,330band a working channel indicator330W. In this embodiment, the working channel indicator330W overlaps the circular outline322of the camera view320, crossing over the circular outline. The working channel indicator330W is shown as two lines approximately perpendicular to the circular outline, partially internal and partially external to the circular camera view320. The indicators330a,330b,330W move around the circle322in synchrony with the orientation of the distal end324of the endoscope312. For example, in view A ofFIG.3, the endoscope has been rotated about 45 degrees clockwise, and the indicators330a,330b, and330W have been rotated around the circle a corresponding amount.

A second graphical indicator336includes a gravity indicator, which indicates the orientation of the distal tip324relative to gravity. The gravity indicator can be presented in various styles or shapes. In this embodiment, it is shown as a pin or marker with a tip pointed down toward the bottom of the screen316. The pin is inside a circle with a line or plane that indicates a level horizon. The view of this pin changes when the endoscope tip pitches up or down. As shown in view C inFIG.3, the gravity marker tilts to indicate that the endoscope tip324has pitched up. When the tip324pitches up, the plane of the pin also tilts up. When the endoscope is neutral (not pitched up or down), the gravity indicator is level, as shown in views A and B.

The UI318also includes a status indicator or icon340, above the camera view320. In the embodiment shown, the status indicator340is a lung icon. This area of the UI may be used to indicate what type of procedure is being performed, or other types of status information, such as a distance from the vocal cords or distance from user-defined waypoints. The UI embodiments disclosed herein may be displayed on a controller that is in communication with the endoscope. The controller may be a hand-held device with a screen, such as a video laryngoscope, a wand, puck, tablet, or other type of display screen.FIGS.4-5show an embodiment in which the controller is implemented as a hand-held wand. An endoscope system400includes an endoscope412connected to a hand-held wand413with a display screen416. A UI418is presented on the screen416. In this embodiment, the UI418includes a roll indicator430(including two horizon markers430a,430bspaced 180 degrees apart, a dashed horizon line between them, and a working channel indicator430W). As shown in view A ofFIG.5, the roll indicator430rotates on the UI418to indicate the degree and direction of rotation of the distal end424of the endoscope412. As discussed above, when the endoscope rotates, in an embodiment, the view from the endoscope camera is adjusted on the screen416, to keep the direction of gravity pointed down toward the bottom of the screen416. Thus, in view A, the roll indicator430rotates but the image420does not.

The UI418also includes a pitch/yaw indicator432, in this case implemented as a crosshairs or bubble440. The bubble440shows the direction of yaw (left or right) or pitch (up or down) movement of the endoscope412. In view B, the user steers the endoscope to the right (as indicated by the thumb prints tapping to the right on the touch screen), and the bubble440also moves to the right within the camera viewing window420on the screen. In view C, the user steers the endoscope to pitch up, and the bubble440moves up. In an embodiment, distance that the bubble440moves within the window420corresponds to the amount that the endoscope has turned. In an embodiment, the bubble440reaches the circular outline422when the endoscope reaches its limit of motion. This is depicted in view D ofFIG.5, where the endoscope has pitched up (bent upward) as far as it can go, and the bubble440comes into contact with the top edge of the circle422. In an embodiment, the UI418also provides an additional limit indicator, such as rays442, when a limit of motion of the endoscope is reached. The rays442appear around the circle view420when the endoscope reaches its limit of motion, and then the rays442disappear when the endoscope moves back in the other direction, away from the respective limit. The controller414may also provide a haptic response when a limit of motion is reached, such as providing a short pulse, buzz, or vibration from a haptic generator. The haptic feedback may be proportional to the size of the signal, with a larger feedback associated with movements at or past a range of motion of the endoscope.

As shown inFIGS.4-5, the UI418also includes a gravity indicator436, which indicates the direction of gravity relative to the endoscope orientation. When the endoscope is level with gravity (not pitched up or down), the gravity indicator436shows a level line below the pointed pin. When the endoscope tip pitches up (as in view C), the gravity indicator also pitches, so that the view moves up over the pointed pin. When the endoscope tip reaches its upward limit of motion (as in view D), the gravity indicator has moved all the way to the top, above the pointed pin, to indicate that the direction of gravity is directly below the view420from the endoscope. This is just one way to indicate the direction of gravity relative to the tip, and other gravity indicators may be used.

InFIGS.4-5, the controller is a hand-held wand413, rather than a video laryngoscope (shown in other figures). The endoscope412connects directly to the wand413, such as by plugging the proximal end of the endoscope412into a port415on the wand413, for passage of control signals from the wand to the endoscope and video signals from the endoscope to the wand. In an embodiment, the endoscope412is removable from the wand413. The endoscope412may be single-use only and discarded (or recycled) after use, and the controller (such as wand413) may be re-usable. In other embodiments the controller may have other forms or structures. For example, the controller may be a video laryngoscope, table-top display screen, tablet, laptop, puck, or other form factor. The controller with the endoscope operates as a two-part endoscope, where the controller serves as the handle, display, and user input for the endoscope. In an embodiment, the controller is reusable and the endoscope is single-use and disposable, to prevent cross-contamination between patients or caregivers. The controller itself does not need to come into contact with the patient, and it can be wiped and cleaned and ready to use for the next patient, with a new sterile endoscope.

An embodiment in which the controller is implemented as a video laryngoscope is shown inFIGS.6-7. In this embodiment, two image views are displayed on the display screen at the same time, one from a camera of the video laryngoscope, and one from a camera of the endoscope. As shown in the figures, an endoscope system600includes an endoscope612connected to a video laryngoscope614with a display screen616. The display screen presents a UI618, which displays a first view644from the video laryngoscope camera and a second view620from the endoscope camera. These two image views are displayed at the same time on the UI, such as with one image overlapping the other. In an embodiment, the video laryngoscope image644is shown within a first outline shape (such as a rectangular corner or outline), and the endoscope image620is shown within a second different outline shape (such as a circular corner or outline622), to help differentiate the two images. InFIG.6, the distal end624of the endoscope612is visible in the first image view644from the video laryngoscope camera.

The UI618includes a roll indicator630, and a pitch/yaw indicator632. The roll indicator630may be located on the circle622to correspond to the location of a working channel of the endoscope. As shown in views A, B, C, and D ofFIG.7, the roll indicator630rotates to indicate roll of the distal end624, and the pitch/yaw indicator lines632move around the outline622to indicate left/right yaw or up/down pitch of the distal end624. In view A, the user uses the right hand to twist or rotate the endoscope to the left (counter-clockwise), and the roll indicator630moves a corresponding amount along the circle622. The user can see the movement of the distal end624within the video laryngoscope image644. In view B, the user instructs the endoscope to yaw to the left, such as by tapping with the thumb of the left hand in the left direction on the screen616. The yaw/pitch indicator lines632move around the circle toward the left, to indicate the change in position of the endoscope. The video laryngoscope image644shows the distal end624curved to the left. In view C, the user instructs the endoscope to pitch upward, such as by tapping up on the screen. The yaw/pitch indicator lines632move up a corresponding amount, and the video laryngoscope image644shows the distal end624curved upward. In view D, the user advances the endoscope through the patient's vocal cords and into the trachea626, and instructs the endoscope to pitch down, as indicated by the thumb taps on the screen and the yaw/pitch indicator632. The endoscope image620now shows a view of the tracheal walls of the patient.

In an example use case, the endoscope system600is used to intubate a patient. With one hand (such as the left hand), the user holds the video laryngoscope614and taps on the screen616to steer the endoscope612, and with the other hand (such as the right hand), the user pushes the endoscope612forward into the patient cavity. When the endoscope is in place (for an intubation, the endoscope is passed through the patient's vocal cords into the trachea, as shown in view D), the proximal end of the endoscope612is disconnected from the laryngoscope614and an endotracheal tube is passed over the endoscope. Once the proximal end emerges from the endotracheal tube, the endoscope612can be reconnected to the laryngoscope614. The endotracheal tube is then passed along the endoscope into the trachea, and then the endoscope612can be withdrawn from the patient, retracting it back through the tube and leaving the endotracheal tube in place.

The endoscope includes one or more steerable segments at the distal end, to actively bend, turn, or curve the distal end of the endoscope. In an embodiment, the steerable segment can bend and curve in three dimensions (not just in a single plane, such as up/down or right/left), curving to point in all directions, up to a limit of its range of motion. For example, in an embodiment each segment can bend up to 90 degrees in any direction, enabling it to move within a hemisphere having a radius equal to the segment's length. Each segment is manipulated by its own actuation system, including one or more actuators (such as sleeved pull-wires or other actuators described below), which moves to bend or un-bend the segment into or out of a curved shape. In an embodiment, the endoscope includes two steerable segments at the distal end of the endoscope. The two steerable segments are coupled to each other, and each segment can articulate independently of the other segment.

Each articulating segment at the distal end of the endoscope is manipulated by a steering system, which operates an actuator that is coupled to the segment to bend or straighten the segment. The steering system may include one or more memory metal components (e.g., memory wire, Nitinol wire) that changes shape based on electrical input, a piezoelectric actuators (such as the SQUIGGLE motor from New Scale Technologies, Victor NY), a retractable sheath (retractable to release a pre-formed curved component such as spring steel which regains its curved shape when released from the sheath), mechanical control wires (pull wires), hydraulic actuators, servo motors, or other means for bending, rotating, or turning the distal end or components at the distal end of the endoscope.

In an embodiment, the camera is located at the distal end or terminus of the distal-most segment of the endoscope, to provide the camera with a clear forward view into the patient anatomy. In an embodiment, the orientation sensor is also located at the distal end, just proximally of the camera. In an embodiment, the orientation sensor is adjacent the camera. In an embodiment, the orientation sensor is mounted on a flex circuit behind the camera. In an embodiment, the orientation sensor is mounted on the same flex circuit as the camera, though the orientation sensor and the camera need not be in communication on the shared flex circuit. In an embodiment, the orientation sensor has a size of between 1-2 mm in each dimension.

The orientation sensor is an electronic component that senses the orientation (such as orientation relative to gravity) and/or movement (acceleration) of the distal end of the endoscope. The orientation sensor contains a sensor or a combination of sensors to accomplish this, such as accelerometers, magnetometers, and gyroscopes. The orientation sensor may be an inertial measurement unit (IMU). The orientation sensor detects static orientation and dynamic movement of the distal tip of the endoscope and provides a signal indicating a change in the endoscope's orientation and/or a motion of the endoscope. The orientation sensor sends this signal to the controller. The orientation sensor is located inside the tubular housing of the endoscope. In an embodiment, the orientation sensor is located very close to the terminus of the distal end of the endoscope, such as behind the camera, to enable the orientation sensor to capture much of the full range of movement of the distal tip and camera. In an embodiment, the orientation sensor is placed at a distal end of the first steerable portion, remote from the proximal end of the steerable portion, to place the orientation sensor away from the fulcrum of movement.

A block diagram of an endoscope system800is shown inFIG.8, including an endoscope812and a controller814. The connection between them may be wired (in which case they each have an electrical connector) or wireless (in which case they each include a wireless transceiver). The endoscope812includes a camera and an orientation sensor at the distal end of the endoscope. The orientation sensor may be an inertial measurement unit (IMU), accelerometer, gyroscope, or other suitable sensor. The endoscope812also includes a light source and an actuator that is coupled to the distal steerable segments, to bend or un-bend them, as described herein.

The controller814includes a processor or chip (such as a chip, a processing chip, a processing board, a chipset, a microprocessor, or similar devices), a hardware memory, a display screen (such as a touch screen), and a steering control system, which may include a motor or other driver for operating the actuator. The controller814may also include some other type of user input (buttons, switches), and a power source (such as an on-board removable and/or rechargeable battery).

The controller814may also include a power source (e.g., an integral or removable battery) that provides power to one or more components of the endoscope as well as communications circuitry to facilitate wired or wireless communication with other devices. In one embodiment, the communications circuitry may include a transceiver that facilitates handshake communications with remote medical devices or full-screen monitors. The communications circuitry may provide the received images to additional monitors in real time.

The processor may include one or more application specific integrated circuits (ASICs), one or more general purpose processors, one or more controllers, FPGA, GPU, TPU, one or more programmable circuits, or any combination thereof. For example, the processor may also include or refer to control circuitry for the display screen. The memory may include volatile memory, such as random access memory (RAM), and/or non-volatile memory, such as read-only memory (ROM). The image data may be stored in the memory, and/or may be directly provided to the processor. Further, the image data for each patient procedure may be stored and collected for later review. The memory may include stored instructions, code, logic, and/or algorithms that may be read and executed by the processor to perform the techniques disclosed herein.

A method900for operating a UI for an endoscope system is shown in the flowchart ofFIG.9. The method includes displaying a view from an endoscope and a graphical orientation indicator, at901. In an embodiment, the endoscope includes a steerable distal end with a camera, and the display is provided on a touch screen display. The method also includes receiving, via the touch screen display, a user input to steer the distal end of the endoscope, at902. In response to the user input, the method includes steering the endoscope to a changed orientation of the distal end, at903. The method includes modifying the graphical orientation indicator to visually represent the changed orientation of the distal end, at904. In an embodiment, the graphical orientation indicator includes one or more of a roll, pitch, or yaw markers, and modifying it includes moving the markers around or along the camera view to represent the changed orientation of the distal end of the endoscope.

In an embodiment, the UI is implemented on a touch screen that is responsive to taps, touches, or proximity gestures from the user. The UI detects the user's touch and sends this touch input to a processor which generates instructions to operate the steering system to bend, turn, or move the endoscope. For example, the user may enter a touch gesture (such as a tap, double-tap, tap-and-hold, slide, or swipe) to identify a target point or direction within the image on the screen. This gesture identifies where the user desires to steer the endoscope, and the controller translates this into a real-world steering direction and corresponding instructions for operating the steering system to move the distal steerable segment of the endoscope in that direction. The user may swipe in a desired direction on the touch screen to reorient the distal end of the endoscope. A desired orientation or movement of the camera may be interpreted from the direction and length of the swipe movement on the touch screen. In one example, the direction of movement of the distal end of the endoscope is the same as the direction of the movement of user input. A swipe or slide to the right steers the endoscope to the right, bringing anatomical areas towards the right into view as the endoscope camera is steered right. Accordingly, in such an embodiment, left swipes steer left, upward swipes steer up, and downward swipes steer down. In another example, the direction of movement of the distal end of the endoscope is opposite the direction of the movement of user input. The steering operates in a manner similar to map or digital paper steering, and a swipe or slide to the right drags the entire image to the right and brings anatomical areas on the left into view as the endoscope camera is steered left. In this embodiment, left swipes steer right, upward swipes steer down, and downward swipes steer up.

In an embodiment, the steering input may additionally or alternatively be provided via user selection from a menu, selection of soft keys, pressing of buttons, operating of a joystick, etc. In an embodiment, the user holds the controller with a left hand and touches the screen with a thumb of the left hand, leaving the right hand free to hold, twist, and advance the endoscope. The user can steer the endoscope camera by tapping the screen with his or her thumb, and then can advance the endoscope by pushing it forward (or pulling back) with his or her right hand.

The steering response to the user input can correlate steering speed of the distal end of the endoscope to a speed of the user input. Thus, fast swiping motions result in faster movement of the distal end of the endoscope relative to slower swiping motions. A user can steer by selecting (tapping, swiping to) a portion of the displayed view from the endoscope as the steering destination. The steering speed towards the selection is correlated to the distance of the selected portion of the image from the distal end of the endoscope. For example, steering to a farther point, relative to the distal end, results in faster steering as compared to steering to a closer point.

While the present techniques are discussed in the context of endotracheal intubation, it should be understood that the disclosed techniques may also be useful in other types of airway management or clinical procedures. For example, the disclosed techniques may be used in conjunction with placement of other devices within the airway, secretion removal from an airway, arthroscopic surgery, bronchial visualization past the vocal cords (bronchoscopy), tube exchange, lung biopsy, nasal or nasotracheal intubation, etc. In certain embodiments, the disclosed visualization instruments may be used for visualization of anatomy (such as the pharynx, larynx, trachea, bronchial tubes, stomach, esophagus, upper and lower airway, ear-nose-throat, vocal cords), or biopsy of tumors, masses or tissues. The disclosed visualization instruments may also be used for or in conjunction with suctioning, drug delivery, ablation, or other treatments of visualized tissue and may also be used in conjunction with endoscopes, bougies, introducers, scopes, or probes.

The description and figures show a variety of icons, graphical indicators, lines, outlines, shading, markers, and visual indicators to represent a status or position of the endoscope. These different types of graphical indicators can be mixed and matched into various combinations, groups, and patterns. A shading or line pattern shown in connection with one indicator can be used with a different indicator, and so forth. Various combinations can be made to provide a desired indicator or animation.

While the disclosure may be susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and have been described in detail herein. However, it should be understood that the embodiments provided herein are not intended to be limited to the particular forms disclosed. Rather, the various embodiments may cover all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure as defined by the following appended claims.