Patent ID: 12186119

While examples of the disclosure are amenable to various modifications and alternate forms, specific examples have been shown by way of example in the drawings and are described in detail below. The intention is not to limit the scope of the disclosure to the particular examples described. On the contrary, the disclosure is intended to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure and the appended claims.

DETAILED DESCRIPTION

Various aspects of the disclosure are described more fully below, with reference to the accompanying drawings, which show specific example aspects. However, different aspects of the disclosure may be implemented in many different forms and should not be construed as limited to the aspects described herein; rather, these aspects are provided so that this disclosure will be thorough and complete and will fully convey the scope of the aspects to those skilled in the art. Aspects may be practiced as methods, systems, or devices. The following detailed description is, therefore, not to be interpreted in a limiting sense.

Breast cancer is one of the leading causes of cancer-related mortality of women. Abnormalities may be identified in the breast tissue by implementing one or more imaging techniques such as breast CT, breast tomosynthesis, and digital mammography. The imaging techniques are employed by emitting x-ray radiation from a source and detecting the radiation at a detector. A breast that is being imaged is placed between the source and the detector, and is typically compressed or immobilized therebetween. Placement and orientation of the source and detector relative to the breast may be adjusted. For example, different relative angles of radiation emitted through the breast may provide different view angles to view and/or assess an abnormality in the breast. The image types (otherwise referred to as image views) are based on the relative position and orientation of the source and detectors relative to the breast. Examples of image types include craniocaudal (CC), mediolateral oblique (MLO), mediolateral (ML), exaggerated craniocaudal lateral (XCCL), exaggerated craniocaudal medial (XCCM), cleavage view or “valley view” (CV), lateromedial (LM), tangential (TAN), caudocranial from below (FB), axillary tail (AT), lateromedial oblique (LMO), superoinferior oblique (SIO), inferomedial superolateral oblique (ISO), specimen, among others. Image types may be associated with one or more imaging modalities, such as conventional mammography, tomosynthesis, HD tomosynthesis, mammography/synthesis combination, HD combination, 2D contrast-enhanced, 2D contrast-enhanced combination, biopsy, quality control, etc.

Desired imaging type(s) are selected by a medical professional such as a technologist prior to imaging a breast with a medical imaging system. Traditionally, imaging type(s) are selected from a list of all available imaging types for a specific imaging modality. The list of image types may be provided as a list of images showing a breast relative to components of an imaging system (e.g., source and/or detector). This approach, however, requires the medical professional to scan through a list of options and navigate through different tabs on an interface. Additionally, by looking through a list of options, the medical professional needs to compare each list option with the configuration of the medical imaging system. Thus, the list format burdens the medical professional.

Accordingly, the present disclosure provides systems and methods for displaying, identifying, and selecting an image type for a medical imaging system. In an example, the present technology provides a user interface. The user interface includes a visual representation of a breast and a visual representation of a medical imaging system. The visual representation of the medical imaging system includes a visual representation of one or more of a detector, a source, and a compression paddle. The visual representation of the medical imaging system may be rotatable and positionable relative to the visual representation of the breast. Based on the relative position and orientation of the visual representation of the medical imaging system relative to the visual representation of the breast, an image type is determined. The image type may be displayed at the user interface. While the present disclosure is directed to breast imaging, the concepts and functions described herein are also applicable to imaging of other body parts (e.g., the abdomen, appendages such as arms and feet, etc.). Certain body parts, such as limbs, are more amenable to rotation thereof relative to a static imaging system. The systems and methods described herein that depict rotation of an imaging system relative to a static breast are equally applicable to rotation of a body part relative to a static imaging system; necessary or desirable modifications thereof would be apparent to a person of skill in the art upon reading this disclosure.

FIGS.1A-1Bshow different views of an example imaging system100.FIG.1Adepicts a schematic view of the example imaging system100andFIG.1Bdepicts a perspective view of the example imaging system100. The descriptions provided herein may be applied to either an upright (shown) or prone (not shown) imaging system100. For simplicity, the following discussion includes examples for use with an upright breast tomosynthesis imaging system (such as the Dimensions Breast Tomosynthesis imaging system provided by Hologic, Inc.).

The imaging system100immobilizes a patient's breast102for x-ray imaging (either or both of mammography and tomosynthesis) via a breast compression immobilizer unit104that includes a static breast support platform106and a foam compressive element108. Different paddles, each having different purposes, are known in the art. Certain examples paddles are also described herein for context. The breast support platform106and the foam compressive element108each have a compression surface110and112, respectively, that move towards each other to compress, immobilize, stabilize, or otherwise hold and secure the breast102during imaging procedures. In known systems, the compression surface110,112is exposed so as to directly contact the breast102. Compression surface110may be a rigid plastic, a flexible plastic, a resilient foam, a mesh or screen, and so on. Compression surface112is a lower surface of the foam compressive element108. The platform106also houses an image receptor116and, optionally, a tilting mechanism118, and optionally an anti-scatter grid (not depicted, but disposed above the image receptor116). The immobilizer unit104(otherwise referred to herein as the compression system104) is in a path of an imaging beam120emanating from x-ray source122, such that the imaging beam120impinges on the image receptor116.

The immobilizer unit104is supported on a first support arm124via a compression arm134, which is configured to be raised and lowered along the support arm124. The x-ray source122is supported on a second support arm, also referred to as a tube head126. For mammography, support arms124,126can rotate as a unit about an axis128between different imaging orientations such as craniocaudal (CC) and mediolateral oblique (MLO), so that the imaging system100can take a mammogram projection image at each orientation. (The terms front, lower, and upper pertain to using a CC imaging orientation, with the patient facing the front of the imaging system, although it should be understood that other imaging orientations, including MLO, are used with the same equipment.) In operation, the image receptor116remains in place relative to the platform106while an image is taken. The immobilizer unit104releases the breast102for movement of arms124,126to a different imaging orientation. For tomosynthesis, the support arm124stays in place, with the breast102immobilized and remaining in place, while at least the second support arm126rotates the x-ray source122relative to the immobilizer unit104and the compressed breast102about the axis128. The imaging system100takes plural tomosynthesis projection images of the breast102at respective angles of the imaging beam120relative to the breast102.

Concurrently and optionally, the image receptor116may be tilted relative to the breast support platform106and in sync with the rotation of the second support arm126. The tilting can be through the same angle as the rotation of the x-ray source122but may also be through a different angle selected such that the imaging beam120remains substantially in the same position on the image receptor116for each of the plural images. The tilting can be about an axis130, which can but need not be in the image plane of the image receptor116. The tilting mechanism118that is coupled to the image receptor116can drive the image receptor116in a tilting motion. For tomosynthesis imaging and/or CT imaging, the breast support platform106can be horizontal or can be at an angle to the horizontal, e.g., at an orientation similar to that for conventional MLO imaging in mammography. The imaging system100can be solely a mammography system, a CT system, or solely a tomosynthesis system, or a “combo” system that can perform multiple forms of imaging. An example of such a combo system has been offered by the assignee hereof under the trade name Selenia Dimensions.

When the system is operated, the image receptor116produces imaging information in response to illumination by the imaging beam120and supplies it to an image processor132for processing and generating breast x-ray images. A system control and workstation unit138including software controls the operation of the system and interacts with the operator to receive commands and deliver information including processed-ray images.

The imaging system100includes a floor mount or base140for supporting the imaging system100on a floor. A gantry142extends upwards from the base140and rotatably supports both the tube head208and a support arm210. The tube head126and support arm124are configured to rotate discretely from each other and may also be raised and lowered along a face144of the gantry142so as to accommodate patients of different heights. The x-ray source122is disposed within the tube head208. Together, the tube head126and support arm124may be referred to as a C-arm124.

A number of interfaces and display screens are disposed on the imaging system100. Additionally or alternatively, a number of interfaces and display screens are disposed at the workstation unit138, which may be located outside of a room of other components of the imaging system100. These include a foot display screen146, a gantry interface148, a support arm interface150, and a compression arm interface152. In general, the various interfaces148,150, and152may include one or more tactile buttons, knobs, switches, as well as one or more display screens, including capacitive touch screens with graphical user interfaces (GUIs) so as to enable user interaction with and control of the imaging system100. In general, the foot display screen146is primarily a display screen, though a capacitive touch screen might be utilized if required or desired.

FIG.2depicts a configuration of a user interface200for selecting an image type for a medical imaging system. The user interface200includes a set of image types202, a set of image modalities204, and imaging plan elements206. The set of image types202includes a list of selectable image types on each tab for the set of image modalities204. As shown, the “Conventional” modality tab is selected and shows a set of image types202organized by left and right breast imaging. Each tab for the set of image modalities204may include a different set of image types202associated with the selected tab. The imaging plan elements206include an “Add” element and a “Clear” element to add or remove one or more image types to a list. In an example, a medical professional using the user interface200may add one or more image types into a plan prior to imaging a breast. The image types may all be added to the plan before position the breast or after positioning the breast, or one or more image types may be added after positioning the breast for each image type.

FIG.3depicts an example user interface300for a medical imaging system. The user interface300includes a visual representation of a breast302and a visual representation of a medical imaging system304. The visual representation of the breast302may be two-dimensional or three-dimensional. Additionally, the visual representation of the breast302may rotate along an axis disposed substantially parallel to the user interface300(or of the screen on which the user interface is displayed). For example, the visual representation of the breast302may swivel or pivot about an axis representing a position of a spine of a patient. The visual representation of the breast302may change in shape to deform based on the relative position and orientation of the visual representation of the medical imaging system304. For example, the visual representation of the breast302may deform to mimic deformation of breast tissue under compression by the imaging system. The visual representation of the breast302may include visual representations of one or two breasts. An example that might be more intuitive for a technologist, however, includes a visual representation of both breasts302of the patient, as depicted inFIG.3. This representation of both breasts302may remain fixed in a position that is consistent with the patient standing or sitting at an imaging system, e.g., the representation of both breasts302does not rotate. By not rotating, this provides the technologist with a consistent frame of reference.

The visual representation of the medical imaging system304includes a visual representation of a detector308and a visual representation of one or more of a source306or a compression paddle306of the imaging system. InFIG.3, a paddle306is depicted. In this regard, the representation of both the detector308and the paddle306is again intuitive for a technologist, since the breast contacts the paddle and detector (or support platform under which the detector is located) during imaging. Regardless, as further described herein, a specific source306may additionally or alternatively be visually represented. As further described herein, the visual representation of the medical imaging system304may be rotatable and positionable relative to the visual representation of the breast302. This may be the most intuitive configuration for a technologist, since during most breast imaging procedures, the patient remains upright while the detector, source, and compression system of the imaging system rotate. The visual representation of a detector308and the visual representation of the source or paddle306may be fixed relative to each other or, alternatively, may be independently moved (e.g, towards or away from each other) or rotated. To rotate the visual representation of the medical imaging system304, a rotation element310may be selected. Although one rotation element310is shown, multiple rotation elements may be appreciated (e.g., one for the visual representation of a detector308and one for the visual representation of the source or paddle306and/or one for the visual representation of the breast302). Interaction with the rotation element310at the user interface300(e.g., a click, a click and drag, etc.) may result in rotation of the associated visually represented element. Rotation may be stepwise or may be based on an amount of drag or time with which the rotation element310is interacted. Rotation of a visually represented element may be about a center of the element or a predefined point on an element. Rotation may also be about a point predefined by an approximate midway point between the detector308and the source or paddle306. Rotation may be clockwise or counterclockwise along an axis of rotation.

The visual representation of the medical imaging system304shown inFIG.3includes two, two-dimensional parallel lines representing the detector308and the source and/or paddle306. The distance between the parallel lines may be fixed or variable and may by representative of the relative position of the detector to the compression paddle. Additionally, the visual representation of the medical imaging system304may be two-dimensional or three-dimensional. The dimensions of the visual representation of the medical imaging system304may be the same as or different than the visual representation of the breast302. In an example, the visual representation of the breast302is three-dimensional and the visual representation of the medical imaging system304is two-dimensional. In another example, both the visual representation of the breast302and the visual representation of the medical imaging system304are three-dimensional. In a further example, both the visual representation of the breast302and the visual representation of the medical imaging system304are two-dimensional.

Based on the relative position and orientation of the visual representation of the medical imaging system304relative to the visual representation of the breast302, an image type is determined. The image type may be determined based on predetermined zones or regions containing the visual representation of the medical imaging system304. Alternatively, the position and orientation of the visual representation of the medical imaging system304may be compared to predetermined positions/orientations, with each position/orientation associated with a specific imaging type. In an example, the actual position/orientation of the visual representation of the medical imaging system304relative to the visual representation of the breast302is compared with the predetermined positions/orientations to determine which predetermined position/orientation is closest. The visual representation of the medical imaging system304may be moved or rotated based on a click and drag action. In an example, the visual representation of the medical imaging system304may snap to the nearest predetermined position/orientation upon release of the click and drag action. The image type may be displayed at the user interface. Additionally, based on the determined image type, an image of a real breast is captured while the breast is compressed or immobilized by the imaging system.

Elements on the user interface300may include controls, graphics, charts, tool bars, input fields, icons, etc. Alternatively, other suitable means for providing input may be provided at the medical imaging system or at the workstation, for instance by a wheel, dial, knob, keyboard, mouse, bezel key, or other suitable interactive device. Thus, commands associated with the user interface300may be accepted through a display as touch input or through other input devices. Inputs may be received by the medical imaging system from a medical professional. A variety of gestures may be supported by the user interface300, including a swipe, double-tap, drag, touch and hold, drag and drop, etc. A drag gesture may include an uninterrupted selection and movement. For example, a drag may include movement of a touch interaction across a touch surface without losing contact with the touch surface. The drag gesture may be similar to a swipe gesture over a longer time and/or at a slower speed. As further described herein, a drag gesture at the user interface300may visually change a portion of the user interface300, such as by rotating or moving the visual representation of the breast302or the visual representation of the medical imaging system304.

FIGS.4A-4Ddepict different configurations of the example user interface ofFIG.3. For example, a first configuration400A shows the visual representation of the medical imaging system304in a horizontal position/orientation relative to the visual representation of the breast302that is associated with an LCV (or Left Cleavage View) image type. In another example, a second configuration400B shows the visual representation of the medical imaging system304in a horizontal position/orientation relative to the visual representation of the breast302that is associated with an LCC (or Left Craniocaudal) image type. In another example, a third configuration400C shows the visual representation of the medical imaging system304in a tilted position/orientation relative to the visual representation of the breast302that is associated with an LMLO (or Left Mediolateral Oblique) image type. In a further example, a fourth configuration400D shows the visual representation of the medical imaging system304in a vertical position/orientation relative to the visual representation of the breast302that is associated with an LML (or Left Mediolateral) image type. Although only four configurations are shown, other configurations associated with other image types are contemplated. For example,FIG.2depicts a number of breast image types, as known in the conventional mammography modality. A representation of any known or developed image type in any known or developed imaging modality may be utilized.

In an example application, a doctor or other specialist may, prior to an imaging procedure, select one or more image types to be later obtained by a technologist who is working with the patient and the imaging system. The specialist may select one or more image types depending on a previously-identified region of interest that requires further investigation, a prior diagnosis, or a to investigate a new suspect location. In most examples, the specialist may select the representation from a predefined list of representations of image types (such as the image types depicted inFIG.2or as otherwise known in the art). These particular representations may be saved to the patient's record, then accessed by a technologist during the imaging procedure. The technologist may select the image on a workstation or on an imaging system itself. The imaging system may then adjust automatically the position of any number of components to place those components in the general position required to take the selected image type. For example, for a right mediolateral oblique (RMLO) image type, the breast support platform and detector may tilt to an angle consistent with such an image type, as would the compression paddle. A tube head containing the x-ray source may move to a position out of the way of the technologist as she assists in placing and compressing the breast. Adjustments to the position of the detector and/or compression paddle may be possible to fine tune positioning as required or desired to accommodate patient comfort, anatomy, height, etc. Thereafter, the patient's breast may be compressed and the imaging procedure may be performed. Subsequent to imaging and release of the breast from the imaging system, the technologist may select the next required representation and the imaging system may automatically position its components as required in preparation therefor.

Each image type in a predefined list of image types includes a representation of the breasts, a representation of the detector (relative to the breast), and a representation of the paddle and/or source (relative to the breast and the detector), along with an indicator of image type (e.g., RCC, LXCCL, RCV, etc.). The technologies described herein, however, contemplate a user interface that may reflect non-standard relationships between a representation of the breast and the representation of the detector and paddle and/or source. In such a system, the representation of the detector and paddle and/or source may be movable relative to the representation of the breast. As such, based on the user control described above, the user may move the representation of the detector and the paddle and/or source along an x-axis (e.g., between the right breast representation and the left breast representation), along a y-axis (e.g., higher or lower along the breast representation), and about a z-axis (e.g., a rotation position reflected in the angle of the detector representation relative to the breast representation). Information may be provided on the interface (such as detector angle) for future reference by the technologist when preparing the imaging system. The ability to move the representations in the x-, y-, and z-axes allows the representation of the breast to reflect easy-to-understand conditions, so a technologist may readily ascertain the type of image required or desired.

Although the user interface technologies described herein are described primarily in the context of breast imaging, imaging of other types of body parts are also contemplated. Breast imaging is a particular type of imaging that allows for movement of the imaging system (e.g., detector and source) to accommodate an otherwise static body part (e.g., the breast is not easy or comfortable to manipulate). As such, adjustment of the representations of the detector and paddle and/or source are about three axes, generally. In imaging procedures for other body parts that are more easily manipulated relative to imaging system, position and rotation of the body part relative to the detector. For example, if the detector on an imaging system is fixed (e.g., such as with a table-type imaging system), the representation of the body part itself may be manipulated within the user interface, e.g., with regard to both position and degree of rotation, while a representation of the detector remains fixed. Imaging information such as specific pre-defined image type, angle of rotation of the body part, or other information, may be provided on the user interface.

In one example, based on a particular imaging procedure, a series of image types may be preloaded as a way to walk the specialist through an imaging procedure. For example, for a routine screening exam, it is typical to perform bilateral craniocaudal (CC) and mediolateral oblique (MLO) views. For patients undergoing a diagnostic exam, additional views may be indicated. The series of image types may be preloaded onto the workstation and displayed to the specialist. The series may be based on the types of screening exam, patient's electronic medical record, the practice at the imaging facility, the geographic region of the imaging facility, and prescribed indications by a radiologist.

FIG.5depicts an example method500for determining an image type for a medical imaging system. The method500may assist a user of an imaging system to determine an appropriate image type to image a breast, based on a configuration of the breast relative to the imaging system. The method500may be performed using systems described herein (e.g., imaging system100and user interface300).

The method500begins at operation502, where a visual representation of a breast and a visual representation of a medical imaging system are displayed. The display may be coupled to a medical imaging system or may be remote from a medical imaging system, such as at a remote workstation. The display shows a graphical user interface (GUI) that may have one or more features of the user interface300described with respect toFIG.3. The visual representation of the medical imaging system may include visual representations of one or more components of the medical imaging system (e.g., the components shown inFIGS.1A-1Bof imaging system100).

At operation504, an indication to move the visual representation of the medical imaging system to a position and an orientation relative to the visual representation of the breast is received. The indication may be received at the GUI (e.g., via touch input) or may be received at a peripheral device connected to the display showing the GUI. In an example, movement and/or rotation of a visually represented element on the GUI may be a click and drag of the element. Visually represented elements being moved on the GUI may move relative to any received user input in real-time (e.g., an element moves according to a drag movement input).

At operation506, the visual representation of the medical imaging system in the position and the orientation relative to the visual representation of the breast is displayed. The visual representation of the medical imaging system may snap to a closest position of a set of predetermined positions/orientations. For example, upon release of a click and drag input associated with the visual representation of the medical imaging system, the visual representation of the medical imaging system may be automatically re-positioned or re-oriented to align with a predetermined position/orientation. Each position/orientation of the set of predetermined positions may be associated with a unique image type.

At operation508, an image type is determined based on the relative position and orientation of the visual representation. As further described herein, the image type may be based on which predetermined position/orientation is closest to the current position/orientation of the visual representation of the imaging system. Alternatively, the image type may be based on the current position/orientation of the visual representation of the medical imaging system being contained substantially within a predefined region or threshold. At operation510, the image type is displayed. At operation512, the imaging system may then adjust automatically the position of any number of components to place those components in the general position required to take the selected image type.

Operations504-512may repeat as required or desired. For example, if a visually represented element on the GUI is moved or reoriented relative to another visually represented element, the image type may be re-evaluated.

FIG.6illustrates an example suitable operating environment600for a medical imaging system, as described herein. In its most basic configuration, operating environment600typically includes at least one processing unit (or processor)602and memory604. Depending on the exact configuration and type of computing device, memory604(storing, instructions to perform projection of an image onto a specimen) may be volatile (such as RAM), non-volatile (such as RAM, flash memory, etc.), or some combination of the two. This most basic configuration is illustrated inFIG.6by dashed line606. Further, environment600may also include storage devices (removable,608, and/or non-removable,610) including, but not limited to, magnetic or optical disks or tape. Similarly, environment600may also have input device(s)614such as keyboard, mouse, pen, voice input, etc. and/or output device(s)616such as a display, speakers, printer, etc. Also included in the environment may be one or more communication connections612, such as LAN, WAN, point to point, etc. In embodiments, the connections may be operable to facility point-to-point communications, connection-oriented communications, connectionless communications, etc.

Operating environment600typically includes at least some form of computer readable media. Computer readable media can be any available media that can be accessed by one or more processing units (or processors)602or other devices comprising the operating environment. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transitory medium which can be used to store the desired information. Computer storage media does not include communication media.

Communication media embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, microwave, and other wireless media. Combinations of the any of the above should also be included within the scope of computer readable media.

The operating environment600may be a single computer operating in a networked environment using logical connections to one or more remote computers. The remote computer may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above as well as others not so mentioned. As an example, the operating environment600may be shared between one or more imaging systems, such as imaging system100. The logical connections may include any method supported by available communications media. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets, and the Internet.

Although aspects of the present disclosure are described with respect to image analysis of living breast tissue, it should be appreciated that the present disclosure may also be useful in variety of other applications, such as imaging excised breast tissue, other tissue, bone, living organisms, body parts, or any other object, living or dead.

As should be appreciated, while the above methods have been described in a particular order, no such order is inherently necessary for each operation identified in the methods. For instance, the operations identified in the methods may be performed concurrently with other operations or in different orders. In addition, the methods described above may be performed by the systems described herein. For example, a system may have at least one processor and memory storing instructions that, when executed by the at least one processor, cause the system to perform the methods described herein.

The embodiments described herein may be employed using software, hardware, or a combination of software and hardware to implement and perform the systems and methods disclosed herein. Although specific devices have been recited throughout the disclosure as performing specific functions, one of skill in the art will appreciate that these devices are provided for illustrative purposes, and other devices may be employed to perform the functionality disclosed herein without departing from the scope of the disclosure.

This disclosure describes some embodiments of the present technology with reference to the accompanying drawings, in which only some of the possible embodiments were shown. Other aspects may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments were provided so that this disclosure was thorough and complete and fully conveyed the scope of the possible embodiments to those skilled in the art. Further, as used herein and in the claims, the phrase “at least one of element A, element B, or element C” is intended to convey any of: element A, element B, element C, elements A and B, elements A and C, elements B and C, and elements A, B, and C.

Although specific embodiments are described herein, the scope of the technology is not limited to those specific embodiments. One skilled in the art will recognize other embodiments or improvements that are within the scope and spirit of the present technology. Therefore, the specific structure, acts, or media are disclosed only as illustrative embodiments. The scope of the technology is defined by the following claims and any equivalents therein.