SYSTEM AND METHOD FOR DETERMINING A TARGET POINT FOR A NEEDLE BIOPSY

A system and a method for determining a target point for a needle biopsy may be provided. The method may include obtaining a first localization image and a second localization image regarding a region of interest (ROI) of a subject. The method may include labelling a plurality of pairs of markers for the ROI on the first localization image and the second localization image. The method may include determining a space position of each of the plurality of pairs of markers. The method may include generating visualized data regarding the ROI based on the space positions of the plurality of pairs of markers, and determining the target point for the needle biopsy based on the visualized data.

TECHNICAL FIELD

This disclosure generally relates to a medical diagnosis, and more particularly, to system and method for determining a target point for a needle biopsy in the medical diagnosis.

BACKGROUND

In some cases, a small lesion (e.g., its size is less than 10 mm) of a disease (e.g., a breast disease) may not accurate diagnosis by a typical imaging device (e.g., a computed tomography (CT) device). To diagnose such a small lesion accurately, a needle biopsy is widely adopted in clinical applications. The needle biopsy is a procedure that extracts sample cells or tissues of a suspected lesion region for examination to determine the presence or extent of the disease. It is important for the needle biopsy to determine a sampling location of the sample cells or tissues. If the sampling location is not within the lesion region, the taken sample cells or tissues can't be used to examine the disease. In such a case, the disease may not be accurately diagnosed. Therefore, it is desirable to develop a system and a method for accurately determining a target point for extracting sample cells or tissues of the suspected lesion region.

SUMMARY

In a first aspect of the present disclosure, a method for determining a target point for a needle biopsy is provided. The method may be implemented on a computing device including at least one processor and at least one storage device. The method may include one or more of the following operations. The method may include obtaining a first localization image and a second localization image regarding a region of interest (ROI) of a subject. The method may include labelling a plurality of pairs of markers for the ROI on the first localization image and the second localization image. A first marker of the pair of markers may correspond to the first localization image and a second marker of the pair of markers may correspond to the second localization image. The method may include determining a space position of each of the plurality of pairs of markers. The method may include generating visualized data regarding the ROI based on the space positions of the plurality of pairs of markers. The method may further include determining the target point for the needle biopsy based on the visualized data.

In some embodiments, the visualized data may be represented by a three-dimensional (3D) model.

In some embodiments, the method may further include displaying the space positions of the plurality of pairs of markers on the 3D model.

In some embodiments, the first localization image and the second localization image may be two-dimensional (2D) images corresponding to a first dimension and a second dimension, and the visualized data may be represented by a 2D map corresponding to a third dimension and the first dimension, or corresponding to the third dimension and the second dimension.

In some embodiments, the first localization image may be acquired at a first acquisition angle by an imaging device. The second localization image may be acquired at a second acquisition angle by the imaging device. The first acquisition angle and the second acquisition angle may have an equal absolute deflection angle value but opposite deflection directions from a reference location.

In some embodiments, before acquiring the first localization image and the second localization image, the method may further include obtaining an initial localization image at an initial acquisition angle using the imaging device, and determining whether the ROI is within an imaging range of the imaging device.

In some embodiments, a first difference between the initial acquisition angle and the first acquisition angle may be equal to a second difference between the initial acquisition angle and the second acquisition angle.

In some embodiments, the method may further include determining one or more candidate points based on the visualized data, and selecting the target point from the one or more candidate points.

In some embodiments, the imaging device may include a radiation source for emitting radiation beams. The method may include obtaining a first coordinate and a second coordinate of the radiation source corresponding to the first localization image and the second localization image, respectively. The method may include obtaining image coordinates of each of the plurality of pairs of markers on the first localization image and the second localization image. The method may further include determining, based on the first coordinate, the second coordinate and the images coordinates, the space position of each of the plurality of pairs of markers.

In some embodiments, the ROI may include a mammary region of the subject.

In a second aspect of the present disclosure, a system for determining a target point for a needle biopsy is provided. The system may include at least one storage device and at least one processor. The at least one storage device may store a set of instructions. The at least one processor may communicate with the at least one storage device. When executing the set of instructions, the at least one processor may cause the system to perform one or more of the following operations. The system may obtain, via an imaging device, a first localization image and a second localization image regarding a region of interest (ROI) of a subject. The system may label a plurality of pairs of markers for the ROI on the first localization image and the second localization image. A first marker of the pair of markers may correspond to the first localization image and a second marker of the pair of markers may correspond to the second localization image. The system may determine a space position of each of the plurality of pairs of markers. The system may generate visualized data regarding the ROI based on the space positions of the plurality of pairs of markers. The system may determine the target point for the needle biopsy based on the visualized data.

In a third aspect of the present disclosure, a non-transitory computer readable medium may be provided. The non-transitory computer readable medium may include at least one set of instructions that, when executed by at least one processor, cause a computing device to effectuate a method. The method may include one or more of the following operations. The method may include obtaining a first localization image and a second localization image regarding a region of interest (ROI) of a subject. The method may include labelling a plurality of pairs of markers for the ROI on the first localization image and the second localization image. A first marker of the pair of markers may correspond to the first localization image and a second marker of the pair of markers may correspond to the second localization image. The method may include determining a space position of each of the plurality of pairs of markers. The method may include generating visualized data regarding the ROI based on the space positions of the plurality of pairs of markers. The method may further include determining the target point for the needle biopsy based on the visualized data.

DETAILED DESCRIPTION

Provided herein are systems and components for medical imaging and/or medical treatment. In some embodiments, the medical system may include an imaging system. The imaging system may include a single modality imaging system and/or a multi-modality imaging system. The single modality imaging system may include, for example, a digital mammography (DM) system, a full-field digital mammography (FFDM) system, a digital breast tomosynthesis (DBT) system, an X-ray radiography system. The X-ray radiography system may include a computed tomography (CT) device, a digital radiography (DR) device, a C-arm X-ray device, and so on. The multi-modality imaging system may include, for example, a computed tomography-magnetic resonance imaging (MRI-CT) system, a computed tomography-a positron emission tomography imaging (PET-CT) system, etc. In some embodiments, the medical system may include a treatment system. The treatment system may include a treatment plan system (TPS), image-guide radiotherapy (IGRT), etc. The image-guide radiotherapy (IGRT) may include a treatment device and an imaging device. The treatment device may include a linear accelerator, a cyclotron, a synchrotron, etc., configured to perform a radiotherapy on a subject. The treatment device may include an accelerator of species of particles including, for example, photons, electrons, protons, or heavy ions. The imaging device may include an MRI scanner, a CT scanner (e.g., cone beam computed tomography (CBCT) scanner), a digital radiology (DR) scanner, an electronic portal imaging device (EPID), etc.

FIG. 1is a schematic diagram illustrating an exemplary medical system according to some embodiments of the present disclosure. As shown inFIG. 1, medical system100may include an imaging system110and an imaging processing workstation130. The imaging system110may connect to the imaging processing workstation130via network120.

The image processing workstation130may communicate with one or more components of the imaging system110system via a wired or wireless network. In some embodiments, the imaging system110may be an X-ray radiography system for diagnosing a region of interest (ROI) of a subject. Mere by way of example, the subject may be a patient. The ROI of the subject may include a specific portion, organ, and/or tissue of a patient. For example, the ROI may include mammary, head, brain, neck, body, shoulder, arm, thorax, cardiac, stomach, blood vessel, soft tissue, knee, feet, or the like, or any combination thereof.

Merely for illustration, the imaging system110may be an X-ray mammography system for diagnosing the mammary region. In some embodiments, the X-ray mammography system may include a positioning component for positioning a target point for a needle biopsy. A needle biopsy device may be used to take a biopsy sample (e.g., mammary lesion related tissues) from the ROI region (e.g., a suspected lesion region) corresponding to the target point. The biopsy sample may be further examined to determine whether the lesion tissues exist. In some embodiments, the positioning component may include an X-ray digital mammography positioning device, an ultrasound mammography positioning device, a magnetic resonance (MR) mammography positioning device, or the like, or any combination thereof. In some embodiments, the X-ray mammography system may generate encoded image information by scanning the ROI of the subject. The encoded image information may be recorded by an image plate. The image processing workstation130may decode the image information to generate one or more digital images. The one or more digital images may be displayed via a display of the imaging processing workstation130. In some embodiments, the positioning component of the X-ray mammography system may determine the target point for the needle biopsy based on the one or more digital images. In some embodiments, the imaging processing workstation130may be a compute electronic device (e.g., computing device300shown inFIG. 3) configured to process the one or more digital images.

FIG. 2is a schematic diagram illustrating an exemplary imaging system according to some embodiments of the present disclosure. In some embodiments, imaging system200may be the same as or similar to the imaging system100shown inFIG. 1. As shown inFIG. 2, the imaging system200may include an imaging device210, a network220, one or more terminal devices230, a processing device240, and a storage device250. The components in the imaging system200may be connected in one or more of various ways. Merely by way of example, as shown inFIG. 2, the imaging device210may be connected to the processing device240through the network220. As another example, the imaging device210may be connected to the processing device240directly as indicated by the bi-directional arrow in dotted lines linking the imaging device210and the processing device240. As a further example, the storage device250may be connected to the processing device240directly or through the network220. As still a further example, one or more terminal devices230may be connected to the processing device240directly (as indicated by the bi-directional arrow in dotted lines linking the terminal device240and the processing device240) or through the network220.

The imaging device210may include a computed tomography (CT) device, a digital radiography (DR) device, an X-ray mammography device, or the like, or any combination thereof. As used herein, the X-ray mammography device may be designated as the imaging device210. The imaging device210may include a radiation source (e.g., an X-ray tube)211, an adjustable compression plate213and a detector214.

In some embodiments, the radiation source211, the compression plate213and the detector214may be mounted on a gantry (not shown inFIG. 2). The detector214and the radiation source211may be oppositely mounted on the gantry. The compression plate213may be disposed between the radiation source211and the detector214. The compression plate213may compress and immobilize a mammary gland215to be examined. The mammary gland215may be compressed to form thin and uniform shape. In some embodiments, if the compressed mammary gland is thinner, an image contrast of the mammary gland is higher. Thus, the mammary gland215may be compressed to a relative thin shape in order to be imaged better.

The radiation source211may emit radiation rays212to irradiate the compressed mammary gland215. The radiation rays may include X-rays, γ-rays, α-rays, ultraviolet, laser, neutron, proton, or the like, or a combination thereof. Typical radiation source211may be an X-ray generator for emitting X-rays. The detector214may receive the radiation rays passed through the compressed mammary gland215. In some embodiments, the detector214may include a plurality of detector units, which may be arranged in a channel direction and a row direction. The detector214may include a scintillation detector (e.g., a cesium iodide detector) or a gas detector.

In some embodiments, the subject (e.g., a patient) may place her/his mammary gland over the detector214. The bottom surface of the compression plate213may closely attach to the mammary gland. In some embodiments, a driving device (not shown inFIG. 2) may drive the compression plate213to compress the mammary gland to a certain compression state. Under the compression state, the mammary gland is thin enough. The radiation rays may traverse the compression plate213and the compressed mammary gland. Then the detector214may receive the traversed radiation rays. One or more mammary images may be reconstructed according to the received data.

The network220may facilitate exchange of information and/or data. In some embodiments, one or more components of the imaging system200(e.g., the imaging device210, the one or more terminal devices230, the processing device240, or the storage device250) may send information and/or data to another component(s) in the imaging system200via the network220. For example, the processing device240may obtain, via the network220, one or more localization images from the storage device250. In some embodiments, the network220may be any type of wired or wireless network, or combination thereof. The network220may be and/or include a public network (e.g., the Internet), a private network (e.g., a local area network (LAN), a wide area network (WAN)), etc.), a wired network (e.g., an Ethernet network), a wireless network (e.g., an 802.11 network, a Wi-Fi network), a cellular network (e.g., a Long Term Evolution (LTE) network), a frame relay network, a virtual private network (“VPN”), a satellite network, a telephone network, routers, hubs, switches, server computers, and/or any combination thereof. Merely by way of example, the network120may include a cable network, a wireline network, an optical fiber network, a telecommunications network, an intranet, an Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a wide area network (WAN), a public telephone switched network (PSTN), a Bluetooth™ network, a ZigBee™ network, a near field communication (NFC) network, or the like, or any combination thereof. In some embodiments, the network220may include one or more network access points. For example, the network220may include wired or wireless network access points such as base stations and/or internet exchange points through which one or more components of the imaging system200may be connected to the network220to exchange data and/or information.

In some embodiments, a user (e.g., an operator or a doctor) may control the imaging system200to perform one or more operations through the one or more terminal devices230. The one or more terminal devices230include a mobile device230-1, a tablet computer230-2, a laptop computer230-3, or the like, or any combination thereof. In some embodiments, the mobile device230-1may include a smart home device, a wearable device, a smart mobile device, a virtual reality device, an augmented reality device, or the like, or any combination thereof. In some embodiments, the smart home device may include a smart lighting device, a control device of an intelligent electrical apparatus, a smart monitoring device, a smart television, a smart video camera, an interphone, or the like, or any combination thereof. In some embodiments, the wearable device may include a bracelet, footgear, eyeglasses, a helmet, a watch, clothing, a backpack, an accessory, or the like, or any combination thereof. In some embodiments, the smart mobile device may include a smartphone, a personal digital assistant (PDA), a gaming device, a navigation device, a point of sale (POS) device, or the like, or any combination thereof. In some embodiments, the virtual reality device and/or the augmented reality device may include a virtual reality helmet, a virtual reality glass, a virtual reality patch, an augmented reality helmet, an augmented reality glass, an augmented reality patch, or the like, or any combination thereof. For example, the virtual reality device and/or the augmented reality device may include a Google Glass, an Oculus Rift, a HoloLens, a Gear VR, etc. In some embodiments, the terminal device230may remotely operate the imaging device210. In some embodiments, the terminal device230may operate the imaging device210via a wireless connection. In some embodiments, the terminal device230may receive information and/or instructions inputted by a user, and send the received information and/or instructions to the imaging device210or to the processing device240via the network220. In some embodiments, the terminal device230may receive data and/or information from the processing device240. In some embodiments, the terminal device230may be part of the processing device240. In some embodiments, the terminal device230may be omitted.

The processing device240may process data obtained from the imaging device210, the one or more terminal devices230, or the storage device250. For example, the processing device240may obtain a first localization image and a second localization image regarding a region of interest (ROI) of a subject (e.g., a mammary region). As another example, the processing device240may label a plurality of pairs of markers for the ROI on the first localization image and the second localization image. As a further example, the processing device240may generate visualized data regarding the ROI based on the labelled plurality of pairs of markers. The processing device240may be a central processing unit (CPU), a digital signal processor (DSP), a system on a chip (SoC), a microcontroller unit (MCU), or the like, or any combination thereof.

In some embodiments, the processing device240may be a single server or a server group. The server group may be centralized or distributed. In some embodiments, the processing device240may be local or remote. For example, the processing device240may access information and/or data stored in the imaging device210, the terminal device2130, and/or the storage device250via the network220. As another example, the processing device240may be directly connected to the imaging device210, the terminal device2130, and/or the storage device250, to access stored information and/or data. In some embodiments, the processing device240may be implemented on a cloud platform. Merely by way of example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or any combination thereof. In some embodiments, the processing device240may be implemented on a computing device300having one or more components illustrated inFIG. 3in the present disclosure.

The storage device250may store data and/or instructions. In some embodiments, the storage device250may store data obtained from the imaging device210, the terminal device230and/or the processing device240. For example, the storage device250may store one or more images obtained from the processing device240. In some embodiments, the storage device250may store data and/or instructions that the processing device240may execute or use to perform exemplary methods described in the present disclosure. For example, the storage device250may store data and/or instructions that the processing device240may execute or use to determine a target point for a needle biopsy. In some embodiments, the storage device250may include a mass storage, removable storage, a volatile read-and-write memory, a read-only memory (ROM), or the like, or any combination thereof. Exemplary mass storage may include a magnetic disk, an optical disk, a solid-state drive, etc. Exemplary removable storage may include a flash drive, a floppy disk, an optical disk, a memory card, a zip disk, a magnetic tape, etc. Exemplary volatile read-and-write memory may include a random-access memory (RAM). Exemplary RAM may include a dynamic RAM (DRAM), a double date rate synchronous dynamic RAM (DDR SDRAM), a static RAM (SRAM), a thyristor RAM (T-RAM), and a zero-capacitor RAM (Z-RAM), etc. Exemplary ROM may include a mask ROM (MROM), a programmable ROM (PROM), an erasable programmable ROM (PEROM), an electrically erasable programmable ROM (EEPROM), a compact disk ROM (CD-ROM), and a digital versatile disk ROM, etc. In some embodiments, the storage device250may be implemented on a cloud platform. Merely by way of example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or any combination thereof.

In some embodiments, the storage device250may be connected to the network220to communicate with one or more components of the imaging system200(e.g., the one or more terminal devices230, or the processing device240). One or more components of the imaging system200may access the data or instructions stored in the storage device250via the network220. In some embodiments, the storage device250may be directly connected to or communicate with one or more components of the imaging system200(e.g., the one or more terminal devices230, or the processing device240). In some embodiments, the storage device250may be part of the processing device240.

FIG. 3is a schematic diagram illustrating exemplary hardware and/or software components of a computing device on which the processing device may be implemented according to some embodiments of the present disclosure. As illustrated inFIG. 3, computing device300may include a processor310, a storage medium320, a memory330, a communication port340, an output device350and an input device360. In some embodiments, the image processing workstation130, the processing device240and/or the one or more terminal devices230may be implemented on the computing device300.

The processor310may execute computer programs (e.g., computer program322stored in a storage320) and, when executing the computer programs, cause the processing device240to perform functions of the processing device240in accordance with techniques described herein. The computer programs may include, for example, routines, programs, objects, components, signals, data structures, procedures, modules, and functions, which perform particular functions described herein. The computer programs may be stored in the storage320. The storage320may also store an operating system321(e.g., Linux, Microsoft windows, mac OS, etc.). The operating system321may be loaded into the memory330from the storage320in order to be executed by the processor310.

The processor310may include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application specific integrated circuits (ASICs), an application-specific instruction-set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physics processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of executing one or more functions, or the like, or any combinations thereof. The storage320and/or the memory330may be a storage device similar to or same as the storage device250illustrated inFIG. 2.

The communication port340may be connected to a network (e.g., the network220) to facilitate data communications. For example, in the imaging system200, the communication port340may establish connections between the processing device240and the imaging device210, the one or more terminal devices230, or the storage device250. The connection may be a wired connection, a wireless connection, or combination of both that enables data transmission and reception. The wired connection may include an electrical cable, an optical cable, a telephone wire, or the like, or any combination thereof. The wireless connection may include Bluetooth, Wi-Fi, WiMAX, WLAN, ZigBee, mobile network (e.g., 3G, 4G, 5G, etc.), or the like, or a combination thereof. In some embodiments, the communication port240may be a standardized communication port, such as RS232, RS485, etc. In some embodiments, the communication port340may be a specially designed communication port. For example, the communication port340may be designed in accordance with the digital imaging and communications in medicine (DICOM) protocol.

In some embodiments, the input device360and the output device350may enable user interaction with the processing device240. Exemplary input devices may include a keyboard, a mouse, a touch screen, a microphone, or the like, or a combination thereof. Exemplary output devices may include a display device, a loudspeaker, a printer, a projector, or the like, or a combination thereof. Exemplary display devices may include a liquid crystal display (LCD), a light-emitting diode (LED)-based display, a flat panel display, a curved screen, a television device, a cathode ray tube (CRT), or the like, or a combination thereof.

Merely for illustration, only one processor is described in the computing device300. However, it should be noted that the computing device300in the present disclosure may also include multiple processors. Thus operations and/or method steps that are performed by one processor as described in the present disclosure may also be jointly or separately performed by the multiple processors. For example, if in the present disclosure the processor of the computing device300executes both operation A and operation B, it should be understood that operation A and operation B may also be performed by two or more different processors jointly or separately in the computing device300(e.g., a first processor executes operation A and a second processor executes operation B, or the first and second processors jointly execute operations A and B).

FIG. 4is a schematic diagram illustrating exemplary hardware and/or software components of a mobile device on which a terminal device may be implemented according to some embodiments of the present disclosure. As illustrated inFIG. 4, mobile device400may include a communication platform410, a display420, a graphic processing unit (GPU)430, a central processing unit (CPU)440, an I/O450, a memory460, and a storage490. In some embodiments, any other suitable component, including but not limited to a system bus or a controller (not shown), may also be included in the mobile device400. In some embodiments, a mobile operating system470(e.g., iOS, Android, Windows Phone, etc.) and one or more applications480may be loaded into the memory460from the storage490in order to be executed by the CPU440. The applications480may include a browser or any other suitable mobile apps for receiving and rendering information relating to image processing or other information from the processing device140. User interactions with the information stream may be achieved via the I/O450and provided to the processing device140and/or other components of the MRI system100via the network120.

FIG. 5is a block diagram illustrating an exemplary processing device according to some embodiments of the present disclosure. The processing device240may include an acquisition module502, a label module504, a space position determination module506, a visualized data determination module508, a target point determination module510and a display module512. At least a portion of the processing device240may be implemented on a computing device as illustrated inFIG. 3or a mobile device as illustrated inFIG. 4. In some embodiments, one or more modules of the processing device240may also be implemented to a position component of the imaging system110(e.g., the X-ray mammography system).

The acquisition module502may acquire data or instructions from the imaging system200. In some embodiments, the acquisition module502may obtain a first localization image and a second localization image regarding a region of interest (ROI) of a subject. In some embodiments, the subject may be a patient. The ROI of the subject may refer to a suspected lesion region of the patient, such as a mammary region of the subject. In some embodiments, the first localization image and the second localization image may be generated by the imaging device210. The imaging device210may generate the first localization image at a first acquisition angle, and generate the second localization image at a second acquisition angle. In some embodiments, the first acquisition angle (e.g., +15°) and the second localization angle (e.g., −15°) may have equal absolute deflection angle value but opposite deflection directions from a reference location (e.g., a location corresponding to 0°). In some embodiments, the reference location may refer to an initial location of a radiation source211of the imaging device210.

The label module504may label a plurality of pairs of markers for the ROI on the first localization image and the second localization image. For each pair of markers, a first marker of the pair of markers may correspond to the first localization image and a second marker of the pair of markers may correspond to the second localization image. In some embodiments, the first marker and the second marker may be labelled on the same point (e.g., a suspected lesion point) of the ROI of the first localization image and the second localization image, respectively. The first marker and the second marker may correspond to a common space position of the same point of the ROI.

The space position determination module506may determine a space position of each of the plurality of pairs of markers. In some embodiments, the space position determination module506may obtain a first coordinate of the radiation source corresponding to the first localization image, and obtain a second coordinate of the radiation source corresponding to the second localization image. The space position determination module506may obtain image coordinates of each of the plurality of pairs of markers on the first localization image and the second localization image. The space position determination module506may determine, based on the first coordinate, the second coordinate and the images coordinates, the space position of each of the plurality of pairs of markers by using a four-point connection-based localization algorithm. In some embodiments, the image coordinates of the markers may be associated with projection coordinates of the markers on the detector.

The visualized data determination module508may generate visualized data regarding the ROI based on the space positions of the plurality of pairs of markers. In some embodiments, the visualized data may be a three-dimensional (3D) model or a two-dimensional (2D) map. In some embodiments, the 2D map may include position information of the suspected lesion point corresponding to the pair of markers at two dimensions. In some embodiments, if the first localization image and the second localization image are the 2D planar image corresponding to a first dimension and a second dimension, the two dimensions of the 2D map may include a third dimension and the first dimension, or the third dimension and the second dimension.

Merely by way of example, if the first localization image and the second localization image are the images of the X-Y coordinate plane, the coordinate of Z direction may represent the position of the third dimension of the 2D map. The 2D map may be the image of the X-Z coordinate plane or the Y-Z coordinate plane. If the first localization image and the second localization image are the images of the X-Z coordinate plane, the coordinate of Y direction may represent the position of the third dimension of the 2D map. The 2D map may be the image of the X-Y coordinate plane or the Y-Z coordinate plane. If the first localization image and the second localization image are the images of the Y-Z coordinate plane, the coordinate of X direction may represent the position of the third dimension of the 2D map. The 2D map may be the image of the X-Y coordinate plane or the X-Z coordinate plane.

The target point determination module510may determine the target point for the needle biopsy based on the visualized data. For example, the target point determination module510may determine one or more candidate points based on the 3D model or the 2D map. The target point determination module510may select the target point from the one or more candidate points. The target point may be designated as a sampling location of the needle biopsy. At the location of the target point, some sample cells or tissues may be extracted by the needle biopsy device. The target point for the needle biopsy may be accurately determined based on the 3D model or the 2D map, which may improve the diagnosis efficiency for some diseases (e.g., the breast disease). More descriptions of the determination of the target point may be found elsewhere in the present disclosure (e.g.,FIGS. 6-8, and the descriptions thereof).

It should be noted that the above description is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations and modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure. For example, the processing device240may further include a storage module (not shown inFIG. 5). The storage module may be configured to store data generated during any process performed by any component of in the processing device240. As another example, each of components of the processing device240may include a storage device. Additionally or alternatively, the components of the processing device240may share a common storage device.

FIG. 6is a flowchart illustrating an exemplary process for determining a target point for a needle biopsy according to some embodiments of the present disclosure. In some embodiments, process600may be implemented in medical system100illustrated inFIG. 1and/or the imaging system200illustrated inFIG. 2. For example, the process600may be stored in a storage device (e.g., the storage device250, or the storage320) as a form of instructions, and can be invoked and/or executed by the processing device240(e.g., the processor310of the computing device300, or one or more modules in the processing device240illustrated inFIG. 5). The operations of the illustrated process600presented below are intended to be illustrative. In some embodiments, the process600may be accomplished with one or more additional operations not described, and/or without one or more of the operations discussed. Additionally, the order in which the operations of the process600as illustrated inFIG. 6and described below is not intended to be limiting.

In602, the processing device (e.g., the acquisition module502of the processing device240) may obtain a first localization image and a second localization image regarding a region of interest (ROI) of a subject. For example, the acquisition module502may obtain the first localization image and the second localization image acquired by an imaging device (e.g., the imaging device210). The imaging device210may be the X-ray mammary device.

In some embodiments, the subject may be a patient. The ROI of the subject may refer to a suspected lesion region of the patient, such as a mammary region of the subject. In some embodiments, the first localization image and the second localization image may be generated by the imaging device210. The imaging device210may generate the first localization image at a first acquisition angle, and generate the second localization image at a second acquisition angle. In some embodiments, the first acquisition angle (e.g., +15°) and the second localization angle (e.g., −15°) may have equal absolute deflection angle value but opposite deflection directions from a reference location (e.g., a location corresponding to 0°). In some embodiments, the reference location may refer to an initial location of a radiation source211of the imaging device210.

Typical radiation source211may be mounted on the gantry (not shown inFIG. 2), which may be driven by the imaging device210to rotate or translate. The gantry carries the radiation source to move to different locations for imaging (e.g., acquiring the first localization image at the first acquisition angle and acquiring the second localization image at the second acquisition angle), while the detector214remains in place. In some embodiments, before imaging, the radiation source mounted on the gantry may be set at the initial location, e.g., zero degree (0°), as the origin of a coordinate system of gantry. In this way, when one pair of markers for the ROI are labeled on the first localization image and the second localization image, respectively, the relative positions of the pair of labeled markers to the gantry is known since the relative position of the detector to the gantry is known. When the radiation source211is at the initial location, a center of the emitted radiation beams may be perpendicular to the detector214. For example, as shown inFIG. 2, the initial location may be the position where the radiation source211and the detector214are coaxial, and separated from the compression plate213by a certain distance (e.g., 30 cm, 40 cm, 50 cm, 60 cm, etc.). The radiation source211may also be coaxial to the compression plate213at the initial location. It should be noted that the initial location may be set according to different scenarios. For example, the initial location may be set as a location of a non-zero angle in the coordinate system of the gantry, such as, +10°, +20°, −10°, or −20°, and so on.

Merely by way of example, the location of the gantry, e.g., at zero degree may be referred as the reference location for determining the relative positions of the pair of labeled markers to the gantry, as discussed above and elaborated further below. In some embodiments, the radiation source211may be moved to a location corresponding to the first acquisition angle. For example, the first acquisition angle is a positive 15° (i.e., +15°) deflected from the reference location. At the first acquisition angle, the radiation source211may emit the radiation beams to irradiate the suspected lesion region (e.g., the mammary region). The detector214may detect signals associated with the radiation beams. The first localization image may be generated by processing the detected signals. The first localization image may include image information indicative of the suspect lesion region at the first acquisition angle. In some embodiments, the radiation source211may be adjusted to a location corresponding to the second acquisition angle. For example, the second acquisition angle is a negative 15° (i.e., −15°) deflected from the reference location. At the second acquisition angle, the radiation source211may emit the radiation beams to irradiate the same suspected lesion region (e.g., the mammary region). The second localization image may be generated by processing the detected signals associated with the radiation beams. The second localization image may include image information indicative of the same suspect lesion region at the second acquisition angle. In some embodiments, the gantry may be driven to carry the radiation source211to move to the location of the first acquisition angle or the second acquisition angle, and the detector214may remain in place with the subject as set forth above.

As used herein, the “positive angle” and “negative angle” may denote a deflection angle at different directions, such as two opposite directions. For example, a first deflection angle along a first direction may be preset as the position angle (e.g.,+15°), and a second deflection angle along a second direction may be preset as the negative angle (e.g., −15°). The first direction and the second direction may be opposite directions. For example, the first direction refers to a clockwise direction, thus the second direction refers to an anti-clockwise direction. The gantry (or the radiation source211) may rotate in the clockwise direction (i.e., the first direction) or in the anti-clockwise direction (i.e., the second direction). In some embodiments, the anti-clockwise direction may be designated to as the first direction, and the clockwise direction may be designated to as the first direction may be designated as the second direction. It is understood that the first direction and the second direction may not be intended to be limited.

In some embodiments, the first localization image and the second localization image may be two-dimensional (2D) planar images. For example, the first localization image and the second localization image may be images generated at the X-Y coordinate plane. As another example, the first localization image and the second localization image may be images generated at the Y-Z coordinate plane. As a further example, the first localization image and the second localization image may be images generated at the X-Z coordinate plane.

In some embodiments, before acquiring the first localization image and the second localization image, the precession device may obtain an initial localization image. Specifically, the imaging device210may generate the initial localization image at an initial acquisition angle. The radiation source211may be disposed at the initial acquisition angle. The acquisition module502may obtain the initial localization image from the imaging device210.

In some embodiments, the processing device may determine whether the ROI is within an imaging range of the imaging device based on the initial localization image. In some embodiments, a first difference between the initial acquisition angle and the first acquisition angle may be equal to a second difference between the initial acquisition angle and the second acquisition angle. For example, the initial acquisition angle may be the angle corresponding to the reference location, such as 0°. The first difference and the second difference may be 15°. In some embodiments, if the ROI is not imaged in the initial localization image, the processing device may determine the ROI is not in the image region of the imaging device. In this case, the compression plate213need to be adjusted so as to make the ROI is within the imaging region of the imaging device, which may improve imaging efficiency of the imaging device210to some extent.

In604, the processing device (e.g., the label module504of the processing device240) may label a plurality of pairs of markers for the ROI on the first localization image and the second localization image. For each pair of markers, a first marker of the pair of markers may correspond to the first localization image and a second marker of the pair of markers may correspond to the second localization image. In some embodiments, the first marker and the second marker may be labelled on the same point (e.g., a suspected lesion point) of the ROI of the first localization image and the second localization image, respectively. The first marker and the second marker may correspond to a common space position of the same point of the ROI.

Merely by way of example, the label module504may determine the first markers for the ROI region (e.g., the mammary region) on the first localization image, and the second markers (e.g., the mammary region) for the ROI region on the second localization image. A pair of markers may include the first marker and the second marker. The label module504may record the pairs of the labeled markers, such as coordinates. In some embodiments, the marker may be a point on the ROI of the localization image. In some embodiments, the marker may be a plane on the ROI of the localization image. The shape of the marker may be not intended to be limited.

In606, the processing device (e.g., the space position determination module506of the processing device240) may determine a space position of each of the plurality of pairs of markers. In some embodiments, the processing device may determine the space position of each of the plurality of pairs of markers using a 3D localization algorithm (e.g., a four-point connection-based localization algorithm). In some embodiments, the space position may be designated as the space position of the suspected lesion point.

In some embodiments, the processing device may obtain a first coordinate of the radiation source corresponding to the first localization image, and obtain a second coordinate of the radiation source corresponding to the second localization image. The processing device may obtain image coordinates of each of the plurality of pairs of markers on the first localization image and the second localization image. The processing device may determine, based on the first coordinate, the second coordinate and the images coordinates, the space position of each of the plurality of pairs of markers by using a four-point connection-based localization algorithm. In some embodiments, the image coordinates of the markers may be associated with projection coordinates of the markers on the detector.

Merely by way of example, the space position determination module506may obtain, from the storage device250, the first coordinate of the radiation source when acquiring the first localization image, and the second coordinate of the radiation source when acquiring the second localization image. The first coordinate may be the coordinate of the radiation source at the first acquisition angle (e.g., +15°), and the second coordinate may be the coordinate of the radiation source at the second acquisition angle (e.g., −15°). The space position determination module506may obtain, from the storage device250, the image coordinates of each marker on its localization image. The space position determination module506may determine, based on the first coordinate, the second coordinate and the image coordinate, the space position of the each marker using one or more 3D localization algorithms (e.g., a layered approach, a gridding algorithm, a four-point connection-based localization algorithm).

In608, the processing device (e.g., the visualized data determination module508of the processing device240) may generate visualized data regarding the ROI based on the space positions of the plurality of pairs of markers. In some embodiments, the visualized data may be a three-dimensional (3D) model or a two-dimensional (2D) map. In some embodiments, the 2D map may include position information of the suspected lesion point corresponding to the pair of markers at two dimensions. In some embodiments, if the first localization image and the second localization image are the 2D planar image corresponding to a first dimension and a second dimension, the two dimensions of the 2D map may include a third dimension and the first dimension, or the third dimension and the second dimension. Merely by way of example, if the first localization image and the second localization image are the images of the X-Y coordinate plane, the coordinate of Z direction may represent the position of the third dimension of the 2D map. The 2D map may be the image of the X-Z coordinate plane or the Y-Z coordinate plane. If the first localization image and the second localization image are the images of the X-Z coordinate plane, the coordinate of Y direction may represent the position of the third dimension of the 2D map. The 2D map may be the image of the X-Y coordinate plane or the Y-Z coordinate plane. If the first localization image and the second localization image are the images of the Y-Z coordinate plane, the coordinate of X direction may represent the position of the third dimension of the 2D map. The 2D map may be the image of the X-Y coordinate plane or the X-Z coordinate plane.

In some embodiments, the processing device may construct the 3D model based on the space positions of the plurality of pairs of markers. For example, the visualized data determination module508may determine the 3D model by connecting the space positions corresponding to the plurality of pairs of markers. The 3D model may represent the space shape of the ROI (e.g., the suspected lesion region). In some embodiments, the 3D surface of the 3D model may be a mesh surface. The mesh surface may include a plurality of grids. In some embodiments, the processing device may display, through a display device, the space positions of the plurality of pairs of markers on the 3D model. The user may intuitively observe the position distribution of the suspected lesion points based on the displayed space positions. More descriptions regarding the determination of 3D model may be found in the present disclosure (e.g.,FIG. 7, and the descriptions thereof).

In some embodiments, the processing device may determine the 2D map based on the space positions of the plurality of pairs of markers. In some embodiments, the 2D map may be a 2D scatter distribution map. A scatter point may denote a suspected lesion point corresponding to the pair of markers. The coordinate of the scatter point may denote the position of the suspected lesion point at the third dimension and the first dimension, or at the third dimension and the second dimension. Merely by way of example, if first localization image and the second localization image are the images of the X-Y coordinate plane, the visualized data determination module508may extract the coordinate of the first dimension (e.g., X coordinate) or the second dimension (e.g., Y coordinate) of the space position, and extract the third dimension (e.g., Z coordinate) of the space position. The visualized data determination module508may construct the 2D map based on the Z coordinate and X or Y coordinate of each space position. The 2D map may relate to position distributions regarding X-Z coordinate plane or Y-Z coordinate plane. More descriptions of the determination of 2D map may be found elsewhere in the present disclosure (e.g.,FIG. 8, and the descriptions thereof).

In610, the processing device (e.g., the target point determination module510of the processing device240) may determine the target point for the needle biopsy based on the visualized data. In some embodiments, the processing device may determine one or more candidate points based on the visualized data. The processing device may select the target point from the one or more candidate points.

In some embodiments, the target point determination module510may determine the one or more candidate points according to the 3D model. The 3D model may intuitively display the ROI region (including the suspect lesion region). The one or more candidate points may be determined according to the shape of the 3D model. Specifically, a contour of the suspect lesion region may be segmented from the 3D model. The target point determination module510may determine the one or more candidate points based on the contour of the suspect lesion region. For example, the one or more candidate points may include a center point, a plurality of points surrounded the center point. A suitable candidate point may be selected as the target point. For example, the center point of the contour may be selected as the target point.

In some embodiments, the user may select the one or more candidate points manually on the 3D model, and select the target point from the one or more candidate points based on her/his experience. In some embodiments, the target point determination module510may determine a geometrical center of the suspected lesion region based on the 3D model, and directly select the geometrical center as the target point.

In some embodiments, the processing device may determine the one or more candidate points on the 2D map. For example, the target point determination module510may determine the one or more candidate points based on a Gaussian distribution or a random distribution on the 2D map. The target determination module510may select the target point from the one or more candidate points. The target point may be a center point of a cluster of the one or more candidate points. In some embodiments, the user may select the one or more candidate points manually on the 2D map, and select the target point from the one or more candidate points based on her/his experience.

The target point may be designated as a sampling location of the needle biopsy. At the location of the target point, some sample cells or tissues may be extracted by the needle biopsy device. As described above, the target point for the needle biopsy may be accurately determined based on the 3D model or the 2D map, which may improve the diagnosis efficiency for some diseases (e.g., the breast disease).

FIG. 7is a flowchart illustrating an exemplary process for determining a target point for a needle biopsy according to some embodiments of the present disclosure. In some embodiments, process700may be implemented in the medical system100illustrated inFIG. 1and/or the imaging system200illustrated inFIG. 2. For example, the process700may be stored in a storage device (e.g., the storage device250, or the storage320) as a form of instructions, and can be invoked and/or executed by the processing device240(e.g., the processor310of the computing device300, or one or more modules in the processing device240illustrated inFIG. 5). The operations of the illustrated process700presented below are intended to be illustrative. In some embodiments, the process700may be accomplished with one or more additional operations not described, and/or without one or more of the operations discussed. Additionally, the order in which the operations of the process700as illustrated inFIG. 7and described below is not intended to be limiting.

In702, the processing device (e.g., the acquisition module502of the processing device240) may obtain a first localization image and a second localization image regarding a region of interest (ROI) of a subject). In some embodiments, the subject may be a patient. The ROI of the subject may include a suspect lesion region of the subject. For example, for a patient with a breast disease, the ROI may be the mammary region of the patient. In some embodiments, the first localization image and the second localization image may be acquired by an imaging device (e.g., the imaging device210). For example, the imaging device210may acquire the first localization image at a first acquisition angle (e.g., +15°), and acquire the second localization image at a second acquisition angle (e.g., −15°). The acquisition module502may obtain the first localization image and the second localization acquired by the image device210. In some embodiments, the first localization image and the second localization image may include the imaged ROI region of the subject. In some embodiments, the first localization image and the second localization image may be 2D planar image. In some embodiments, a coordinate system (X, Y, Z) of the gantry of the imaging system may be as a reference coordinate system of the imaging system. If the first localization image and the second localization image may be imaged at X and Y directions, the first localization image and the second localization image may be designated as images of the X-Y coordinate plane. If the first localization image and the second localization image may be imaged at X and Z directions, the first localization image and the second localization image may be designated as images of the X-Z coordinate plane. If the first localization image and the second localization image may be imaged at Y and Z directions, the first localization image and the second localization image may be designated as images of the Y-Z coordinate plane images.

In704, the processing device (e.g., the label module504of the processing device240) may label a plurality of pairs of markers for the ROI on the first localization image and the second localization image. For each pair of markers, a first marker of the pair of markers may correspond to the first localization image and a second marker of the pair of markers may correspond to the second localization image. In some embodiments, the first marker and the second marker may be labelled on the same corresponding point (e.g., a suspected lesion point) of the ROI of the first localization image and the second localization image, respectively. The first marker and the second marker may correspond to a common space position of the same point of the ROI. In some embodiments, coordinates of the plurality of pairs of markers may be recorded by the processing device.

In706, the processing device (e.g., the space position determination module506of the processing device240) may determine a space position of each of the plurality of pairs of markers. In some embodiments, the processing device may obtain a first coordinate of the radiation source corresponding to the first localization image, and obtain a second coordinate of the radiation source corresponding to the second localization image. The processing device may obtain image coordinates of each of the plurality of pairs of markers on the first localization image and the second localization image. The processing device may determine, based on the first coordinate, the second coordinate and the images coordinates, the space position of each of the plurality of pairs of markers by using a four-point connection-based localization algorithm. It should be noted that the plurality of pairs of markers each corresponds to a space position.

Operations702-706may be similar to or the same as operations602-606. More details regarding the operations702-706may be described in connection with the operations602-606, and not be repeated herein.

In708, the processing device (e.g., the visualized data determination module508of the processing device240) may generate a 3D model based on the space positions of the plurality of pairs of markers.

In some embodiments, the space positions of at least a part of the plurality of pairs of markers may be associated with suspected lesion points. These space positions may represent the locations of the suspected lesion points. The processing device may connect, based on the determined space positions, the suspected lesion points to form the 3D model. The 3D model may visually represent the suspected lesion region constructed by the suspected lesion points. In some embodiments, the 3D surface of the 3D model may be a mesh surface. The mesh surface may include a plurality of grids.

Merely for illustration, the visualized data determination module508may classify the space positions of the plurality of pairs of markers into multiple layers (e.g., N layers) along the Z coordinate direction. A thickness of each layer may be set as M. The visualized data determination module508may construct an envelope line by fitting points on each layer. The visualized data determination module508may determine a volume by spreading the envelope line based on the thickness of the layer. Multiple volumes corresponding to the multiple layers may be determined. The entire 3D model may be constructed by the multiple volumes corresponding to the multiple layers.

As another example, the visualized data determination module508may determine projection points on the X-Y coordinate plane for the space positions of the plurality of pairs of markers. In some embodiments, Z coordinate value of each projection points may be recorded. In some embodiments, the visualized data determination module508may enclose the projection points with a minimum area rectangle on the X-Y coordinate plane. The visualized data determination module508may generate a plurality of grids on the surface of rectangle. In some embodiments, each grid may have equal area. For the projection points within each grid, the visualized data determination module508may obtain a first projection point having a maximum Z coordinate value and a second projection having a minimum Z coordinate value. The visualized data determination module508may generate a first surface by fitting the first projection points, and a second surface by fitting the second projection points. The visualized data determination module508may determine the entire 3D model based on the first surface and the second surface. For example, the 3D model may be a 3D volume enclosed by the first surface and the second surface.

As a further example, the visualized data determination module508may directly construct, based on the space positions of the plurality of pairs of markers, 3-dimension envelope using a convhulln function. The visualized data determination module508may determine the 3D model based on the 3-dimension envelop. Specifically, the volume enclosed by the 3-dimension envelop may be designated as the volume of the 3D model.

In710, the processing device (e.g., the target point determination module510of the processing device240) may determine a target point for the needle biopsy based on the 3D model.

In some embodiments, using the 3D model, the user (e.g., the operator or the doctor) may comprehensively consider the space positions of the plurality of pairs of markers associated with the suspected lesion region and position information of the suspected lesion region in a coordinate plane. The user may further determine the target point, for example, according to her/his experience.

In some embodiments, the processing device may determine one or more candidate points on the 3D model. The one or more candidate points may be displayed on the 3D model. For example, the one or more candidate points may displayed as red color. The processing device may determine the target point from the one or more candidate points. The target point may be displayed as green color different from other candidate points.

In some embodiments, the target point may be selected manually. Specifically, the user may label the one or more candidate points on the 3D model via an auxiliary tool according to her/his experience. The user may select the target point from the one or more candidate points. In some embodiments, a geometrical center of a cluster of the one or more candidate points may be selected as the target point.

In some embodiments, the target point may be selected automatically. For example, the target point determination module510may segment a contour of the suspected lesion region on the 3D model. The target point determination module510may determine the one or more candidate points based on the contour of the suspected lesion region. For example, the one or more candidate points may include a center point of the contour and a plurality of points surrounded the center point. The target point determination module510may automatically select the center point of the contour as the target point.

FIG. 8is a flowchart illustrating an exemplary process for determining a target point for a needle biopsy according to some embodiments of the present disclosure. In some embodiments, process800may be implemented in the medical system100illustrated inFIG. 1and/or the imaging system200illustrated inFIG. 2. For example, the process800may be stored in a storage device (e.g., the storage device250, or the storage320) as a form of instructions, and can be invoked and/or executed by the processing device240(e.g., the processor310of the computing device300, or one or more modules in the processing device240illustrated inFIG. 5). The operations of the illustrated process800presented below are intended to be illustrative. In some embodiments, the process800may be accomplished with one or more additional operations not described, and/or without one or more of the operations discussed. Additionally, the order in which the operations of the process800as illustrated inFIG. 8and described below is not intended to be limiting.

In802, the processing device (e.g., the acquisition module502of the processing device240) may obtain a first localization image and a second localization image regarding a region of interest (ROI) of a subject). In some embodiments, the subject may be a patient. The ROI of the subject may include a suspect lesion region of the subject. For example, for a patient with a breast disease, the ROI may be the mammary region of the patient. In some embodiments, the first localization image and the second localization image may be acquired by an imaging device (e.g., the imaging device210). For example, the imaging device210may acquire the first localization image at a first acquisition angle (e.g., +15°), and acquire the second localization image at a second acquisition angle (e.g., −15°). The acquisition module502may obtain the first localization image and the second localization acquired by the image device210. In some embodiments, the first localization image and the second localization image may include the imaged ROI region of the subject. In some embodiments, the first localization image and the second localization image may be 2D planar image. In some embodiments, a coordinate system (X, Y, Z) of the gantry of the imaging system may be as a reference coordinate system of the imaging system. If the first localization image and the second localization image may be imaged at X and Y directions, the first localization image and the second localization image may be designated as images of the X-Y coordinate plane. If the first localization image and the second localization image may be imaged at X and Z directions, the first localization image and the second localization image may be designated as images of the X-Z coordinate plane. If the first localization image and the second localization image may be imaged at Y and Z directions, the first localization image and the second localization image may be designated as images of the Y-Z coordinate plane images.

In804, the processing device (e.g., the label module504of the processing device240) may label a plurality of pairs of markers for the ROI on the first localization image and the second localization image. For each pair of markers, a first marker of the pair of markers may correspond to the first localization image and a second marker of the pair of markers may correspond to the second localization image. In some embodiments, the first marker and the second marker may be labelled on the same corresponding point (e.g., a suspected lesion point) of the ROI of the first localization image and the second localization image, respectively. The first marker and the second marker may correspond to a common space position of the same point of the ROI. In some embodiments, coordinates of the plurality of pairs of markers may be recorded by the processing device.

In806, the processing device (e.g., the space position determination module506of the processing device240) may determine a space position of each of the plurality of pairs of markers. In some embodiments, the processing device may obtain a first coordinate of the radiation source corresponding to the first localization image, and obtain a second coordinate of the radiation source corresponding to the second localization image. The processing device may obtain image coordinates of each of the plurality of pairs of markers on the first localization image and the second localization image. The processing device may determine, based on the first coordinate, the second coordinate and the images coordinates, the space position of each of the plurality of pairs of markers by using a four-point connection-based localization algorithm. It should be noted that the plurality of pairs of markers each corresponds to a space position.

Operations802-806may be similar to or the same as operations602-606or operations702-706. More details regarding the operations802-806may be described in connection with the operations602-606or the operations702-706, and not be repeated herein.

In808, the processing device (e.g., the visualized data determination module508of the processing device240) may generate a 2D map based on the space positions of the plurality of pairs of markers. As described in connection with operation802, the first localization image and the second localization image may be the planar image including two dimensions (e.g., a first dimension and a second dimension). In some embodiments, the generated 2D map may include position information (e.g., coordinates) regarding at least one of the two dimensions of the localization image and a third dimension. In other words, the 2D map may be associated with the first dimension and the third dimension, or the second dimension and the third dimension.

Merely by way of example, if the first localization image and the second localization image are the images of the X-Y coordinate plane, the coordinate of Z direction may represent the position of the third dimension of the 2D map. If the first localization image and the second localization image are the images of the X-Z coordinate plane, the coordinate of Y direction may represent the position of the third dimension of the 2D map. If the first localization image and the second localization image are the images of the Y-Z coordinate plane, the coordinate of X direction may represent the position of the third dimension of the 2D map.

It should be noted that the space position may be represented as a 3-dimension coordinate (X, Y, Z). Merely for illustration, if first localization image and the second localization image are the images of the X-Y coordinate plane, the visualized data determination module508may extract the coordinate of the first dimension (e.g., X coordinate) or the second dimension (e.g., Y coordinate) of the space position, and extract the third dimension (e.g., Z coordinate) of the space position. The visualized data determination module508may construct the 2D map based on the Z coordinate and X or Y coordinate of each space position. The 2D map may relate to position distributions regarding X-Z coordinate plane or Y-Z coordinate plane.

In810, the processing device (e.g., the target point determination module510of the processing device240) may determine a target point for the needle biopsy based on the 2D map.

In some embodiments, using the 2D map, the user (e.g., the operator or the doctor) may comprehensively consider the position distribution of the plurality of pairs of markers associated with the suspected lesion region and position information of the suspected lesion region in a coordinate plane. The user may further determine the target point, for example, according to her/his experience.

In some embodiments, the processing device may automatically determine one or more candidate points on the 2D map. For example, the target point determination module510may determine the one or more candidate points based on a Gaussian distribution or a random distribution on the 2D map. The target point determination module510may select the target point from the one or more candidate points. For example, the target point may be a center point of a cluster of the one or more candidate points. The one or more candidate points may be displayed on the 2D map. The one or more candidate points may displayed as red color. The processing device may determine the target point from the one or more candidate points. The target point may be displayed as green color different from other candidate points. It should be noted that the display form of the candidate point and the target point may be not intended to limit.

In some embodiments, the processing device may display, on the 2D map adjustment information between the candidate point and the target point. The adjustment information may include an adjustment angle and an adjustment amplitude. The candidate point may be adjusted to the target point based on the adjustment information. For example, the candidate point may be adjusted based on the adjustment angle and/or the adjustment amplitude.

FIG. 9is a flowchart illustrating an exemplary process for generating a 2D map according to some embodiments of the present disclosure.

In902, the processing device may receive a click instruction on an auxiliary tool. Specifically, the processing device receives the click instruction on the user interface (UI) of the auxiliary tool. The auxiliary tool may be a software or an application for controlling the imaging system.

In904, in response to the click instruction, the processing device may obtain coordinates of a third dimension and a first dimension or a second dimension corresponding to space positions of a plurality of pairs of markers. The space position may be represented as a 3-dimension coordinate (X, Y, Z). In some embodiments, if the first localization image and the second localization image are the images of the X-Y coordinate plane, the processing device may extract the coordinate of the first dimension (e.g., X coordinate) or the second dimension (e.g., Y coordinate) of the space position, and extract the third dimension (e.g., Z coordinate) of the space position. In some embodiments, if the first localization image and the second localization image are the images of the X-Z coordinate plane, the processing device may extract the coordinate of the first dimension (e.g., X coordinate) or the second dimension (e.g., Z coordinate) of the space position, and extract the third dimension (e.g., Y coordinate) of the space position. In some embodiments, if the first localization image and the second localization image are the images of the Y-Z coordinate plane, the processing device may extract the coordinate of the first dimension (e.g., Y coordinate) or the second dimension (e.g., Z coordinate) of the space position, and extract the coordinate of third dimension (e.g., X coordinate) of the space position.

In906, the processing device may generate a 2D map based on the extracted coordinates of the third dimension and the first dimension or the second dimension. For example, the processing device may construct the 2D map based on the Z coordinate and X coordinate or Y coordinate of each space position. The 2D map may represent position distributions regarding X-Z coordinate plane or Y-Z coordinate plane. As another example, the processing device may construct the 2D map based on the Y coordinate and X coordinate or Z coordinate of each space position. The 2D map may represent position distributions regarding X-Y coordinate plane or Y-Z coordinate plane. As a further example, the processing device may construct the 2D map based on the X coordinate and Y coordinate or Z coordinate of each space position. The 2D map may represent position distributions regarding X-Y coordinate plane or X-Z coordinate plane.

In some embodiments, a non-transitory computer readable medium may be provided as one embodiment of the present disclosure. The non-transitory computer readable medium may comprise at least one set of instructions for determining a target point for a needle biopsy. When executed by one or more processors of a computing device, the at least one set of instructions causes the computing device to perform one or more operations as follows. The one or more processors may obtain a first localization image and a second localization image regarding a region of interest (ROI) of a subject. The one or more processors may label a plurality of pairs of markers for the ROI on the first localization image and the second localization image. The one or more processors may generate visualized data regarding the ROI based on the space positions of the plurality of pairs of markers. The one or more processors may determine the target point for the needle biopsy based on the visualized data. The target point may be designated as a sampling location of the needle biopsy. At the location of the target point, some sample cells or tissues may be extracted by the needle biopsy device. The target point for the needle biopsy may be accurately determined based on the 3D model or the 2D map, which may improve the diagnosis efficiency for some diseases (e.g., the breast disease).