Patent Description:
<CIT> discloses a system and method for generating a three-dimensional visualization image of an object such as an organ using volume visualization techniques and exploring the image using a guided navigation system which allows the operator to travel along a flight path and to adjust the view to a particular portion of the image of interest in order, for example, to identify polyps, cysts or other abnormal features in the visualized organ. An electronic biopsy can also be performed on an identified growth or mass in the visualized object. Virtual colonoscopy can be enhanced by electronically removing residual stool, fluid and non-colonic tissue from the image of the colon, by employing bowel preparation followed by image segmentation operations. Methods are also employed for virtually expanding regions of colon collapse using image segmentation results.

Colorectal cancer is a type of cancer that affects colon and rectum. This can occur in young adults and teenagers, but incidences of colorectal cancers are mostly seen in people after the age of <NUM> years. Computed tomography colonography (CTC) is a potential screening technique for colorectal cancer. CTC is a virtual colonoscopy method to examine the large intestine for cancer and growths such as polyps. CTC has a greater acceptability over other contemporary methods of screening for colorectal cancer such as optical colonography, blood testing methods, etc. However, in multiple instances of CTC, analysis may remain incomplete or inaccurate. This may be due to insufficient patient preparation resulting in incomplete colonography scans. In such cases, the patient may have to undergo scanning procedure for a second time. This increases the increased exposure to radiation, affecting the health of the patient. Alternatively, the patient may have to undergo colonoscopy to detect the abnormalities in the colon which has an underlying risk of damage to the colon of the patient.

Currently, there is no way reducing the risk of radiation exposure to patients in case of an incomplete colonography procedure. Therefore, there is a need for a method and system which enables effective visualization of the colon using computed tomography colonography such that medical image obtained at the first instance can be effectively utilized.

The object of the invention is therefore to provide a method, device and system that enables accurate visualization of the colon of a patient.

The invention achieves the object by a method of visualization of a colon of a patient. The method comprises receiving a medical image suitable for virtual colonoscopy of the patient. The medical image may be received from a medical imaging device. The medical imaging device may include, for example, but not limited to, a computed tomography device, X-ray imaging device, etc. For example, the medical imaging device may be a computed tomography device configured to for colonography or virtual colonoscopy. The medical image may be three-dimensional and/or related to a volume. The imaging plane and/or the volume may be a part of a patient body. The imaging plane and/or the volume may include one or more objects associated with a patient. The objects may be in particular one or more body parts associated with the patient that may have been imaged. The objects may include, but not be limited to, one or more imaged organs, tissues, skeletal information, associated with the patient. For example, the object may be a colon of the patient. The medical image may, for example, be in the form of an array of voxels or voxels. Such arrays of voxels or voxels may be representative of intensity, absorption or other parameter as a function of three-dimensional position, and may, for example, be obtained by suitable processing of measurement signals obtained by one or more of the above-mentioned medical imaging devices. In particular, the medical image includes information associated with the colon of the patient.

The method further comprises identifying from the medical image a diameter of the colon. The diameter of the colon may be defined as a distance between two points on parallel walls of the colon such that a line drawn between the two points passes through a center of the colon. The method further comprises determining if the diameter of the colon is less than a pre-defined threshold. The pre-defined threshold may be a minimum value associated with the diameter of the colon required for accurate visualization of the colon. For example, if the diameter of the colon is below the pre-defined threshold, visualization of the colon, particularly the interior of the colon, may be difficult. In an embodiment, the pre-defined threshold associated with the diameter of the colon in the medical image may be in a range between <NUM> and <NUM>. The method further comprises adjusting one or more voxels associated with the colon in the medical image. The one or more voxels are adjusted if the diameter of the colon is less than the pre-defined threshold. The one or more voxels associated with the colon are adjusted such that the diameter of the colon is equal to or greater than the pre-defined threshold. In an embodiment, the one or more voxels to be adjusted lie in an inner surface of the colon in the medical image. Advantageously, the method enables effective visualization of the colon in the medical image. The method enables expansion of the colon such that an abnormality in the colon can be observed easily. Yet another advantage of the invention is that a need for second round of imaging of the patient is avoided. Therefore, patient's exposure to radiation is reduced.

According to an embodiment, identifying from the medical image the diameter of the colon comprises identifying a centerline associated with the colon in the medical image. The centerline is a line that falls within an exact center of the colon.

Therefore, the centerline lies parallel to the walls of the colon. The method further includes determining a first center of curvature on a first wall of the colon in the medical image. The center of curvature is a point that is at a distance from the curve equal to a radius of curvature lying on a normal vector. The method comprises determining a second center of curvature on a second wall of the colon in the medical image. Therefore, the first wall and the second wall of the colon are parallel to each other. Thus, the first point of curvature and the second point of curvature lie opposite to each other in a tubular structure of the colon. The method further comprises defining a diameter of the colon based on the first center of curvature and the second center of curvature. The diameter includes the first and the second points of curvature at either end points of the diameter. Therefore, when a line is drawn between the first center of curvature and the second center of curvature, the line passes through the centerline of the colon in the medical image. Advantageously, determining the diameter of the colon enables accurate mapping of the diameter with the pre-defined threshold associated with the diameter of the colon.

According to a further embodiment, the first wall of the colon and the second wall of the colon form a part of the inner surface of the colon. The colon has an outer surface and an inner surface. The inner surface of the colon forms the interior of the colon and the outer surface of the colon forms the exterior of the colon. Therefore, adjustment of the one or more voxels associated with the colon is performed on the inner surface of the colon in the medical image.

According to an embodiment, determining if the diameter of the colon is less than the pre-defined threshold comprises positioning a virtual sphere on the centerline of the colon in the medical image. The virtual sphere may be a sphere of reference having a diameter identical to that of a pre-defined threshold diameter of the colon. In an embodiment, the virtual sphere is movable along the centerline of the colon. The virtual sphere enables determining the actual diameter of the colon in the medical image. In a further embodiment, the virtual sphere may not touch the inner surface of the colon. The method further comprises moving the virtual sphere along the centerline of the colon in the medical image. During the movement of the virtual sphere a determination is made if the virtual sphere touches the inner surface of the colon. If the virtual sphere does not touch the inner surface of the colon in the medical image, the diameter of the colon is above or equal to the pre-defined threshold. However, if the virtual sphere touches the inner surface of the colon in the medical image, the diameter of the colon may be less than the pre-defined threshold associated with the diameter of the colon. The method further comprises determining at least one location in the colon where the diameter of the colon is less than the pre-defined threshold, based on whether the virtual sphere touches the inner surface of the colon in the medical image. Advantageously, the invention enables accurate identification of regions in the colon where the diameter of the colon does not meet the pre-defined threshold value.

According to an embodiment, adjusting the one or more voxels associated with the colon in the medical image comprises displacing the one or more voxels associated with the colon in the medical image based on the diameter of the virtual sphere. The one or more voxels in the inner surface of the colon may be displaced according to the diameter of the virtual sphere. Therefore, the colon in the medical image achieves a diameter similar or identical to that of the virtual sphere. In an embodiment, displacement of the voxels in the inner surface of the colon may also cause a proportionate displacement of voxels on the outer surface of the colon. Therefore, the diameter of the colon may be increased proportionately without causing a distortion in the medical image of the colon. The method further comprises generating a modified medical image comprising the displaced one or more voxels associated with the colon. The modified medical image includes a colon having a diameter equal to or greater than the pre-defined threshold associated with the diameter of the colon. Advantageously, the invention enables effective visualization of the colon by generating a modified medical image comprising a colon having a diameter meeting the pre-defined threshold. Therefore, multiple rounds of imaging to accurately visualize the colon is avoided.

The object of the invention is also achieved by a medical imaging device for visualizing a colon associated with a patient. The device comprises one or more processing units, a scanner unit configured to capture one or more medical images and a memory coupled to the one or more processing units. The memory comprises a image processing module configured to perform the method steps as described above.

The invention relates in another aspect to a system for visualizing a colon associated with a patient. According to an embodiment, the system includes one or more one or more servers and a medical imaging device coupled to the one or more servers. The one or more servers comprise instructions, which when executed causes the one or more servers to perform the method steps as described above.

The invention relates in one aspect to a computer program product comprising a computer program, the computer program being loadable into a storage unit of a system, including program code sections to make the system execute the method according to an aspect of the invention when the computer program is executed in the system.

The invention relates in one aspect to a computer-readable medium, on which program code sections of a computer program are saved, the program code sections being loadable into and/or executable in a system to make the system execute the method according to an aspect of the invention when the program code sections are executed in the system.

The realization of the invention by a computer program product and/or a computer-readable medium has the advantage that already existing management systems can be easily adopted by software updates in order to work as proposed by the invention.

The computer program product can be, for example, a computer program or comprise another element apart from the computer program. This other element can be hardware, for example a memory device, on which the computer program is stored, a hardware key for using the computer program and the like, and/or software, for example a documentation or a software key for using the computer program.

<FIG> provides an illustration of a block diagram of a client-server architecture that is a geometric modelling of components representing different parts of real-world objects, according to an embodiment. The client-server architecture <NUM> includes a server <NUM> and a plurality of client devices 107A-N. Each of the client device 107A-N is connected to the server <NUM> via a network <NUM>, for example, local area network (LAN), wide area network (WAN), WiFi, etc. In one embodiment, the server <NUM> is deployed in a cloud computing environment. As used herein, "cloud computing environment" refers to a processing environment comprising configurable computing physical and logical resources, for example, networks, servers, storage, applications, services, etc., and data distributed over the network <NUM>, for example, the internet. The cloud computing environment provides on-demand network access to a shared pool of the configurable computing physical and logical resources. The server <NUM> may include a medical database <NUM> that comprises medical images and associated medical data related to a plurality of patients that is maintained by a healthcare service provider. The server <NUM> may include an image processing module <NUM> that is configured to visualize a colon of a patient. Additionally, the server <NUM> may include a network interface <NUM> for communicating with the client device 107A-N via the network <NUM>.

The client device 107A-N are user devices, used by users, for example, a medical personnel such as a radiologist, pathologist, physician, etc. In an embodiment, the user device 107A-N may be used by the user to receive data associated with the patient. The data can be accessed by the user via a graphical user interface of an end user web application on the user device 107A-N. In another embodiment, a request may be sent to the server <NUM> to access the data associated with the patient via the network <NUM>. An imaging unit <NUM> may be connected to the server <NUM> through the network <NUM>. The unit <NUM> may be a medical imaging unit <NUM> capable of acquiring a plurality of medical images. The medical imaging unit <NUM> may be, for example, a scanner unit such as a computed tomography imaging unit, an X-ray imaging unit, etc..

<FIG> is a block diagram of a data processing system <NUM> in which an embodiment can be implemented, for example, as a system <NUM> for visualizing a colon of a patient, configured to perform the processes as described therein. It is appreciated that the server <NUM> is an exemplary implementation of the system in <FIG>. In <FIG>, said data processing system <NUM> comprises a processing unit <NUM>, a memory <NUM>, a storage unit <NUM>, an input unit <NUM>, an output unit <NUM>, a bus <NUM>, and a network interface <NUM>.

The processing unit <NUM>, as used herein, means any type of computational circuit, such as, but not limited to, a microprocessor, microcontroller, complex instruction set computing microprocessor, reduced instruction set computing microprocessor, very long instruction word microprocessor, explicitly parallel instruction computing microprocessor, graphics processor, digital signal processor, or any other type of processing circuit. The processing unit <NUM> may also include embedded controllers, such as generic or programmable logic devices or arrays, application specific integrated circuits, single-chip computers, and the like.

The memory <NUM> may be volatile memory and non-volatile memory. The memory <NUM> may be coupled for communication with said processing unit <NUM>. The processing unit <NUM> may execute instructions and/or code stored in the memory <NUM>. A variety of computer-readable storage media may be stored in and accessed from said memory <NUM>. The memory <NUM> may include any suitable elements for storing data and machine-readable instructions, such as read only memory, random access memory, erasable programmable read only memory, electrically erasable programmable read only memory, a hard drive, a removable media drive for handling compact disks, digital video disks, diskettes, magnetic tape cartridges, memory cards, and the like. In the present embodiment, the memory <NUM> includes an image processing module <NUM> stored in the form of machine-readable instructions on any of said above-mentioned storage media and may be in communication to and executed by processor <NUM>. When executed by the processor <NUM>, the image processing module <NUM> causes the processor <NUM> to process a medical image to visualize a colon of a patient. Method steps executed by the processor <NUM> to achieve the abovementioned functionality are elaborated upon in detail in <FIG>, <FIG>, <FIG>,and <FIG>.

The storage unit <NUM> may be a non-transitory storage medium which stores a medical database <NUM>. The medical database <NUM> is a repository of medical images and associated medical data sets related to one or more patients that is maintained by a healthcare service provider. The input unit <NUM> may include input means such as keypad, touch-sensitive display, camera (such as a camera receiving gesture-based inputs), etc. capable of receiving input signal such as a medical image. The bus <NUM> acts as interconnect between the processor <NUM>, the memory <NUM>, the storage unit <NUM>, the input unit <NUM>, the output unit <NUM> and the network interface <NUM>.

Those of ordinary skilled in the art will appreciate that said hardware depicted in <FIG> may vary for particular implementations. For example, other peripheral devices such as an optical disk drive and the like, Local Area Network (LAN)/ Wide Area Network (WAN)/ Wireless (e.g., Wi-Fi) adapter, graphics adapter, disk controller, input/output (I/O) adapter also may be used in addition or in place of the hardware depicted. Said depicted example is provided for the purpose of explanation only and is not meant to imply architectural limitations with respect to the present disclosure.

A data processing system <NUM> in accordance with an embodiment of the present disclosure includes an operating system employing a graphical user interface. Said operating system permits multiple display windows to be presented in the graphical user interface simultaneously with each display window providing an interface to a different application or to a different instance of the same application. A cursor in said graphical user interface may be manipulated by a user through a pointing device. The position of the cursor may be changed and/or an event such as clicking a mouse button, generated to actuate a desired response.

One of various commercial operating systems, such as a version of Microsoft Windows™, a product of Microsoft Corporation located in Redmond, Washington may be employed if suitably modified. Said operating system is modified or created in accordance with the present disclosure as described.

Disclosed embodiments provide systems and methods for processing medical images. In particular, the systems and methods may enable visualization of a colon of a patient.

<FIG> illustrates a flowchart of a method <NUM> of visualizing a colon of a patient. At step <NUM>, a medical image data associated with the colon of the patient is received. The medical image may be received from a medical imaging unit such as an X-ray imaging unit, or a computed tomography imaging unit,. Alternatively, the medical image may be received from the medical database <NUM>. The medical image may include one or more objects associated with the patient. The objects may be one or more body parts associated with the patient. In the present embodiment, the imaged object may include the colon of the patient. At step <NUM>, a diameter of the colon is identified from the medical image. The diameter of the colon may be the longest distance between two points of curvature on parallel walls of the colon. The method steps for identifying the diameter of the colon are described in further detail in <FIG>. At step <NUM>, it is determined if the diameter of the colon is less than a pre-defined threshold associated with the diameter of the colon. In an embodiment, the pre-defined threshold associated with the diameter of the colon may be the minimum range of diameter that the colon should be to accurately visualize the colon. The accurate visualization may enable a physician to analyze the colon for abnormalities without the need for a repeat medical scan. For example, the pre-defined threshold associated with the diameter of the colon may be a range of <NUM> and <NUM>. The diameter of the colon in the medical image may be determined at regular distance intervals. For example, the diameter of the colon may be measured at every <NUM> distance in the colon. This enables effective identification of location(s) in the colon which may have a diameter lesser than the pre-defined threshold.

At step <NUM>, if the diameter of the colon in the medical image is less than the pre-defined threshold at a given location in the colon, one or more voxels associated with the colon in the medical image is adjusted. For example, the one or more voxels associated with the colon may be displaced such that the diameter of the colon in the given location meets the pre-defined threshold. In an embodiment, the one or more voxels associated with the colon may be located in an inner surface of the colon in the medical image. Therefore, the voxels may be displaced such that any medical information associated with the colon is not lost. Adjustment/displacement of the one or more voxels associated with the colon in the medical image may include addition of new voxel information in the medical image. For example, new voxel information may be added to the medical image using image interpolation algorithms. The image interpolation algorithms generate new voxel information based on an approximation of values associated with surrounding voxels in the medical image. In a further embodiment, the displacement of voxels associated with the inner surface of the colon may be performed such that voxels associated with the outer surface of the colon is also displaced appropriately. Therefore, distortion of the colon in the medical image is avoided. For example, the displacement of the outer surface of the colon at the given location may be performed such that the outer surface of the colon positions in line with another location in the colon which has a diameter equal to that of the pre-defined threshold. At step <NUM>, a modified medical image is generated which includes the displaced one or more voxels associated with the colon and the additional voxel information generated by the interpolation algorithms. Therefore, the modified medical image includes a colon which may have a diameter equal to or greater than the pre-defined threshold.

<FIG> illustrates a flowchart of a method <NUM> of identifying the diameter of the colon in the medical image, according to an embodiment of the invention. At step <NUM>, a centerline associated with the colon is identified in the medical image. The centerline may be a line passing through a center point of the colon in the medical image. The center point may be a point at the core of the colon which is equidistant from the parallel walls of the colon. For example, an edge detection algorithm may be used to identify the inner surfaces of the colon, i.e. the parallel walls of the colon. The edge detection algorithm may identify the walls of the colon based on the voxel information associated with the walls of the colon. The distance between the walls of the colon may be determined and the centerline may be defined which may be equidistance to both the walls of the colon in the medical image. At step <NUM>, a first center of curvature is determined on a first wall of the colon in the medical image. The first wall may be one of the two parallel walls of the colon in the medical image. The center of curvature may be a point in the curve of the first wall of the colon which is at a distance equal to the radius of the curvature of the colon. At step <NUM>, a second center of curvature is determined on a second wall of the colon in the medical image. The second wall of the colon may be the second of the two parallel walls of the colon. In an embodiment, the second center of curvature may lie exactly opposite to the first center of curvature on the first wall of the colon. At step <NUM>, the diameter of the colon is defined using the first center of curvature and the second center of curvature. Therefore, the first and the second center of curvature lie at opposite ends of the diameter and a line between the first and the second center of curvature passes through the centerline of the colon in the medical image.

<FIG> illustrates a method <NUM> of determining if the diameter of the colon is less than the pre-defined threshold, according to an embodiment of the invention. At step <NUM>, a virtual sphere is positioned on the centerline of the colon in the medical image. A virtual sphere is virtual reference marker using which the diameter of the colon in the medical image may be determined. The virtual sphere may have a diameter equivalent to the pre-defined threshold for the diameter of the colon in the medical image. In an embodiment, the virtual sphere may be positioned at a point of entry of the colon in the medical image. For example, the virtual sphere may be positioned at a location in the medical image which represents a rectum of the patient. The virtual sphere may not touch the inner surface of the colon in the medical image. In a further embodiment, the virtual sphere is movable and at step <NUM>, the virtual sphere is moved along the centerline of the colon in the medical image. As the virtual sphere moves along the centerline, it is determined if the virtual sphere comes in contact with the inner surface of the colon, at step <NUM>. For example, the virtual sphere may have an outline which may come in contact with the inner surface of the colon in the medical image if the diameter of the colon is lesser than the pre-defined threshold. At step <NUM>, a location at which the diameter of the colon is less than the pre-defined threshold is determined based on the virtual sphere coming in contact with the inner surface of the colon in the medical image. In an embodiment, one or more such locations may be identified in the medical image where the diameter of the colon is less than the pre-defined threshold.

<FIG> illustrates an exemplary embodiment of implementation <NUM> of a method of visualizing a colon, associated with a patient. Illustration <NUM> includes a colon <NUM> having an inner surface <NUM> and an outer surface <NUM>. A centerline <NUM> is defined in the colon <NUM> which is a line running parallel to the walls of the colon <NUM> and is equidistant to the walls of the colon <NUM>. A virtual sphere <NUM> is placed at an entry point of the colon <NUM>. In an embodiment, the virtual sphere <NUM> may depict a minimum range (represented by a solid lined sphere) and a maximum range (represented by a dotted lined sphere). The arrow marks along the centerline <NUM> depict the direction in which the virtual sphere <NUM> may move. The colon <NUM> may include a narrow obstruction <NUM> which may require expansion. The narrow obstruction <NUM> may have a diameter less than the pre-defined threshold associated with the diameter. The maximum range of the virtual sphere <NUM> represents the pre-defined threshold value of diameter that the colon <NUM> should have.

Illustration <NUM> depicts movement of the virtual sphere <NUM> along the centerline <NUM> of the colon <NUM>. As the virtual sphere <NUM> moves, there may be a possibility of the virtual sphere <NUM> coming in contact with the inner surface <NUM> of the colon <NUM>. For example, the virtual sphere <NUM> may come in contact with the inner surface <NUM> of the colon <NUM> at the narrow obstruction <NUM>. Illustration <NUM> depicts displacement <NUM> of one or voxels associated with the inner surface <NUM> of the colon <NUM>. The arrows depict the direction in which the voxels may be displaced.

The displacement of the voxels may cause an expansion of the narrow obstruction <NUM> portion of the colon <NUM> resulting in better visualization of the colon. In an embodiment, the displacement of the voxels may be such that the voxels fit the surface of the virtual sphere <NUM>. In a further embodiment, the virtual sphere <NUM> may be moved along the centerline <NUM> of the colon <NUM> to displace the voxels of the inner surface <NUM> of the colon, until a an acceptable size of colon <NUM> is generated in the medical image.

The advantage of the invention is that the need for the patient to undergo frequent medical scanning processes is avoided. Therefore, over-exposure of the patient to radiation is avoided. Furthermore, time required to prepare a patient for medical scanning process and to plan next steps of treatment is reduced. Additionally, frequent inflation of colon for colonography procedure is avoided.

Claim 1:
A method (<NUM>) of visualizing a colon of a patient, the method comprising computer implemented steps of:
receiving a medical image suitable for virtual colonoscopy of the patient;
identifying from the medical image a diameter of the colon (<NUM>);
determining if the diameter of the colon (<NUM>) is less than a pre-defined threshold; and
adjusting one or more voxels associated with the colon (<NUM>) in the medical image, if the diameter of the colon (<NUM>) is less than the pre-defined threshold, wherein the one or more voxels are adjusted such that the diameter of the colon (<NUM>) in the medical image is equal to or greater than the pre-defined threshold.