Patent ID: 12205251

It should be appreciated by those skilled in the art that any block diagrams herein represent conceptual views of illustrative systems embodying the principles of the present subject matter. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudo code, and the like represent various processes which may be substantially represented in computer readable medium and executed by a computer or processor, whether or not such computer or processor is explicitly shown.

DETAILED DESCRIPTION OF EMBODIMENTS

In the present document, the word “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any embodiment or implementation of the present subject matter described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

While the disclosure is susceptible to various modifications and alternative forms, specific embodiment thereof has been shown by way of example in the drawings and will be described in detail below. It should be understood, however that it is not intended to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternative falling within the scope of the disclosure.

The terms “comprises”, “comprising”, or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a setup, device or method that comprises a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus proceeded by “comprises . . . a” does not, without more constraints, preclude the existence of other elements or additional elements in the system or apparatus.

Embodiments of the present disclosure relate to normalizing pixel intensity values of images. Qualitative images which have to be compared need to have actual pixel intensity values in a suitable range. The ‘actual’ pixel intensity values for an image may be considered to be the intensity values that are generated and/or stored in image data for the image. For example, the actual pixel intensity values may form part of or be stored in digital image data, such as DICOM (Digital Imaging and Communications in Medicine) image data. Generally, the qualitative images to be compared are made to appear visually similar by adjusting display settings. Thus, the images appear visually similar because the displayed pixel intensities are the same or similar. Using the relation between display settings of the qualitative images, the present disclosure normalizes pixel intensity values of the qualitative images, for enabling comparison of the images by any image processing apparatus.

FIG.1is an illustration of a block diagram of a system (100) for normalizing pixel intensities of images, in accordance with some embodiments of the present disclosure. As shown inFIG.1, the system (100) comprises an imaging unit (102), two images, viz., a first image (Ia) (105) and a second image (Ib) (106) input to an image processing apparatus (101), a subject (103) and a display unit (104). In an embodiment, the imaging unit (102) can be a camera, a Magnetic Resonance Imaging (MRI) device, a Computed Tomography (CT) device or any other device capable of imaging a patient (104). The first image and the second image are further denoted without part number for simplicity. However, it should be apparent to a person skilled in the art that the part numbers (105and106) inFIG.1refers to the first image and the second image respectively. In one embodiment, the first image (Ia) and the second image (Ib) which appear visually similar to a radiologist/lab technician may be captured by a same imaging unit. In one embodiment, the first image (Ia) and the second image (Ib) which appear visually similar to a radiologist/lab technician may be captured using different imaging units. In a further embodiment, the first image (Ia) and the second image (Ib) may be captured by different imaging units of a similar/same modality. For example, the first image (Ia) may be captured using a first MRI scanner and the second image (Ib) may be captured using a second MRI scanner. In another embodiment, the first image (Ia) and the second image (Ib) may be captured by different imaging units of different modality. For example, the first image (Ia) may be captured using an MRI scanner and the second image (Ib) may be captured using a CT scanner. In such a case, parameters of the MRI scanner may be adjusted such that the first image (Ia) captured using the MRI scanner appears visually similar/same as the second image (Ib) captured by the CT scanner. In one embodiment, the first image (Ia) and the second image (Ib) are captured at different time. In one embodiment, when the imaging unit (102) is a camera, the first image (Ia) and the second image (Ib) may represent for example skin of the subject (103), an eye of the subject (103), and the like. In one embodiment, when the imaging unit (102) is the MRI device, the first image (Ia) and the second image (Ib) may represent for example an organ of the subject (103), tissue of the subject (103) and bones of the subject (103). In one embodiment, when the imaging unit (102) is the CT device, the first image (Ia) and the second image (Ib) may represent for example an organ of the subject (103), tissue of the subject (103) and bones of the subject (103), blood vessels of the subject (103).

In an embodiment, the first image (Ia) and the second image (Ib) may represent a same area/point of an object. In an embodiment the first image (Ia) and the second image (Ib) may represent a region of a subject, such as a tissue of the subject, an organ of the subject. In an embodiment, pixel intensity values (Xa) of the first image (Ia) and pixel intensity values (Xb) the second image (Ib) may be different while the first image (Ia) and the second image (Ib) appear visually similar on a display unit (104). In an embodiment, the images may appear similar for a user/laboratory technician viewing the first image (Ia) and the second image (Ib) on the display unit (104) as a result of combination of the actual pixel intensities and one or more contrast and illumination parameters of the object in the first image (Ia) and second image (Ib). In an embodiment, displayed pixel intensity values (Ya) of the first image (Ia) is equal to displayed pixel intensity values (Yb) of the second image (Ib). In a further embodiment, the displayed pixel intensity values (Ya) and (Yb) are received by the image processing apparatus from the display unit (104).

In an embodiment, the displayed pixel intensity values (Ya) of the first image (Ia) and the displayed pixel intensity values (Yb) of the second image (Ib) vary with respective actual pixel intensity values (Xaand Xb). In some examples, the displayed pixel intensity values of the first image and/or the second image comprise pixel intensity values displayed on the display unit. As used herein, the actual pixel intensity values (Xaand Xb) refer to pixel intensity values generated and/or stored by the image processing apparatus (101). As used herein the displayed pixel intensity values (Yaand Yb) refer to pixel intensity values displayed on the display unit (104). For example, the displayed pixel intensity may comprise the intensities of pixels that an image viewer displays on the display unit (e.g. a monitor), and this may depend on the range of intensities that the image viewer is capable of displaying (e.g. 256 colors ranging from 0: black to 255: white).

In an embodiment, the one or more contrast and illumination parameters of the first image (Ia) and the second image (Ib) may include, but are not limited to, hue, saturation, contrast, brightness, Gamma, and combination thereof. In some embodiments, one or more illumination parameters may comprise an illuminance (e.g. an illuminance measured in terms of HSI (hue, saturation, intensity), HSL (hue, saturation, lightness) and HSV (hue, saturation, value) or HSB (hue, saturation, brightness)). In other embodiments, the one or more contrast and illumination parameters may comprise parameters other than those mentioned herein. In general, the one or more contrast and illumination parameters may comprise any suitable contrast and illumination parameters that can be normalized and used to determine normalized pixel intensity values of images.

In an embodiment, the imaging unit (102) may communicate with the image processing apparatus (101) through a communication network (not shown). The imaging unit (102) may be disposed in communication with the communication network via a network interface (not shown). The network interface may employ connection protocols including, without limitation, direct connect, Ethernet (e.g., twisted pair 10/100/1000 Base T), transmission control protocol/Internet protocol (TCP/IP), token ring, IEEE 802.11a/b/g/n/x, etc. The communication network may include, without limitation, a direct interconnection, wired connection, e-commerce network, a peer to peer (P2P) network, Local Area Network (LAN), Wide Area Network (WAN), wireless network (e.g., using Wireless Application Protocol (WAP)), the Internet, Wireless Fidelity (Wi-Fi), etc.

In an embodiment, the image processing apparatus (101) generates normalizes the actual pixel intensity values (Xaor Xb) for enabling meaningful comparison between the first and the second image (Iaand Ib). The normalized pixel intensity values may inherently form a normalized image (Ia′ or Ib′) (107). Further explanation is provided without referring to part number (107). However, it should be apparent to a person of ordinary skill that the part number (107) refers to normalized image (Ia′ or Ib′).

FIG.2is an exemplary illustration of internal structure of an image processing apparatus (101) configured to normalize pixel intensities of images, in accordance with some embodiments of the present disclosure. The image processing apparatus (101) may include at least one Central Processing Unit (“CPU” or “processor”) (203) and a memory (202) storing instructions executable by the at least one processor (203). The processor (203) may comprise at least one data processor for executing program components for executing user or system-generated requests. The memory (202) is communicatively coupled to the processor (203). The image processing apparatus (101) further comprises an Input/Output (I/O) interface (201). The I/O interface (201) is coupled with the processor (203) through which an input signal or/and an output signal is communicated.

In an embodiment, data (204) may be stored within the memory (202). The data (204) may include, for example, contrast and illumination parameters (205), displayed pixel intensity value (206) and other data (207).

In an embodiment, the contrast and illumination parameters (205) may include but not limited to hue, saturation, contrast, brightness, Gamma, or combinations thereof.

In an embodiment, the highest displayed pixel intensity value (206) (herein denoted as G) may be the highest pixel intensity value displayed on the display unit (104). In an embodiment, the highest displayed pixel intensity (G) may vary depending on the display unit (104). In an embodiment, the highest displayed pixel intensity (G) may be determined using specification sheet of the display unit (104). In an embodiment, the other data (207) may include parameters related to the imaging unit (102) and a timestamp associated with the first image (Ia) and the second image (Ib).

In an embodiment, the data (204) in the memory (202) is processed by modules (208) of the image processing apparatus (101). As used herein, the term module refers to an Application Specific Integrated Circuit (ASIC), an electronic circuit, a field-programmable gate arrays (FPGA), Programmable System-on-Chip (PSoC), a combinational logic circuit, and/or other suitable components that provide the described functionality. The modules (208) when configured with the functionality defined in the present disclosure will result in a novel hardware.

In one implementation, the modules (208) may include, for example, a communication module (209), a normalized slope determination module (210), a normalized intercept determination module (211), a normalized pixel intensity determination module (212) and other modules (213). It will be appreciated that such aforementioned modules (209) may be represented as a single module or a combination of different modules.

In one embodiment, the communication module (209) may be configured to receive the first image (Ia) and the second image (Ib) from the imaging unit (102) via the communication network. In an embodiment, the communication module (209) may be configured to pre-process the first image (Ia) and the second image (Ib). In an embodiment, pre-processing can include, but is not limited to, image enhancement, noise reduction, image compression, etc. The communication module (209) may further receive actual pixel intensity values (Xa, Xb), the highest displayed pixel intensity value (G), window level values (La, Lb) and window width values (Wa, Wb) of the first image (Ia) and the second image (Ib). In an embodiment, the displayed pixel intensity values (Ya. Yb) may vary linearly with the respective actual pixel intensity values (Xa, Xb).

In an embodiment, the normalized slope determination module (210) may be configured to determine a normalized slope (Mf) based on window width value (Wa, Wb) of the first image (Ia) and the second image (Ib).

In an embodiment, the normalized intercept determination module (211) may be configured to determine a normalized intercept value (Cf) based on, the window level value (La) of the first image (Ia), the window level value (Lb) of the second image (Ib), the window width value (Wa) of the first image (Ia), the window width value (Wb) of the second image (Ib) and the highest displayed pixel intensity value (G).

In an embodiment, the normalized slope value (Mf) and the normalized intercept value (Cf) may be determined to analyse a relationship between displayed pixel intensity values (Ya, Yb) and the actual pixel intensity values (Xa. Xb) of respective images (Ia, Ib).

In an embodiment, functions of the normalized slope determination module (210) and the normalized intercept determination module (211) may be combined and a single module may perform the functions of the normalized slope determination module (210) and the normalized intercept determination module (211). The normalized slope (Mf) and the normalized intercept (Cf) may be together represented as one or more normalized parameters. In some embodiments, the one or more normalized parameters may comprise one or more of: the highest displayed pixel intensity value (G), the window level value (La. Lb) and the window width value (Wa, Wb), of the first image (Ia) and/or of the second image (Ib).

In an embodiment, the normalized pixel intensity determination module (212) is configured to determine normalized pixel intensity values (Xb′) of the second image (Ib) based on the normalized slope (Mf) and the normalized intercept (Cf). In an embodiment, the normalized pixel intensity values (Xb′) may represent the actual pixel intensity values (Xb) of the second image (Ib) in a range comparable with the actual pixel intensity values (Xa) of the first image (Ia). In an embodiment, the normalized pixel intensity values (Xb) is obtained by transforming the actual pixel intensity values (Xb) with respect to the actual pixel intensity values (Xa). In an embodiment, the normalized pixel intensity determination module (212) may determine the normalized pixel intensity values (Xb) using the one or more normalized parameters. In an embodiment, normalized pixel intensity values (Xb′) forms a normalized image (Ib′). The normalized image (Ib′) may be used for meaningful comparison with the first image (Ia).

In an embodiment, the other modules (213) may include a classification module, a labelling module, and a segmentation module.

In an embodiment, the classification module may classify the first image (Ia) and the second image (Ib) into one or more predefined categories. For example, the classification module can be used to classify the first image (Ia) and the second image (Ib) as comprising tumour cells. Likewise, the classification module can classify the first image (Ia) and the second image (Ib) into different categories.

In an embodiment, the segmentation module can be configured to segment the first image (Ia) and the second image (Ib) based on comparison of the second image (Ib) with the first image (Ia). For example, the segmentation module can segment an image of a blood smear based on blood concentration.

In an embodiment, the labelling module can be configured to label the first image (Ia) and the second image (Ib) based on the comparison. For example, the labelling module can label a patch of image as comprising Red Blood Cells (RBCs).

FIG.3is a flowchart illustrating exemplary method steps for normalizing pixel intensities of images, in accordance with some embodiments of the present disclosure.

As illustrated inFIG.3, the method (300) may comprise one or more steps for normalizing pixel intensity of images, in accordance with some embodiments of the present disclosure. The method (300) may be described in the general context of computer executable instructions. Generally, computer executable instructions can include routines, programs, objects, components, data structures, procedures, modules, and functions, which perform particular functions or implement particular abstract data types.

The order in which the method (300) is described is not intended to be construed as a limitation, and any number of the described method blocks can be combined in any order to implement the method. Additionally, individual blocks may be deleted from the methods without departing from the scope of the subject matter described herein. Furthermore, the method can be implemented in any suitable hardware, software, firmware, or combination thereof.

At step301, receiving by the communication module (209), the first image (Ia) and the second image (Ib) from the imaging unit (102). As described herein, the first image (Ia) and the second image (Ib) may be received over the communication network. In an embodiment, the first image (Ia) and the second image (Ib) appear similar. In an embodiment, window settings like window width (Wa, Wb) and window level (La, Lb) are applied on respective images to make the first image (Ia) and the second image (Ib) appear similar. In one embodiment, the window settings are applied by the display unit (104).

At step302, determining by the single module (combination of normalized slope determination module (210) and normalized intercept determination module (211)) one or more normalized parameters for the first image (Ia) and the second image (Ib). A person skilled in the art should appreciate that although not mentioned explicitly, any parameters apart from window parameters may be covered within the scope of this disclosure.

At step303, determining by the normalized pixel intensity determination module (212), normalized pixel intensity values (Xb′) of the second image (Ib) based on the one or more normalized parameters. In an embodiment, the normalized pixel intensity values (Xb′) forms the normalized image (Ib′). The normalized image (Ib′) may have pixel intensity values (Xb′) that lie in a comparable range with the actual pixel intensity values (Xa) of the first image (Ia).

Following description describes the method steps of300in detail. Reference is now made toFIG.4.

At step401, the communication module (209) receives the actual pixel intensity values (Xa. Xb), highest displayed pixel intensity (G), window level value (La, Lb) and window width value (Wa, Wb) for the first and second images (Ia, Ib). In one embodiment, the first and the second images (Ia, Ib) may be captured using different modalities, for example, first image (Ia) is captured using first settings in MRI device and second image (Ia) is captured using second settings in MRI device. In another embodiment, the first and the second images (Ia, Ib) may be images of a same area of a subject/patient but captured at different time. Hence, there may be variations in the first and the second images (Ia, Ib). Window settings (window width and Window level) may be applied on the first and the second images (Ia, Ib) to make the images appear visually similar on the display unit (104). Such images that appear visually similar may be viewed by radiologists/lab technicians to compare the images. In an embodiment, the window width values (Wa, Wb) may indicate contrast settings and window level values (La, Lb) may indicate brightness settings.

For an image I, windowing (window level (L) and window width (W)) is a linear contrast stretching which can be expressed as a linear equation as shown in equation 1:

y=m⁢x+c(1)
where:y=displayed/interpreted pixel intensity of an image displayed under window settings W and L;x=actual pixel intensity of an image;m=slope of the linear equation; andc=intercept;

Thus, for the first image (Ia) and the second image (Ib), the Yaand Ybcan be represented in a form of a linear equation as shown below:

Ya=Ma⁢Xa+Ca(2)Yb=Mb⁢Xb+Cb(3)

At step402, determining by the normalized slope determination module (210) a normalized slope (Mf) based on the window width (Wa, Wb) of the first and the second images (Ia, Ib). In general, a slope can be determined for a linearly varying displayed pixel intensity value (y) with respect to the actual pixel intensity value (x) expressed in equation 1 as follows:

m=G/W(4)andc=-m[W+L/2](5)

Now considering equations, 2 and 3, Ya=Ybas images Iaand Ibappear visually similar. In an embodiment, the second image (Ib) can be transformed to be compared with the first image (Ia). Alternatively, the first image (Ia) can be transformed to be compared with the second image (Ib). For illustration, let us consider that the second image (Ib) is transformed. Hence, Xbcan be represented with respect to Xaas shown:

Ma⁢Xa+Ca=M⁢b⁢Xb+Cb(6)

Substituting for m and c as shown in equations 4 and 5 and upon further solving equations 6, the normalized slope (Mf) is determined using the below equation:

Mf=Wa/Wb(7)

A person skilled in the art should appreciate that when (Ia) is transformed according to (Ib), the Mfcan be determined using Wb/Wa.

While, in some embodiments, transforming the second image with respect to the first image may comprise performing a linear contrast stretching transformation, in some embodiments, the second image may be transformed with respect to the first image in a geometrical representation domain (e.g. using a geometrical transformation), a pixel intensity distribution domain, a Fourier domain, or any other domain.

Reference is now made toFIG.5which shows exemplary images of same area in the images appearing visually similar, in accordance with some embodiments of the present disclosure. As seen, the first image (Ia) and the second images (Ib) appear similar on the display unit (104). Further, from theFIG.5, it can be noted that the first image (Ia) is associated with the widow settings of La=401 and Wa=697 while the second image (Ib) is associated with the window settings of Lb=1219 and Wb=2119. Thus, the window settings are applied on the first and the second images (Ia, Ib) such that the two images appear visually similar/same on the display unit (104). Further, an area (shown by a circular selection) in the first and the second image (Ia, Ib) may be considered by a radiologist/lab technician for comparison.

Table 1a and 1b show exemplary pixel intensity values for the area in the images (Ia, Ib), in accordance with some embodiments of the present disclosure. In an embodiment, for the same area in the first and the second image (Ia, Ib), actual pixel intensity values (Xa, Xb) are shown in Table 1a and Table 1b respectively. As seen, the actual pixel intensity values (Xa, Xb) vary and are not in a common range for comparison. The difference in the actual pixel intensity values (Xa, Xb) can occur due to various reasons as described earlier in the disclosure.

TABLE 1a279.09294.94266.4291.77320.31336.17345.69348.86345.69342.51364.71358.37361.54380.57301.29294.94272.74301.29313.97348.86352.03339.34345.69339.34348.86345.69358.37377.4317.14282.26279.09301.29313.97342.51342.51342.51329.83313.97333345.69355.2367.89294.94294.94288.6294.94310.8320.31342.51342.51323.49326.66342.51348.86345.69361.54269.57323.49317.14304.46313.97329.83364.71352.03339.34348.86345.69358.37342.51352.03294.94313.97307.63313.97317.14345.69364.71352.03339.34336.17352.03364.71352.03342.51307.63291.77291.77323.49317.14348.86358.37361.54348.86339.34377.4361.54348.86333279.09298.11329.83345.69336.17348.86358.37$74.23374.23358.37361.54339.34345.69352.03288.6323.49348.86358.37367.89352.03345.69361.54383.74361.54333323.49355.2390.09333336.17320.31326.66358.37367.89361.54367.89377.4364.71355.2348.86361.54393.26339.34336.17310.8307.63336.17380.57402.77386.91371.06367.89364.71371.06371.06374.23333348.86326.66329.83364.71361.54355.2367.89361.54361.54348.86342.51364.71364.71339.34364.71336.17345.69383.74339.34301.29355.2364.71367.89371.06313.97329.83367.89367.89364.71345.69352.03355.2333329.83371.06374.23364.71380.57339.34320.31364.71367.89345.69336.17367.89361.54333358.37377.4355.2333348.86364.71329.83336.17320.31326.66317.14355.2377.4342.51352.03361.54329.83313.97329.83345.69329.83317.14313.97323.49323.49326.66333348.86355.2355.2345.69336.17336.17329.83326.66342.51352.03323.49352.03345.69301.29323.49352.03339.34361.54358.37345.69336.17323.49342.51336.17323.49374.23383.74323.49310.8333326.66345.69355.2342.51336.17326.66317.14326.66355.2383.74374.23345.69336.17333333339.34336.17333333336.17333371.06386.91371.06342.51342.51348.86336.17339.34326.66313.97329.83326.66329.83336.17371.06355.2320.31326.66333317.14323.49342.51326.66301.29329.83326.66317.14313.97339.34320.31291.77320.31339.34310.8320.31348.86329.83310.8336.17333307.63323.49326.66333333326.66348.86345.69342.51339.34317.14320.31326.66317.14307.63323.49333342.51361.54348.86333342.51339.34329.83326.66310.8288.6285.43317.14301.29355.2326.66320.31355.2326.66304.46301.29323.49345.69320.31291.77279.09307.63301.29358.37326.66304.46329.83317.14298.11294.94298.11317.14342.51336.17288.6266.4294.94339.34323.49313.97320.31307.63329.83339.34310.8317.14323.49320.31291.77247.37275.91329.83288.6320.31348.86323.49348.86339.34336.17339.34279.09269.57288.6266.4285.43326.66272.74333352.03307.63313.97285.43294.9430129260.06260.06266.4275.91298.11320.31288.6317.14304.46288.6288.6272.74269.57269.57260.06260.06247.37269.57298.11294.94291.77291.77279.09310.8313.97294.94285.43294.94279.09253.71247.37269.57285.43

TABLE 1b0.17813,322779,897869.029857.8871002.7251047.291947.018835,604779,897768,756846,746880.171002.7251013.867947,018746,473768,756835,604846,746846,746913,594991.5841002.725724.19880.17913.594902,453880.17958.161047.2911058.432846,746947,018846,746913.594980,4421013.8671047.2911036.149980,442857,887735,332846,746958.16980,4421058,4321002.725980,442768,756768.756869.029913.594991,5841080.7151036.149924,736835,604891.311924,7361002.7251069,5741058,4321058,432880.17891.311913,594902.4531036.1491080.7151002.7251058,432891.311880.17869.029880.17980,4421025.008980,4421013.867924,736913,594880.17958.16980,4421025.0081036.149935,877935.877991.584969.301958.161025.0081069.5741069.574947.018958.16980,4421013.867924,736991.5841091.8561058,4321002.725991,584947,0181002.725958.16991,5841125.2811080.7151013.867991,584969.3011013.867980,4421036.1491147.5631125.2811125.281969.3011002.7251025,0081002.725991.5841069,5741158.7051158.7051036.1491036.149947,0181036.149980.4421025.0081180.9881025.0081080.7151047.291924,7361058,4321147.5631091.8561058,4321069.5741047.2911036.1491013.8671058,4321169,8461080.7151002.7251214,4121058.4321058.4321102.9981013.867947.0181069.5741114.1391114.1391091.8561058,4321125.281969.301924,7361114.1391091.856958.161047.2911002.7251036.149991,5841080.7151069.574935.8771013,8671047.2911047.291991.5841025.0081102.9981002.7251002.7251158.7051069.5741102.9981091.8561036.1491069.5741125.2811125.2811147,5631069.5741013.8671125.2811058,4321158.7051180.988047.2911058,4321036.149913.5941047.2911114.1391158.7051036.149947.0181058,432969.301924.7361047.2911114.1391069.574991.584947,0181047,2911047.291991.5841091.8561058,4321025.0081047.2911025,0081047.2911180.9881047.2911114.1391091.8561047.2911058,4321080.7151136,4221125.2811058,4321136.4221180.9881102.9981091.8561114,1391192.1291069.5741091.8561180.9881136,4221047.2911136,4221114,1391136,4221136,4221125.2811147.5631080.715958.161080.7151158.7051147,5631136,4221091.8561058.4321102.9981002.7251080.7151158.7051147,563980.442991.584980,4421080.7151102.998991.584991.5841025.008991.5841058.4321102.998958.161058,4321069.5741036.1491047.2911036.1491013.8671114.1391025.0081013.8671069.574935.877958.161036.149969.301935,8771036.149958.16857,887913,5941002.7251013.8671002.725991,584969.301969.3011058,4321114.139991.584935.8771047.2911069,5741002.7251002.725991,584958.16958.161036.149891.311891.3111002.7251036.149991.584991.584913.594991.5841047.2911058,4321091.8561002.7251080.7151080.7151091.8561036.1491069.574991.5841102.9981025.0081069.5741080.7151091.856969.3011047.2911058,4321080.7151158.7051114.1391013,8671147,5631169.8461114.1391169.8461058,4321102.9981192.1291180.9881058,4321091.8561069.5741114.1391147,5631102.9981036.1491013,8671036.1491080.7151136.4221013.8671047.2911036.149958.161102.9981058,432969.301958.161047.291980,4421102.998969.301969.301891,311980,442924,7361047.291980,442935.877947.018991.584902,4531047.2911036.149947,018969.3011025.0081036.1491080.7151091.8561036.1491025.0081036.1491013.8671091.8561069.5741102.9981180.9881136.422935.8771036.149991.5841102.9981180.9881136,422991,5841025.0081036.1491069.5741058,4321013.867969.3011147.5631125.2811002.7251080.7151036.149935.8771147,5631102.9981058,4321180.9881114.1391025,0081025.0081080.7151136.4221102.9981047.2911036.1491102.9981114,1391013.867947,0181002.7251025.008281.261069.574891.3111002.7251025,008958.161258.977991,584958.161180.9881047.291880.171203.271058,4321036.1491125.2811002.725980,4421236,6951169,8461013.867924,736924,7361069.5

At step403, determining, by the normalized intercept determination module (211), the normalized intercept value (Cf) based on the window level values (La, Lb) the window width values (Wa, Wb) and the highest displayed pixel intensity values (G) of the first and the second images (Ia, Ib). Reference is now made toFIG.6which is a flowchart illustrating exemplary method steps for determining normalized intercept value, in accordance with some embodiments of the present disclosure.

At step601, determining by the normalized intercept determination module (211) a first ratio of window level value (La) to the window width value (Wa) of the first image (Ia). The first ratio can be denoted as:

R⁢1=La/Wa(8)

At step602, determining by the normalized intercept determination module (211) a second ratio of window level value (Lb) to the window width value (Wb) of the second image (Ib). The first ratio can be denoted as:

R⁢2=Lb/Wb(9)

At step603, determining by the normalized intercept determination module (211) a difference between the first ratio (R1) and the second ratio (R2), as shown:

R⁢1-R⁢2=(La/Wa-Lb/Wb)(10)

At step604, determining by the normalized intercept determination module (211) the normalized intercept (Cf) by determining a product of the equation 10 with the highest displayed pixel intensity value (G). The normalized intercept (Cf) can be denoted as:

Cf=G⁡(La/Wa-Lb/Wb)(11)

Referring back toFIG.4, at step404, normalized pixel intensity value determination module (212) the normalized pixel intensity values (Xb′) based on the normalized slope value (Mf) and the normalized intercept value (Cf). The normalized pixel intensity value determination module (212) may use the equations 7 and 11 to transform the (Xb) to (Xb′) as shown below:

Xb′=Mf⁢Xb+Cf(12)

Table 2 shows exemplary normalized pixel intensity values for the area in the second image, with respect to the first image, in accordance with some embodiments of the present disclosure. As shown, the normalized pixel intensity values (Xb′) may be in the range of the actual pixel intensity values (Xa). Therefore, Xacan be compared with Xb′.

TABLE 2289,526267,538256,544285,862282.197329,838344,497311.515274,867256,544252.879278,532289,526329,838333.503311.515245.55252.879274.867278.532278.532300.52326,174329.838238.22289,526300.52296,856289,526315,179344,497348,162278,532311.515278,532300.52322,509333,503344,497340.832322.509282.197241.885278.532315.179322.509348.162329.838322.509252.879252.879285.862300.52326,174355.491340.832304,185274,867293,191304,185329,838351,827348,162348,162289.526293,191300.52296,856340,832355,491329,838348,162293.191289.526285.862289.526322.509337.168322.509333.503304,185300.52289.526315,179322.509337,168340,832307.85307.85326,174318,844315,179337,168351,827351.827311.515315,179322,509333,503304,185326,174359,156348,162329,838326,174311.515329.838315.179326,174370.15355,491333.503326,174318,844333.503322.509340,832377.48370.15370.15318,844329,838337,168329,838326,174351,827381.144381.144340,832340,832311.515340,832322,509337,168388,474337.168355,491344,497304.185348.162377.48359,156348,162351.827344,497340,832333,503348,162384,809355,491329,838399,468348,162348,162362,821333,503311.515351.827366,486366,486359,156348,162370.15318,844304,185366,486359.156315.179344,497329.838340,832326,174355,491351,827307.85333.503344,497344,497326.174337,168362,821329,838329,838381.144351.827362.821359,156340,832351,827370.15370.15377.48351.827333.503370.15348.162381.144388,474344,497348,162340.832300.52344,497366,486381,144340,832311.515348,162318.844304.185344.497366,486351.827326,174311.515344,497344,497326,174359,156348,162337,168344,497337,168344,497388.474344,497366,486359,156344,497348,162355,491373.815370.15348,162373.815388,474362.821359,156366,486392.139351.827359.156388.474373.815344,497373,815366,486373,815373.815370.15377.48355,491315,179355,491381.144377.48322.509326.174322.509355,491362.821326,174326.174337.168326,174348,162362,821315,179348.162351.827340,832344,497340.832333.503366,486337.168333.503351.827307.85315,179340.832318.844307.85340.832315,179282,197300.52329.838333.503329,838326,174318,844318,844348,162366,486326,174307.85344,497351,827329.838329.838326.174315.179315,179340.832293.191293.191329.838340.832326,174326.174300.52326,174344,497348,162359.156329,838355,491355,491359,156340.832351.827326,174362,821337,168351.827355,491359.156318,844344,497348.162355,491381.144366,486333.503377.48384,809366,486384,809348,162362,821392,139388.474348,162359.156351.827366,486377.48362.821340.832333.503340.832355,491373.815333.503344.497340.832315.179362.821348,162318,844315,179344,497322.509362,821318,844318,844293,191322.509304,185344,497322.509307.85311.515326,174296.856344,497340.832311.515318.844337.168340.832355,491359,156340,832337,168340.832333,503359,156351,827362,821388,474373,815307.85340.832326,174362,821388,474373.815326.174337.168340,832351.827348,162333.503318.844377.48370.15329,838355,491340,832307.85377.48362,821348,162388,474366,486337,168337,168355,491373,815362.821344,497340.832362.821366,486333,503311.515329,838337,168421,456351,827293.191329,838337,168315,179414,127326,174315,179388,474344,497289,526395.803348.162340.832370.15329.838322.509

In an embodiment the generated normalized pixel intensity values (Xb′) may represent the normalized image (Ib′) In an embodiment, generating the normalized pixel intensity values (Xb′) may inherently mean generating the normalized image (Ib′). In a further embodiment, the actual pixel intensity values (Xb′) may be similar to the actual pixel intensity values (Xa) of the first image (Ia). Therefore, the present disclosure provides a solution enabling meaningful comparison of images (I) which have different actual pixel intensity values, by normalizing the actual pixel intensity values (X). For example, if images have to be classified or labelled, the images may have to be compared with reference images. The images to be classified or labelled may have pixel intensity values different from the pixel intensity values of the reference images. For the images, normalized pixel intensity values can be generated, and the pixel intensity values of the images may be in the range of the reference images such that meaningful comparisons may be performed to successfully classify/label the images.

In an embodiment, the normalization of actual pixel intensity values (X) provides meaningful comparison. Efficient classification, labelling, segmentation and/or multi-label classification can be performed by meaningful comparison between images. Thus, the normalized image (Ib′) may be compared with the first image (Ia) and the comparison may be used for at least one of image labelling, image classification, image segmentation, and multi-label classification. Multi-label classification will be understood to refer to a type of classification whereby an image may be categorised into more than one class or as having more than one label.

Computer System

FIG.7illustrates a block diagram of an exemplary computer system (700) for implementing embodiments consistent with the present disclosure. The computer system (700) may comprise a central processing unit (“CPU” or “processor”) (702). The processor (702) may comprise at least one data processor for executing program components for dynamic resource allocation at run time. The processor (702) may include specialized processing units such as integrated system (bus) controllers, memory management control units, floating point units, graphics processing units, digital signal processing units, etc.

The processor (702) may be disposed in communication with one or more input/output (I/O) devices (not shown) via I/O interface (701). The I/O interface (701) may employ communication protocols/methods such as, without limitation, audio, analog, digital, monoaural, RCA, stereo, IEEE-1394, serial bus, universal serial bus (USB), infrared, PS/2, BNC, coaxial, component, composite, digital visual interface (DVI), high-definition multimedia interface (HDMI), RF antennas, S-Video, VGA, IEEE 802.n/b/g/n/x, Bluetooth, cellular (e.g., code-division multiple access (CDMA), high-speed packet access (HSPA+), global system for mobile communications (GSM), long-term evolution (LTE), WiMax, or the like), etc.

Using the I/O interface (701), the computer system (700) may communicate with one or more I/O devices. For example, the input device (710) may be an antenna, keyboard, mouse, joystick, (infrared) remote control, camera, card reader, fax machine, dongle, biometric reader, microphone, touch screen, touchpad, trackball, stylus, scanner, storage device, transceiver, video device/source, etc. The output device (711) may be a printer, fax machine, video display (e.g., cathode ray tube (CRT), liquid crystal display (LCD), light-emitting diode (LED), plasma. Plasma display panel (PDP), Organic light-emitting diode display (OLED) or the like), audio speaker, etc.

In some embodiments, the computer system (700)) is connected to the service operator through a communication network (709). The processor (702) may be disposed in communication with the communication network (709) via a network interface (703). The network interface (703) may communicate with the communication network (709). The network interface (703) may employ connection protocols including, without limitation, direct connect, Ethernet (e.g., twisted pair 10/100/1000 Base T), transmission control protocol/Internet protocol (TCP/IP), token ring, IEEE 802.11a/b/g/n/x, etc. The communication network (709) may include, without limitation, a direct interconnection, e-commerce network, a peer to peer (P2P) network, local area network (LAN), wide area network (WAN), wireless network (e.g., using Wireless Application Protocol), the Internet, Wi-Fi, etc. Using the network interface (703) and the communication network (709), the computer system (700) may communicate with the one or more service operators.

In some embodiments, the processor (702) may be disposed in communication with a memory (705) (e.g., RAM, ROM, etc. not shown inFIG.7) via a storage interface (704). The storage interface (704) may connect to memory (705) including, without limitation, memory drives, removable disc drives, etc., employing connection protocols such as serial advanced technology attachment (SATA), Integrated Drive Electronics (IDE), IEEE-1394, Universal Serial Bus (USB), fibre channel, Small Computer Systems Interface (SCSI), etc. The memory drives may further include a drum, magnetic disc drive, magneto-optical drive, optical drive, Redundant Array of Independent Discs (RAID), solid-state memory devices, solid-state drives, etc.

The memory (705) may store a collection of program or database components, including, without limitation, user interface (706), an operating system (707), web server (708) etc. In some embodiments, computer system (700) may store user/application data (706), such as the data, variables, records, etc. as described in this disclosure. Such databases may be implemented as fault-tolerant, relational, scalable, secure databases such as Oracle or Sybase.

The operating system (707) may facilitate resource management and operation of the computer system (700). Examples of operating systems include, without limitation, Apple Macintosh OS X, Unix, Unix-like system distributions (e.g., Berkeley Software Distribution (BSD), FreeBSD, NetBSD, OpenBSD, etc.), Linux distributions (e.g., Red Hat, Ubuntu, Kubuntu, etc.), IBM OS/2, Microsoft Windows (XP, Vista/7/8, 10 etc.), Apple iOS, Google Android, Blackberry OS, or the like.

In some embodiments, the computer system (700) may implement a web browser (708) stored program component. The web browser (708) may be a hypertext viewing application, such as Microsoft Internet Explorer, Google Chrome, Mozilla Firefox, Apple Safari, etc. Secure web browsing may be provided using Secure Hypertext Transport Protocol (HTTPS), Secure Sockets Layer (SSL), Transport Layer Security (TLS), etc. Web browsers (708) may utilize facilities such as AJAX, DHTML, Adobe Flash, JavaScript, Java, Application Programming Interfaces (APIs), etc. In some embodiments, the computer system (700) may implement a mail server stored program component. The mail server may be an Internet mail server such as Microsoft Exchange, or the like. The mail server may utilize facilities such as ASP. ActiveX, ANSI C++/C #, Microsoft .NET, CGI scripts, Java. JavaScript, PERL, PHP, Python, WebObjects, etc. The mail server may utilize communication protocols such as Internet Message Access Protocol (IMAP), Messaging Application Programming Interface (MAPI), Microsoft Exchange, Post Office Protocol (POP), Simple Mail Transfer Protocol (SMTP), or the like. In some embodiments, the computer system (700) may implement a mail client stored program component. The mail client may be a mail viewing application, such as Apple Mail. Microsoft Entourage, Microsoft Outlook, Mozilla Thunderbird, etc.

In an embodiment, the imaging unit (712) may be configured to capture first and second images (Iaand Ib) and provide the first and second images (Iaand Ib) to the computer system (700) over the communication network (709) for normalizing the actual pixel intensity values. In an embodiment, a display unit (713) may display the first and the second images (Iaand Ib).

The terms “an embodiment”, “embodiment”, “embodiments”, “the embodiment”, “the embodiments”, “one or more embodiments”, “some embodiments”, and “one embodiment” mean “one or more (but not all) embodiments of the invention(s)” unless expressly specified otherwise.

The terms “including”, “comprising”, “having” and variations thereof mean “including but not limited to”, unless expressly specified otherwise.

The enumerated listing of items does not imply that any or all of the items are mutually exclusive, unless expressly specified otherwise. The terms “a”, “an” and “the” mean “one or more”, unless expressly specified otherwise.

A description of an embodiment with several components in communication with each other does not imply that all such components are required. On the contrary a variety of optional components are described to illustrate the wide variety of possible embodiments of the invention.

When a single device or article is described herein, it will be readily apparent that more than one device/article (whether or not they cooperate) may be used in place of a single device/article. Similarly, where more than one device or article is described herein (whether or not they cooperate), it will be readily apparent that a single device/article may be used in place of the more than one device or article or a different number of devices/articles may be used instead of the shown number of devices or programs. The functionality and/or the features of a device may be alternatively embodied by one or more other devices which are not explicitly described as having such functionality/features. Thus, other embodiments of the invention need not include the device itself.

The illustrated operations ofFIG.3,FIG.4, andFIG.7show certain events occurring in a certain order. In alternative embodiments, certain operations may be performed in a different order, modified or removed. Moreover, steps may be added to the above described logic and still conform to the described embodiments. Further, operations described herein may occur sequentially or certain operations may be processed in parallel. Yet further, operations may be performed by a single processing unit or by distributed processing units.

Finally, the language used in the specification has been principally selected for readability and instructional purposes, and it may not have been selected to delineate or circumscribe the inventive subject matter. It is therefore intended that the scope of the invention be limited not by this detailed description, but rather by any claims that issue on an application based here on. Accordingly, the disclosure of the embodiments of the invention is intended to be illustrative, but not limiting, of the scope of the invention, which is set forth in the following claims.

While various aspects and embodiments have been disclosed herein, other aspects and embodiments will be apparent to those skilled in the art. The various aspects and embodiments disclosed herein are for purposes of illustration and are not intended to be limiting, with the true scope being indicated by the following claims.

REFERRAL NUMERALS:Reference numberDescription100System101Image processing apparatus102Imaging unit103Subject104Display unit201I/O interface202Memory203Processor204Data205Contrast and illumination parameters206Displayed pixel intensity value207Other data208Modules209Communication module210Normalized slope determination module211Normalized intercept determination module212Normalized pixel intensity determinationmodule213Other modules700Computer system701I/O interface702Processor703Network interface704Storage interface705Memory706User interface707Operating system708Web service709Communication network710Input device711Output device712Imaging unit713Display unit