Patent Description:
With the advancement of technology, it is becoming more and more common to use automated image analyzation technology to assist professionals such as doctors or laboratory scientists in analyzing medical images.

<NPL> mainly concerns the development of a deep learning system with supported by the convolutional neural network (CNN), in which the supplementary CNN model is trained to re-correct the keypoints located on corners of vertebra based on the first CNN regression model, to precisely measure required characteristics. In order to determine the instability of the lumbar spondylolisthesis, the measurement ability of the proposed method is also required to adapt to multiple lateral bending views including flexion and extension postures.

<CIT> discloses a method for extracting geometrical data from a <NUM>-D digital image of the spine, comprising steps for determining spine outlines, endplates and corners wherein: digitizing the spine center line and end points; constructing a <NUM>-D image band, referred to as Rubber-Band, whose center line is a spline representing the spine center line, and unfolding said Rubber-Band for constructing a <NUM>-D Rectangular-Band; processing the <NUM>-D Rectangular-Band image data in order to estimate best paths going through selected points for determining the spine outlines, then the endplates based on the found outline data and the corners at the intersection of the outlines and endplates.

However, the current automated image analyzation technology is not more accurate for the analysis of the X-ray image of human spine. The possible reason is that a general spine X-ray image will present multiple adjacent vertebrae (also referred to as osteomeres). When interpreting the spine X-ray image, it is possible that, in the automated image analyzation technology, too many osteomeres exist in the same spine X-ray image at the same time, so that the system cannot locate the correct osteomere for analysis.

In order to solve the above problem, the invention provides an image analyzation method according to claim <NUM> and an image analyzation device according to claim <NUM>, which may improve an accuracy of automated image analyzation. Advantageous embodiments are the subject of the dependent claims.

An embodiment of the disclosure provides an image analyzation method carried out by an image analyzation device, which includes the following steps. A first image which is an X-ray image is obtained, and at least a first object and a second object are presented in the first image. The first image is analyzed to detect a first central point between a first endpoint of the first object and a second endpoint of the second object. A target region is determined in the first image based on the first central point as a center of the target region. A second image located in the target region is captured from the first image. The second image is analyzed to generate status information, and the status information reflects a gap status between the first object and the second object.

An embodiment of the disclosure further provides an image analyzation device, which includes a processor and a storage circuit. The processor is coupled to the storage circuit. The processor is coupled to the storage circuit. The processor is configured to: obtain a first image which is an X-ray image, and at least a first object and a second object are presented in the first image; analyze the first image to detect a first central point between a first endpoint of the first object and a second endpoint of the second object; determine a target region in the first image based the first central point as a center of the target region; capture a second image located in the target region from the first image; and analyze the second image to generate status information, and the status information reflects a gap status between the first object and the second object.

Based on the above, after obtaining the first image, the first central point between the first endpoint of the first object in the first image and the second endpoint of the second object in the first image may be detected, and the target region may be automatically determined in the first image based on the first central point as the center of the target region. Next, the second image located in the target region may be captured from the first image and analyzed to generate the status information. In particular, the status information reflects the gap status between the first object and the second object. In this way, the accuracy of the automated image analyzation may be effectively improved.

<FIG> is a schematic view of an image analyzation device according to an embodiment of the disclosure. Referring to <FIG>, a device (also referred to as an image analyzation device) <NUM> may be any electronic device or computer device with image analyzation and calculation functions. In an embodiment, the device <NUM> may also be an X-ray inspection device or an X-ray scanner (referred to as an X-ray machine).

The device <NUM> includes a processor <NUM>, a storage circuit <NUM>, and an input/output (I/O) device <NUM>. The processor <NUM> is coupled to the storage circuit <NUM> and the I/O device <NUM>. The processor <NUM> is configured to be responsible for the overall or partial operation of the device <NUM>. For example, the processor <NUM> may include a central processing unit (CPU), a graphics processing unit (GPU), other programmable general-purpose or special-purpose microprocessors, a digital signal processor (DSP), a programmable controller, an application specific integrated circuit (ASIC), a programmable logic device PLD), other similar devices, or a combination of the devices.

The storage circuit <NUM> is configured to store data. For example, the storage circuit <NUM> may include a volatile storage circuit and a non-volatile storage circuit. The volatile storage circuit is configured to store the data volatilely. For example, the volatile storage circuit may include a random access memory (RAM) or similar volatile storage media. The non-volatile storage circuit is configured to store the data non-volatilely. For example, the non-volatile storage circuit may include a read only memory (ROM), a solid state disk (SSD), a traditional hard disk drive (HDD), or similar non-volatile storage media.

In an embodiment, the storage circuit <NUM> stores an image analyzation module <NUM> (also referred to as an image recognition module). The image analyzation module <NUM> may perform an image recognition operation such as machine vision. For example, the processor <NUM> may run the image analyzation module <NUM> to automatically recognize a specific object presented in a specific image file. In addition, the image analyzation module <NUM> may also be trained to improve a recognition accuracy. In an embodiment, the image analyzation module <NUM> may also be implemented as a hardware circuit. For example, the image analyzation module <NUM> may be implemented as an independent image processing chip (such as the GPU). In addition, the image analyzation module <NUM> may also be disposed inside the processor <NUM>.

The I/O device <NUM> may include an input/output device of various signals such as a communication interface, a mouse, a keyboard, a screen, a touch screen, a speaker, and/or a microphone. The disclosure does not limit the type of the I/O device <NUM>.

In an embodiment, the processor <NUM> may obtain an image (also referred to as a first image) <NUM>. For example, the image <NUM> may be stored in the storage circuit <NUM>. The image <NUM> may be an X-ray image. For example, the image <NUM> may be the X-ray image obtained by using the X-ray machine to perform X-ray irradiation or scanning on a specific part of a human body. Multiple objects may be presented in the image <NUM>. For example, the objects include at least a first object and a second object.

In an embodiment, both the first object and the second object are skeletons of the human body. For example, the first object and the second object may include a vertebra (also referred to as an osteomere) of a neck or a back of the human body. For example, in an embodiment, the image <NUM> may be the X-ray image which may present a shape and an arrangement of the osteomeres of the neck or the back of the human body obtained by using the X-ray machine to perform the X-ray irradiation or scanning on the neck or the back of the human body.

In an embodiment, the processor <NUM> may analyze the image <NUM> through the image analyzation module <NUM>, so as to detect an endpoint (also referred to as a first endpoint) of the first object and an endpoint (also referred to as a second endpoint) of the second object in the image <NUM>. Next, the processor <NUM> may detect a central point (also referred to as a first central point) between the first endpoint and the second endpoint. The first central point may be located at a central position between the first endpoint and the second endpoint.

In an embodiment, the processor <NUM> may determine a region (also referred to as a target region) in the first image based on the first central point as a center of the target region, and capture an image (also referred to as a second image) <NUM> located in the target region from the first image. For example, a central position of the target region may be located at a position where the first central point is located and/or overlap with the first central point. For example, a shape of the target region may be a rectangle, a circle, or other shapes. In addition, the captured image <NUM> may also be stored in the storage circuit <NUM>.

In an embodiment, the processor <NUM> may analyze the image <NUM> through the image analyzation module <NUM> to generate status information. In particular, the status information may reflect a status of a gap (also referred to as a gap status) between the first object and the second object. For example, if the first object and the second object are the two adjacently arranged osteomeres of the neck or the back of the human body, the status information may reflect the status of the gap between the two osteomeres (for example, a width of the gap between the two osteomeres or the closeness of the two osteomeres), a health status of the two osteomeres, whether the arrangement of the two osteomeres conforms to characteristics of a specific disease, and/or whether the gap between the two osteomeres conforms to the characteristics of the specific disease. For example, the specific disease may include ankylosing spondylitis or other diseases.

In an embodiment, the status information may include scoring information. The scoring information may reflect a health status of the human body or a risk of suffering from the specific disease. For example, in an embodiment, the scoring information may include mSASSS. The mSASSS may reflect a risk level of ankylosing spondylitis in the human body corresponding to the image <NUM> (or <NUM>). In an embodiment, the scoring information may also reflect a risk level of other types of diseases in the human body. The disclosure is not limited thereto.

In an embodiment, the status information may be presented in a form of a report. For example, the status information may be presented on a display of the device <NUM>. In an embodiment, the status information may be sent to other devices, such as a smart phone, a tablet computer, a notebook computer, or a desktop computer, so as to be viewed by a user of other devices.

<FIG> is a schematic view of a first image according to an embodiment of the disclosure. Referring to <FIG>, in an embodiment, objects <NUM> to <NUM> arranged adjacently to one another may be present in the image <NUM>. For example, the objects <NUM> to <NUM> may actually be the osteomeres (marked as A to F) of the specific part (such as the neck or back) of the human body. In addition, in the presented objects <NUM> to <NUM>, there is a gap (also referred to as a physical gap) between every two of the adjacently arranged objects. It should be noted that the disclosure does not limit the total number and arrangement status of the objects <NUM> to <NUM> presented in the image <NUM>.

In an embodiment, the processor <NUM> may analyze the image <NUM> to detect endpoints <NUM> to <NUM> on the objects <NUM> to <NUM>. For example, the endpoint <NUM> is the endpoint at a lower left corner of the object <NUM>. The endpoint <NUM> is the endpoint at an upper left corner of the object <NUM>, and the endpoint <NUM> is the endpoint at a lower left corner of the object <NUM>. The endpoint <NUM> is the endpoint at an upper left corner of the object <NUM>, and the endpoint <NUM> is the endpoint at a lower left corner of the object <NUM>. The endpoint <NUM> is the endpoint at an upper left corner of the object <NUM>, and the endpoint <NUM> is the endpoint at a lower left corner of the object <NUM>. The endpoint <NUM> is the endpoint at an upper left corner of the object <NUM>, and the endpoint <NUM> is the endpoint at a lower left corner of the object <NUM>. The endpoint <NUM> is the endpoint at an upper left corner of the object <NUM>. It should be noted that the endpoints <NUM> to <NUM> are all located on the same side of the objects <NUM> to <NUM> (for example, the left side).

After finding the endpoints <NUM> to <NUM>, the processor <NUM> may detect central points <NUM> to <NUM> between any two of the adjacent endpoints according to positions of the endpoints <NUM> to <NUM>. For example, the central point <NUM> is located at a central position between the endpoints <NUM> and <NUM>. The central point <NUM> is located at a central position between the endpoints <NUM> and <NUM>. The central point <NUM> is located at a central position between the endpoints <NUM> and <NUM>. The central point <NUM> is located at a central position between the endpoints <NUM> and <NUM>. The central point <NUM> is located at a central position between the endpoints <NUM> and <NUM>. After finding the central points <NUM> to <NUM>, the processor <NUM> may detect a distance between any two of the adjacent central points among the central points <NUM> to <NUM>.

<FIG> is a schematic view of detecting distances between multiple adjacent central points according to an embodiment of the disclosure. Referring to <FIG>, following the embodiment of <FIG>, the processor <NUM> may obtain distances D(<NUM>) to D(<NUM>) between any two of the adjacent central points among the central points <NUM> to251. For example, the distance D(<NUM>) reflects a linear distance between the central points <NUM> and <NUM>. The distance D(<NUM>) reflects a linear distance between the central points <NUM> and <NUM>. The distance D(<NUM>) reflects a linear distance between the central points <NUM> and <NUM>. The distance D(<NUM>) reflects a linear distance between the central points <NUM> and <NUM>.

In an embodiment, the processor <NUM> may determine the target region in the image <NUM> based on one of the central points <NUM> to <NUM> as the center of the target region. In addition, the processor <NUM> may determine a coverage range of the target region according to at least one of the distances D(<NUM>) to D(<NUM>). For example, the at least one of the distances D(<NUM>) to D(<NUM>) may be positively correlated with an area of the coverage range of the target region. For example, if a value of the at least one of the distances D(<NUM>) to D(<NUM>) is larger, the area of the coverage range of the target region may also be larger.

In an embodiment, if the target region is a rectangle, the coverage range of the target region may be defined by a length and a width of the target region. Therefore, in an embodiment, the processor <NUM> may determine the length and/or the width of the target region according to the distance. In addition, if the target region is a circle, the coverage range of the target region may be defined by a radius of the target region. Therefore, in an embodiment, the processor <NUM> may determine the radius of the target region according to the distance.

<FIG> is a schematic view of determining a target region in a first image according to an embodiment of the disclosure. Referring to <FIG>, following the embodiment of <FIG> and taking the central point <NUM> as an example, the processor <NUM> may determine a target region <NUM> based on the central point <NUM> as the center of the target region. A center of the target region <NUM> may be located at a position where the central point <NUM> is located and/or overlap with the central point <NUM>. In an embodiment, the processor <NUM> may also determine the target region <NUM> based on any one of the central points <NUM> to <NUM> as the center of the target region. In addition, the processor <NUM> may determine a coverage range of the target region <NUM> according to the at least one of the distances D(<NUM>) to D(<NUM>).

In an embodiment, the processor <NUM> may determine a distance D(T) according to an average value (also referred to as an average distance) of at least two of the distances D(<NUM>) to D(<NUM>). The distance D(T) may be a half of a length and/or a width of the target region <NUM>. In addition, in an embodiment, if the target region <NUM> is a circle, the distance D(T) may also be a radius of the target region <NUM>. In an embodiment, the average distance may also be replaced by any one of the distances D(<NUM>) to D(<NUM>).

In an embodiment, the distance D(T) may also be fine-tuned through a function to slightly enlarge or reduce the distance D(T). In this way, even if a shape of at least one of the objects <NUM> to <NUM> is relatively irregular, and/or a size is quite different from the other objects, the fine-tuned distance D(T) may also provide higher operating tolerance for the objects <NUM> to <NUM>.

After the distance D(T) is determined, the target region <NUM> may be determined in the image <NUM> according to the distance D(T). In addition, after determining the target region <NUM>, the processor <NUM> may capture an image located in the target region <NUM> from the image <NUM> as the image <NUM>.

<FIG> is a schematic view of a second image according to an embodiment of the disclosure. Referring to <FIG>, following the embodiment of <FIG>, the image <NUM> captured from the target region <NUM> may present at least a portion of the object <NUM> (i.e., the osteomere A) and at least a portion of the object <NUM> (i.e., the osteomere B). In particular, the image <NUM> may present a gap GP between the objects <NUM> and <NUM>. Afterwards, the processor <NUM> may analyze the image <NUM> to generate status information that may reflect a status of the gap GP. For example, the status information may include the scoring information related to mSASSS or other useful information.

In an embodiment, in an operation of capturing the image <NUM> from the target region <NUM>, the processor <NUM> may filter out an image of at least a portion of endpoints or edges of the objects <NUM> (and/or <NUM>) that is not located in the target region <NUM> in the image <NUM>. After filtering out the image of at least the portion of the endpoints or the edges of the objects <NUM> (and/or <NUM>) that is not located in the target region <NUM>, the remaining image is the image <NUM>, as shown in <FIG>. In this way, when the image <NUM> is subsequently analyzed by the image analyzation module <NUM>, the image analyzation module <NUM> may focus on analyzing an image content related to the gap GP in the image <NUM> (such as a width and/or a shape of the gap GP, etc.) and generate the corresponding status information.

Compared with the image <NUM> which is analyzed directly in a large scale, information, in the image <NUM>, which is irrelevant to the gap (such as the gap GP) between the osteomeres to be analyzed and may cause a misjudge of the image analyzation module <NUM> is filtered out (for example, a main display content of the image <NUM> is located at the gap GP between the two objects <NUM> and <NUM> (for example, the osteomeres A and B)). Therefore, the image analyzation module <NUM> may more accurately generate the status information that may reflect the status of the gap. In this way, an accuracy of automated image analyzation for the X-ray image may be effectively improved.

<FIG> is a flowchart of an image analyzation method according to an embodiment of the disclosure. Referring to <FIG>, in step S601, the first image is obtained, and at least the first object and the second object are present in the first image. In step S602, the first image is analyzed to detect the first central point between the first endpoint of the first object and the second endpoint of the second object. In step S603, the target region is determined in the first image based on the first central point as the center of the target region. In step S604, the second image located in the target region is captured from the first image. In step S605, the second image is analyzed to generate the status information, and the status information reflects the gap status between the first object and the second object.

However, each of the steps in <FIG> has been described in detail as above. Thus, details in this regard will not be further reiterated in the following. It is worth noting that each of the steps in <FIG> may be implemented as multiple program codes or circuits, and the disclosure is not limited thereto. In addition, the method in <FIG> may be used in conjunction with the above exemplary embodiments, or may be used alone. The disclosure is not limited thereto.

Claim 1:
An image analyzation method carried out by an image analyzation device (<NUM>), comprising:
obtaining a first image (<NUM>) which is an X-ray image, wherein at least a first object and a second object are presented in the first image (<NUM>);
characterized by
analyzing the first image (<NUM>) to detect a first central point between a first endpoint of the first object and a second endpoint of the second object;
determining a target region (<NUM>) in the first image (<NUM>) based on the first central point as a center of the target region (<NUM>);
capturing a second image (<NUM>) located in the target region (<NUM>) from the first image (<NUM>); and
analyzing the second image (<NUM>) to generate status information, wherein the status information reflects a gap (GP) status between the first object and the second object.