IMAGE PROCESSING APPARATUS, CAPSULE ENDOSCOPE SYSTEM, METHOD OF OPERATING IMAGE PROCESSING APPARATUS, AND COMPUTER-READABLE STORAGE MEDIUM

An image processing apparatus includes: an identification circuit configured to calculate a characteristic of each of a plurality of image groups captured when a capsule endoscope is introduced into a subject multiple times, each image group being a group of images that are captured each time the capsule endoscope is introduced into the subject, and identify, based on the calculated characteristic, a first region or a second region in each image group, the first region being a region that does not include an image of the subject captured by the capsule endoscope, the second region being a region that is regarded as not including the captured image of the subject; and a first specifying circuit configured to specify at least one section of the subject in the image groups, the at least one section including the first region or the second region.

BACKGROUND

1. Technical Field

The present disclosure relates to an image processing apparatus, a capsule endoscope system, a method of operating an image processing apparatus, and a computer-readable storage medium.

2. Related Art

In the field of endoscopes, a capsule endoscope that is introduced into a subject to capture an image has been developed. The capsule endoscope has an imaging function and a wireless communication function inside a capsule-shaped casing formed to have a size that enables introduction into the gastrointestinal tract of a subject. The capsule endoscope is swallowed by the subject and thereafter captures an image while moving inside the gastrointestinal tract by a peristaltic motion or the like, and sequentially generates and wirelessly transmits an image (hereinafter, also referred to as in-vivo image) of an internal portion of an organ of the subject (see, for example, JP 2012-228346 A). The wirelessly transmitted image is received by a receiving device provided outside the subject. Further, the received image is fetched to an image processing apparatus such as a workstation and subjected to predetermined image processing. As a result, the in-vivo image of the subject can be displayed as a still image or a moving image on a display device connected to the image processing apparatus.

When finding a lesion such as a bleeding source using the capsule endoscope, in a case where the lesion cannot be found in a single examination, the capsule endoscope may be introduced into the same subject multiple times for examination.

SUMMARY

In some embodiments, provided is an image processing apparatus that performs image processing on an image captured by a capsule endoscope introduced into a subject. The image processing apparatus includes: an identification circuit configured to calculate a characteristic of each of a plurality of image groups captured when the capsule endoscope is introduced into the subject multiple times, each image group being a group of images that are captured each time the capsule endoscope is introduced into the subject, and identify, based on the calculated characteristic, a first region or a second region in each image group, the first region being a region that does not include an image of the subject captured by the capsule endoscope, the second region being a region that is regarded as not including the captured image of the subject; and a first specifying circuit configured to specify at least one section of the subject in the plurality of image groups, the at least one section including the first region or the second region.

In some embodiments, a capsule endoscope system includes: the image processing apparatus; and the capsule endoscope.

In some embodiments, provided is a method of operating an image processing apparatus that performs image processing on an image captured by a capsule endoscope introduced into a subject. The method includes: calculating, by an identification circuit, a characteristic of each of a plurality of image groups captured when the capsule endoscope is introduced into the subject multiple times, each image group being a group of images that are captured each time the capsule endoscope is introduced into the subject; identifying, based on the calculated characteristic, a first region or a second region in each of the plurality of image groups, the first region being a region that does not include an image of the subject captured by the capsule endoscope, the second region being a region that is regarded as not including the captured image of the subject; and specifying, by a first specifying circuit, at least one section of the subject in each of the plurality of image groups, the at least one section including the first region or the second region.

In some embodiments, provided is a non-transitory computer-readable recording medium on which an executable program is recorded. The program instructs an image processing apparatus that performs image processing on an image captured by a capsule endoscope introduced into a subject to execute: calculating, by an identification circuit, a characteristic of each of a plurality of image groups captured when the capsule endoscope is introduced into the subject multiple times, each image group being a group of images that are captured each time the capsule endoscope is introduced into the subject, identifying, based on the calculated characteristic, a first region or a second region in each of the plurality of image groups, the first region being a region that does not include an image of the subject captured by the capsule endoscope, the second region being a region that is regarded as not including the captured image of the subject; and specifying, by a first specifying circuit, at least one section of the subject in each of the plurality of image groups, the at least one section including the first region or the second region.

DETAILED DESCRIPTION

First Embodiment

FIG. 1is a schematic diagram illustrating a schematic configuration of a capsule endoscope system including an image processing apparatus according to a first embodiment. A capsule endoscope system1illustrated inFIG. 1includes

a capsule endoscope2that is introduced into a subject H such as a patient, generates an image obtained by capturing the inside of the subject H, and wirelessly transmits the generated image, a receiving device3that receives the image wirelessly transmitted from the capsule endoscope2via a receiving antenna unit4attached to the subject H, an image processing apparatus5that acquires the image from the receiving device3, performs predetermined image processing on the acquired image, and displays the processed image, and a display device6that displays the image of the inside of the subject H, or the like in response to an input from the image processing apparatus5.

The capsule endoscope2is constituted by an image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The capsule endoscope2is a capsule type endoscope device formed to have a size that enables introduction into an organ of the subject H. The capsule endoscope2is introduced into the organ of the subject H by oral insertion or the like, and sequentially captures in-vivo images while moving inside the organ by a peristaltic motion or the like, and maintaining a predetermined frame rate. Then, the images generated by the capturing are sequentially transmitted by an embedded antenna or the like.

The receiving antenna unit4includes a plurality of (eight inFIG. 1) receiving antennas4ato4h. Each of the receiving antennas4ato4his implemented by a loop antenna, for example, and disposed at a predetermined position on an external surface of the subject H (for example, a position corresponding to each organ inside the subject H, the organ being a region through which the capsule endoscope2passes).

The receiving device3receives the image wirelessly transmitted from the capsule endoscope2via these receiving antennas4ato4h, performs predetermined processing on the received image, and stores the image and information regarding the image in an embedded memory. The receiving device3may include a display unit that displays a state of reception of the image wirelessly transmitted from the capsule endoscope2, and an input unit such as an operation button to operate the receiving device3. Further, the receiving device3includes a general-purpose processor such as a central processing unit (CPU), or a special-purpose processor such as various arithmetic operation circuits that perform specific functions, such as an application specific integrated circuit (ASIC) and a field programmable gate array (FPGA).

The image processing apparatus5performs image processing on each of a plurality of image groups captured by introducing the capsule endoscope2into the same subject H multiple times. Each image group is a group of in-vivo images of the subject H that are arranged in time series, the in-vivo images being captured by the capsule endoscope2introduced into the subject H until the capsule endoscope2is pulled out of the body of the subject H. The image processing apparatus5is implemented by a workstation or personal computer including a general- purpose processor such as a CPU, or a special-purpose processor such as various arithmetic operation circuits that execute a certain function, such as an ASIC and an FPGA. The image processing apparatus5fetches the image and the information regarding the image, the image and the information being stored in the memory of the receiving device3, performs predetermined image processing, and displays the image on the screen. Note thatFIG. 1illustrates a configuration in which a cradle3ais connected to a universal serial bus (USB) port of the image processing apparatus5, the receiving device3is connected to the image processing apparatus5by setting the receiving device3in the cradle3a, and an image and information regarding the image are transferred from the receiving device3to the image processing apparatus5. Note that a configuration in which an image and information regarding the image are wirelessly transmitted from the receiving device3to the image processing apparatus5via an antenna or the like may also be possible.

FIG. 2is a block diagram illustrating the image processing apparatus illustrated inFIG. 1. The image processing apparatus5illustrated inFIG. 2includes an image acquisition unit51, a storage unit52, an input unit53, an identification unit54, a first specifying unit55, a generation unit56, a control unit57, and a display controller58.

The image acquisition unit51acquires an image to be processed from the outside. Specifically, the image acquisition unit51fetches, under the control of the control unit57, an image (an image group including a plurality of in-vivo images captured (acquired) in time series by the capsule endoscope2) stored in the receiving device3set in the cradle3a, via the cradle3aconnected to the USB port. Further, the image acquisition unit51also causes the storage unit52to store the fetched image group via the control unit57.

The storage unit52is implemented by various IC memories such as a flash memory, a read only memory (ROM), and a random access memory (RAM), a hard disk that is built-in or connected by a data communication terminal, or the like. The storage unit52stores the image group transferred from the image acquisition unit51via the control unit57. Further, the storage unit52stores various programs (including an image processing program) executed by the control unit57, information required for processing performed by the control unit57, or the like.

The input unit53is implemented with input devices such as a keyboard, a mouse, a touch panel, and various switches, and outputs, to the control unit57, input signals generated in response to an external operation on these input devices.

The identification unit54calculates a characteristic of each of the plurality of image groups to identify a region of the subject H that is not captured by the capsule endoscope2, in each of the plurality of image groups on the basis of the characteristic. Specifically, the identification unit54includes a first calculation unit541that calculates, as a characteristic, the amount of a specific region in each image of each of the plurality of image groups, and a first identification unit542that identifies the region of the subject H that is not captured by the capsule endoscope2on the basis of the amount of the specific region calculated by the first calculation unit541. The specific region is a region including a captured image of, for example, a bubble or residue in the gastrointestinal tract, or noise caused by a poor state of communication between the capsule endoscope2and the receiving device3. Further, the specific region may include a region including a captured image of bile. Further, the identification unit54may identify a blurred image caused by fast movement of the capsule endoscope2. Alternatively, a configuration in which a user can select a specific target to be included in the specific region by setting. The identification unit54includes a general- purpose processor such as a CPU or a special-purpose processor such as various arithmetic operation circuits that perform specific functions, such as an ASIC and an FPGA.

Note that the specific region can be detected by applying a known method. For example, as disclosed in JP 2007-313119 A, it is allowable to detect a bubble region by detecting a match between a bubble model to be set on the basis of a feature of a bubble image, such as an arc-shaped protruding edge due to illumination reflection, existing at a contour portion of a bubble or inside the bubble, and an edge extracted from an intraluminal image. Alternatively, as disclosed in JP 2012-143340 A, it is allowable to detect a residue candidate region, that is assumed to be a non-mucosa region, on the basis of color feature data based on each pixel value, and to discern whether or not the residue candidate region is a mucosa region on the basis of a positional relationship between the residue candidate region and the edge extracted from the intraluminal image.

The first specifying unit55specifies a section of the subject H in which the region identified by the identification unit54in the image group overlaps each other between the plurality of image groups. However, the first specifying unit55may specify at least one section of the subject H in which the region is included in one of the plurality of image groups. Specifically, the first specifying unit55may specify a section of the subject H in which the region identified by the identification unit54is included in any one of the plurality of image groups. Further, the first specifying unit55may specify a section of the subject H in which an overlapping proportion of the region of the image group identified by the identification unit54overlapping each other between the plurality of image groups is equal to or more than a predetermined value. The first specifying unit55includes a general-purpose processor such as a CPU or a special-purpose processor such as various arithmetic operation circuits that perform specific functions, such as an ASIC and an FPGA.

The generation unit56generates information regarding a position of the section specified by the first specifying unit55. The information generated by the generation unit56is, for example, a distance from a reference position of the subject H to the section. However, the generation unit56may generate information regarding a position of the section specified by the first specifying unit55for at least one section. Further, the information generated by the generation unit56may include a distance from the reference position of the subject H to a position where the section ends, a distance from the reference position of the subject H to an intermediate position of the section, the length of the section, and the like. The generation unit56includes a general-purpose processor such as a CPU or a special-purpose processor such as various arithmetic operation circuits that perform specific functions, such as an ASIC and an FPGA.

The control unit57reads a program (including the image processing program) stored in the storage unit52and controls an overall operation of the image processing apparatus5according to the program. The control unit57includes a general-purpose processor such as a CPU or a special-purpose processor such as various arithmetic operation circuits that perform specific functions, such as an ASIC and an FPGA. Alternatively, the control unit57may include the identification unit54, the first specifying unit55, the generation unit56, the display controller58, and the like, and one CPU and the like.

The display controller58controls display performed by the display device6under the control of the control unit57. Specifically, the display controller58controls display performed by the display device6by generating and outputting a video signal. The display controller58causes the display device6to display the information generated by the generation unit. The display controller58includes a general-purpose processor such as a CPU or a special-purpose processor such as various arithmetic operation circuits that perform specific functions, such as an ASIC and an FPGA.

The display device6is implemented by a liquid crystal display, an organic electroluminescence (EL) display, or the like, and displays a display screen such as an in-vivo image under the control of the display controller58.

Next, an operation of the image processing apparatus5will be described. Hereinafter, processing for two image groups including first and second image groups will be described. However, the number of image groups is not particularly limited as long as it is plural.

FIG. 3is a flowchart illustrating an operation of the image processing apparatus illustrated inFIG. 2. As illustrated inFIG. 3, the first and second image groups stored in the storage unit52are acquired (Step S1). Here, as the image groups, the first and second image groups that are respectively captured by the capsule endoscope2when the capsule endoscope2is introduced into the subject H twice are acquired.

Next, the identification unit54performs identification processing on the first image group (Step S2).FIG. 4is a flowchart illustrating the identification processing illustrated inFIG. 3. As illustrated inFIG. 4, the control unit57sets a variable i so that i=1 (Step S11).

Then, the first calculation unit541calculates the amount (the area, the number of pixels, or the like) of a specific region included in the i-th image (Step S12).

Next, the first identification unit542determines whether or not the i-th image is a specific image in which the amount of the specific region is equal to or more than a predetermined threshold value (equal to or more than a predetermined area) stored in the storage unit52. (Step S13). The specific image is an image including a region that does not include a captured image of the subject H (inner wall of the gastrointestinal tract) in an amount that is equal to or more than a predetermined threshold value due to the specific region such as a bubble, residue, or noise. The threshold value may be a value input by the user.

In a case where the i-th image is the specific image (Step S13: Yes), the control unit57stores, in the storage unit52, the fact that the i-th image is the specific image (Step S14).

On the other hand, in a case where the i-th image is not the specific image (Step S13: No), the processing directly proceeds to Step S15.

Next, the control unit57determines whether or not the variable i is equal to or more than the number N of all images (Step S15).

In a case where the variable i is smaller than N (Step S15: No), the control unit57increments the variable i (i=i+1) (Step S16), and returns to Step S12to continue the processing. On the other hand, in a case where the variable i is N or more (Step S15: Yes), the identification processing ends.

By the identification processing described above, a region of the subject H that is not captured by the capsule endoscope2in the first image group is identified. Specifically, a region between the specific images that are consecutive in time series is the region of the subject H that is not captured by the capsule endoscope2.

Returning toFIG. 3, the identification unit54performs identification processing on the second image group (Step S3). As a result, a region of the subject H that is not captured by the capsule endoscope2in the second image group is identified.

Then, the first specifying unit55specifies an overlapping section of the subject H in which the region identified by the identification unit54in each of the first and second image groups overlap each other between the first and second image groups (Step S4).

Next, the generation unit56calculates a distance from a reference position to the overlapping section (Step S5).

Further, the display controller causes the display device6to display an image displaying the distance to the overlapping section (Step S6).FIG. 5is a diagram illustrating an example of the image displayed on the display device. As illustrated inFIG. 5, the display device6displays the first image group, the second image group, and the overlapping section. A horizontal axis ofFIG. 5represents a distance in a forward direction from the mouth of the subject H toward the anus. Further, the first image group and the second image group are arranged so that reference positions indicated by a broken line match. The reference position is, for example, a site such as the mouth, the cardia, the pylorus, the ileum, or the anus, or a lesion such as a hemostasis site or a ridge site. The reference position may be detected from an image, or the user may observe the image to select the reference position.

In the first image group, the region of the subject H that is not captured by the capsule endoscope2is a region A11. Similarly, in the second image group, the region of the subject H that is not captured by the capsule endoscope2is a region A12. The region A11and the region A12are identified by the identification unit54. Then, the first specifying unit55specifies an overlapping section B1as a section in which the region A11and the region A12overlap each other. Further, the display device6displays a distance d1and a distance d2as the distances from the reference positions generated by the generation unit56to the overlapping section.

The user can recognize a section of the subject H that is not captured by the capsule endoscope2even after performing an examination multiple times, due to the overlapping section B1displayed on the display device6. As a result, the user can easily specify a lesion such as a bleeding source by selectively examining the overlapping section B1with a small intestine endoscope or the like.

In the examination using the capsule endoscope2, in a case of a patient with obscure gastrointestinal bleeding (OGIB), in which a bleeding source is not found by the examination using the capsule endoscope2and anemia is not alleviated, the bleeding source is specified by repeatedly performing the examination using the capsule endoscope2. However, in a case where the bleeding source is in a region where the capsule endoscope2passes through quickly or in a region where residues are likely to accumulate, the bleeding source may not be found even after performing the examination using the capsule endoscope2multiple times. In such a case, the image processing apparatus5automatically specifies the overlapping section B1which is the section of the subject H that is not captured by the capsule endoscope2in the examination performed multiple times. As a result, the user can easily specify the bleeding source by examining the overlapping section B1with a small intestine endoscope or the like.

MODIFIED EXAMPLE 1-1

FIG. 6is a block diagram illustrating an image processing apparatus according to Modified Example 1-1. As illustrated inFIG. 6, an identification unit54A of an image processing apparatus5A includes a second calculation unit541A that calculates the amount of change in a parameter based on a position of the capsule endoscope2when at least two images of an image group are captured, and a second identification unit542A that identifies a region of the subject H that is not captured by the capsule endoscope2on the basis of the amount of change calculated by the second calculation unit541A. The amount of change is an amount that is determined based on the degree of similarity between the at least two images, or on the position, speed, or acceleration of the capsule endoscope. Note that the position of the capsule endoscope2can be detected from information acquired by the receiving device3. Further, the speed or acceleration of the capsule endoscope2can be acquired from a speed sensor or an acceleration sensor embedded in the capsule endoscope2.

Next, an operation of the image processing apparatus5A will be described. The operation of the image processing apparatus5A differs from the image processing apparatus5only in identification processing.FIG. 7is a flowchart illustrating identification processing of the image processing apparatus illustrated inFIG. 6. As illustrated inFIG. 7, after performing the processing in Step S11in the same manner as in the first embodiment, the second calculation unit541A calculates the degree of similarity between the i-th image and the i+1-th image of an image group that are arranged in time series (Step S21).

Then, the second identification unit542A identifies whether or not the degree of similarity calculated by the second calculation unit541A is lower than a predetermined threshold value (Step S22). Note that the threshold value may be a value stored in a storage unit52in advance, or may be a value input by the user. In a case where it is identified by the second identification unit542A that the degree of similarity is lower than the predetermined threshold value (Step S22: Yes), a control unit57stores, in a storage unit52, the fact that a region between the i-th image and the i+1-th image is a region of the subject H that is not captured by the capsule endoscope2(Step S23).

On the other hand, in a case where it is identified by the second identification unit542A that the degree of similarity is equal to or higher than the predetermined threshold value (Step S22: No), the processing directly proceeds to Step S15.

Next, the processing in Steps S15and S16is performed in the same manner as in the first embodiment.

As in Modified Example 1-1, the identification unit54may identify a region of the subject H that is not captured by the capsule endoscope2by using an amount that is determined based on the degree of similarity between at least two images, or on a position, speed, or acceleration of the capsule endoscope.

MODIFIED EXAMPLE 1-2

FIG. 8is a block diagram illustrating an image processing apparatus according to Modified Example 1-2. As illustrated inFIG. 8, an image processing apparatus5B includes a second specifying unit59B that specifies, as a reciprocating image group, a group of reciprocating images captured when the capsule endoscope2reciprocates in the subject H, in each of a plurality of image groups. The second specifying unit59B specifies the reciprocating image group by comparing consecutive images arranged in time series and detecting a direction in which the capsule endoscope2moves. Alternatively, the second specifying unit59B may specify the reciprocating image group on the basis of position information of the capsule endoscope2received by the receiving device3, a capturing time, an image number, or a speed or acceleration measured by a speed sensor or acceleration sensor embedded in the capsule endoscope2.

A first specifying unit55B of the image processing apparatus5B specifies, in the reciprocating image group, a section of the subject H that is overlappingly identified, by an identification unit54, as a region of the subject H that is not captured by the capsule endoscope2when the capsule endoscope2reciprocates in the subject H.

Next, an operation of the image processing apparatus5B will be described.FIG. 9is a flowchart illustrating an operation of the image processing apparatus illustrated inFIG. 8. As illustrated inFIG. 9, after performing the processing in Steps S1and S2in the same manner as in the first embodiment, the second specifying unit59B specifies the reciprocating image group in the first image group (Step S31).

FIG. 10is a diagram illustrating the reciprocating image group. InFIG. 10, a direction toward the right side of the paper is a forward direction. The forward direction is a direction in which the capsule endoscope2advances from the mouth of the subject H toward the anus. The second specifying unit59B compares consecutive images arranged in time series in the first image group, and identifies a direction in which the capsule endoscope2moves when each image is captured. InFIG. 10, the capsule endoscope2advances in the forward direction in sections s1, s21, s23, and s3, and the capsule endoscope2advances in a backward direction in a section s22. At this time, the second specifying unit59B specifies the sections s21, s22, and s23as the reciprocating image group.

Next, the first specifying unit55B specifies a section of the subject H that is not captured by the capsule endoscope2in the first image group (Step S32).

FIG. 11is a diagram illustrating a state in which an overlapping section is specified from the reciprocating image group. As illustrated inFIG. 11, the first specifying unit55B specifies a section of the subject H that is overlappingly identified, by an identification unit54, as a region of the subject H that is not captured by the capsule endoscope2when the capsule endoscope2reciprocates in the subject H, in the first image group. Specifically, the first specifying unit55B specifies, as an overlapping section B2, a section in which a region A21of the subject H that is not captured by the capsule endoscope2in the section s21, a region A22of the subject H that is not captured by the capsule endoscope2in the section s22, and a region A23of the subject H that is not captured by the capsule endoscope2in the section s23overlap each other, the regions A21, A22, and A23being identified by the identification unit54.

Further, as illustrated inFIG. 11, the first specifying unit55specifies the overlapping section for images other than the reciprocating image group as in the first embodiment, and specifies the overlapping section B2for the entire first image group.

Then, as in Steps S2, S31, and S32, in Steps S3, S33, and S34, an overlapping section of the second image group is specified. Then, the processing in Steps S4to S6is performed in the same manner as in the first embodiment, and a series of treatments ends.

According to Modified Example 1-2, a section that is not captured by the capsule endoscope2even once when the capsule endoscope2reciprocates is specified as the overlapping section B2. Therefore, sections that the user examines again by using a small intestine endoscopy are reduced, and the burden on the user can be reduced.

Second Embodiment

A configuration of an image processing apparatus5according to a second embodiment is the same as that of the first embodiment, and the second embodiment differs from the first embodiment only in processing in the image processing apparatus5.FIG. 12is a diagram illustrating a state in which the image processing apparatus according to the second embodiment specifies overlapping sections. As illustrated inFIG. 12, a first specifying unit55of the image processing apparatus5performs normalization of each of acquired first to fourth image groups into position series in an entire section, and divides the entire section of each of the plurality of image groups into sections with an equal distance D.

An identification unit54identifies regions A31to A34of the subject H that are not captured by the capsule endoscope2, in each of the plurality of image groups.

The first specifying unit55identifies whether or not each section of each of the plurality of image groups includes the region identified by the identification unit54. Then, the first specifying unit55specifies overlapping sections B31in which an overlapping proportion of the regions identified by the identification unit54is 75% or more.

A generation unit56calculates a distance d21and a distance d22as information regarding positions of the overlapping sections B31. An image including a captured image of the pylorus in the fourth image group is a position where distance d=0, the position corresponding to a reference position, and the distance d21and the distance d22are distances from the reference position to the overlapping sections B31. Further, the generation unit56calculates a distance C1between the two overlapping sections B31as information regarding the positions of the overlapping sections B31.

FIG. 12illustrates a case where the overlapping sections B31include one section in which a proportion of a region identified by the identification unit54on the basis of the distance d21is 100%, and two sections in which a proportion of a region identified by the identification unit54on the basis of the distance d22is 75%. Since the distance d21and the distance d22are displayed on the display device6, the user can know a distance to a region to be examined by using a small intestine endoscope or the like. Further, since the distance C1is displayed on the display device6, the user can easily perform movement to another overlapping section B31after examining the first overlapping section B31.

MODIFIED EXAMPLE 2-1

FIG. 13is a diagram illustrating a state in which an image processing apparatus according to Modified Example 2-1 specifies overlapping sections. As illustrated inFIG. 13, a first specifying unit55may specify, as an overlapping section B32, a section including at least one region identified by an identification unit54.

A generation unit56calculates a distance d31, a distance d32, and a distance d33as information regarding positions of the overlapping sections B32. An image including a captured image of the pylorus in a fourth image group is a position where distance d=0, the position corresponding to a reference position, and the distance d31, the distance d32, and the distance d33are distances from the reference position to the overlapping sections B32. Further, the generation unit56calculates, as the information regarding the positions of the overlapping sections B32, a distance C2between the first overlapping section B32and the second overlapping section B32, and a distance C3between the second overlapping section B32and the third overlapping section B32.

FIG. 13illustrates a case where the overlapping sections B32include four sections each including a region identified by the identification unit54on the basis of the distance d31, two sections each including a region identified by the identification unit54on the basis of the distance d32, and five sections each including a region identified by the identification unit54on the basis of the distance d33.

Third Embodiment

FIG. 14is a diagram illustrating a state in which an image processing apparatus according to a third embodiment specifies an overlapping section. As illustrated inFIG. 14, a generation unit56corrects a position of each image in a first image group so that the first captured image in the first image group and the last captured image in the first image group correspond to a predetermined distance d=0 and a distance d=D1, respectively. By this correction, a region A411identified by an identification unit54as a region of the subject H that is not captured by the capsule endoscope2in the first image group is corrected to a region A412.

Similarly, the generation unit56corrects a position of each image in a second image group so that the first captured image in the second image group and the last captured image in the second image group correspond to the predetermined distance d=0 and the distance d=D1, respectively. By this correction, a region A421identified by the identification unit54as a region of the subject H that is not captured by the capsule endoscope2in the second image group is corrected to a region A422.

Then, a first specifying unit55specifies, as an overlapping section B4, a section in which the region A412and the region A422overlap each other.

MODIFIED EXAMPLE 3-1

FIG. 15is a diagram illustrating a state in which an image processing apparatus according to Modified Example 3-1 specifies overlapping sections. As illustrated inFIG. 15, the first captured image and the last captured image in a first image group correspond to a distance d=0 and a distance d=D2, respectively. Then, a generation unit56corrects a position of each image in a second image group so that the first captured image in the second image group and the last captured image in the second image group correspond to the predetermined distance d=0 and the distance d=D2, respectively. By this correction, a region A521identified by an identification unit54as a region of the subject H that is not captured by the capsule endoscope2in the second image group is corrected to a region A522.

Then, a first specifying unit55specifies, as an overlapping section B5, a section in which a region A51and the region A522overlap each other.

MODIFIED EXAMPLE 3-2

FIG. 16is a diagram illustrating a state in which an image processing apparatus according to Modified Example 3-2 specifies overlapping sections. As illustrated inFIG. 16, an image corresponding to the pylorus and an image corresponding to the ileocecal valve in a first image group correspond to a distance d=D31and a distance d=D32, respectively. Then, a generation unit56corrects a position of each image in a second image group so that the image corresponding to the pylorus in the second image group and the image corresponding to the ileocecal valve in the second image group correspond to the predetermined distance d=D31and the distance d=D32, respectively. By this correction, a region A621identified by an identification unit54as a region of the subject H that is not captured by the capsule endoscope2in the second image group is corrected to a region A622.

Then, a first specifying unit55specifies, as an overlapping section B6, a section in which a region A61and the region A622overlap each other.

Note that three or more reference positions may be set to sites such as the mouth, the cardia, the pylorus, the ileum, and the anus, or lesions such as a hemostasis site and a ridge site, and different corrections may be applied for the respective reference positions. Further, the reference position may be detected from an image, or the user may observe the image to select the reference position.

Fourth Embodiment

FIG. 17is a block diagram illustrating an image processing apparatus according to a fourth embodiment. As illustrated inFIG. 17, a processing device7is connected to an image processing apparatus5C. The processing device7is a server connected via an internet line, or the like. The processing device7includes an identification unit71. The identification unit71includes a first calculation unit711and a first identification unit712. Functions of the identification unit71, the first calculation unit711, and the first identification unit712are the same as those of the identification unit54, the first calculation unit541, and the first identification unit542of the image processing apparatus5. Therefore, a description thereof will be omitted. Meanwhile, the image processing apparatus5C does not include the identification unit, the first calculation unit, and the first identification unit.

A first specifying unit55C acquires a region of the subject H that is not captured by the capsule endoscope2, the regions being identified in each of a plurality of image groups on the basis of a characteristic of each of the plurality of image groups, and specifies a section of the subject H in which the region in each of a plurality of image groups overlap each other between the plurality of image groups. In other words, the first specifying unit55C specifies a section of the subject H in which the region identified by the identification unit71in each of the plurality of image groups overlaps each other between the plurality of image groups. However, the first specifying unit55C may specify at least one section of the subject H in which the region is included in one of the plurality of image groups.

As in the fourth embodiment described above, the image processing apparatus5C does not include the identification unit, the first calculation unit, and the first identification unit, and the processing device7connected via the Internet may perform processing that is to be performed by the identification unit. Similarly, the processing that is to be performed by the identification unit may be performed on a cloud including a plurality of processing devices (server group).

MODIFIED EXAMPLE 4-1

FIG. 18is a block diagram illustrating an image processing apparatus according to Modified Example 4-1. As illustrated inFIG. 18, a processing device7D is connected to an image processing apparatus5D. The processing device7D includes an identification unit71, a first specifying unit72D, and a generation unit73D. Functions of the identification unit71, the first specifying unit72D, and the generation unit73D are the same as those of the identification unit54, the first specifying unit55, and the generation unit56of the image processing apparatus5, and thus a description thereof will be omitted. Meanwhile, the image processing apparatus5D does not include the identification unit, the first specifying unit, and the generation unit.

A display controller58D acquires a specified section of the subject H in which a region of the subject H that is not captured by the capsule endoscope2in each of a plurality of image groups overlaps each other between a plurality of image groups, the region being identified in each of a plurality of image groups on the basis of a characteristic of each of the plurality of image groups, and causes the display device6to display information regarding a position of the section. In other words, the first specifying unit72D specifies the section of the subject H in which the regions identified by the identification unit71overlap each other between the plurality of image groups, the generation unit73D generate the information regarding the position of the section specified by the first specifying unit72D, and the display controller58D causes the display device6to display the information regarding the position of the section. However, the first specifying unit72D may specify at least one section of the subject H in which the region is included in one of the plurality of image groups.

As in Modified Example 4-1 described above, the image processing apparatus5D does not include the identification unit, the first specifying unit, and the generation unit, and the processing device7D connected via the Internet may perform processing that is to be performed by the identification unit, the first specifying unit, and the generation unit, respectively. Similarly, the processing that is to be performed by the identification unit, the first specifying unit, and the generation unit may be performed on a cloud including a plurality of processing devices (server group).

Fifth Embodiment

FIG. 19is a diagram illustrating an example of the image displayed on the display device. As illustrated inFIG. 19, in the display device6, images61and62, a distance bar63indicating a region63athat is not captured by the capsule endoscope2in a current examination, and a marker64indicating a region that is not captured by the capsule endoscope2in a past examination.

As such, only a current examination result may be displayed by the distance bar63, and a past examination result may be displayed by the marker64. Note that in a case where there are a plurality of past examination results, markers for each examination may be displayed side by side. In addition, in a case where there are a plurality of past examination results, a marker indicating a region that is repeatedly not captured by the capsule endoscope2in the past examinations may be displayed. Similarly, in a case where there are a plurality of past examination results, a marker indicating a region including a portion that is repeatedly not captured the capsule endoscope2in the past examinations may be displayed, the portion having a predetermined proportion or more. In addition, in a case where there are a plurality of past examination results, a marker indicating a region that is not captured by the capsule endoscope2even once in the past examinations may be displayed.

MODIFIED EXAMPLE 5-1

FIG. 20is a diagram illustrating a state in which reference positions match each other. As illustrated inFIG. 20, a distance bar63A for a past examination may be corrected on the basis of a distance bar63for a current examination, and displayed on the display device6. Specifically, the distance bar63A for the past examination may be corrected so that a reference position p3and a reference position p4in the past examination corresponding to a reference position p1and a reference position p2of the current examination, respectively, overlap with the reference position pl and the reference position p2of the current examination, respectively. Here, a region63Aathat is not captured by the capsule endoscope2in the past examination is corrected to a marker64A.

MODIFIED EXAMPLE 5-2

FIG. 21is a diagram illustrating a state in which a non-captured proportion is displayed. As illustrated inFIG. 21, in a current examination and a past examination, proportions (non-captured proportions) of regions that are not captured by the capsule endoscope2may be displayed by using icons65and66each including a numerical value. Note that in a case where there are a plurality of past examination results, icons of non-captured proportions for each examination may be displayed side by side. In addition, in a case where there are a plurality of past examination results, a proportion of a region that is repeatedly not captured by the capsule endoscope2in the past examinations may be displayed in a form of a numerical value. Similarly, in a case where there are a plurality of past examination results, a proportion of a region including a portion that is repeatedly not captured the capsule endoscope2in the past examinations may be displayed in a form of a numerical value, the portion having a predetermined proportion or more. In addition, in a case where there are a plurality of past examination results, a proportion of a region that is not captured by the capsule endoscope2even once in the past examinations may be displayed in a form of a numerical value.

MODIFIED EXAMPLE 5-3

FIG. 22is a diagram illustrating a state in which a captured proportion is displayed. As illustrated inFIG. 22, in a current examination and a past examination, proportions (captured proportions) of regions captured by the capsule endoscope2may be displayed by using icons65aand66aeach including a numerical value.

MODIFIED EXAMPLE 5-4

FIG. 23is a diagram illustrating a state in which distance bars are displayed side by side. As illustrated inFIG. 23, a distance bar63for a current examination and a distance bar63A for a past examination may be displayed side by side. Further, the distance bar63A for the past examination may be hidden by clicking a button67.

FIG. 24is a diagram illustrating a state in which a distance bar is hidden. As illustrated inFIG. 24, when the button67is clicked, the distance bar63A for the past examination is hidden. Here, captured images68may be displayed in a region where the distance bar63A for the past examination was displayed. The captured images68are each an image including a reddish (bleeding)68aand the like, the image being particularly noticed by the user, and is an image selected by the user from an image group and saved. Each captured image68is an image displayed at a position connected to the distance bar63by a straight line.