Gas detection device that visualizes gas

A gas detection device includes: a processor that visualizes a gas by performing image processing on infrared image data in an inspection region imaged by an imaging device; a display that displays an inspection image that reflects a result of the image processing; and an input interface that receives an input of supplementary information on the inspection image displayed on the display.

CROSS-REFERENCE TO RELATED APPLICATIONS

The disclosures of Japanese Patent Applications No. 2018-139158, filed on Jul. 25, 2018 and No. 2018-153951, filed on Aug. 20, 2018, including the specifications, drawings and abstracts are incorporated herein by reference in their entirety.

TECHNICAL FIELD

The present invention relates to a gas detection device, a gas detection method, a display control method, and a non-transitory computer-readable recording medium storing a program.

BACKGROUND ART

A gas leakage detector that detects a gas leak in an inspection region by using characteristics of gas for absorbing infrared is conventionally known (see Patent Literature, (hereinafter, referred as “PTL”)1).

PTL 1 discloses the gas leakage detector including an infrared camera and a visible light camera imaging an image (a moving image) of an inspection region including an inspection target, an image processing section processing the infrared image data imaged by the infrared camera, and a display section. The image processing section extracts an image of fluctuation caused by a gas leak from the image data of the inspection region. The display section displays an inspection image in which the image data of fluctuation is superimposed on the image data of the inspection region imaged by the visible light camera.

PATENT LITERATURE

The gas detection device disclosed in PTL 1 allows an inspector to visually identify with ease a gas leak spot in an inspection region by visually recognizing the inspection image displayed on the display section.

Incidentally, in the inspection image, for example, importance of an inspection image in a normal time is different from that of an inspection image in an emergency time when an inspection target has a gas leak.

With respect to such inspection images, for example, only a specific inspection image may be needed (e.g., only the inspection image in the emergency time) while the inspection image in a predetermined time including the inspection image in the normal time and the inspection image in the emergency time may be needed. When a user can add supplementary information to the specific inspection image in the inspection image, then, the user can efficiently extract the specific inspection image from the inspection image. However, the gas detection device disclosed in NPL 1 does not have such a configuration.

SUMMARY

One or more embodiments of the present invention provide a gas detection device, a gas detection method, a display control method, and a non-transitory computer-readable recording medium storing a program capable of adding supplementary information to a specific image of inspection images.

A gas detection device according to one or more embodiments of the present invention includes: an image processing section (i.e., processor) that visualizes a gas by performing image processing on infrared image data in an inspection region imaged by an imaging section (i.e., imaging device); a display section (i.e., display) that displays an inspection image that reflects a result of the image processing; and an input section (i.e., input interface) that receives input of supplementary information related to the inspection image displayed on the display section.

A gas detection device according to one or more embodiments of the present invention includes: an image processing section that visualizes a gas by performing image processing on infrared image data in an inspection region imaged by an imaging section; a gas detection section that detects the gas based on a result of the image processing; and a display control section (i.e., controller) that performs display control to display an inspection image reflecting the result of the image processing and to display detection time information indicating a time when the gas is detected by the gas detection section.

A gas detection method according to one or more embodiments of the present invention, that is a gas detection method to be executed in a gas detection device, includes: visualizing a gas by performing image processing on infrared image data in an inspection region imaged by an imaging section; displaying an inspection image reflecting a result of the image processing on a display section; and receiving input of supplementary information related to the inspection image displayed on the display section.

A non-transitory computer-readable recording medium storing a program according to one or more embodiments of the present invention causes a computer to perform: gas visualization processing by performing image processing on infrared image data in an inspection region imaged by an imaging section; display processing of an inspection image reflecting a result of the image processing on the display section; and receiving processing of input of supplementary information related to the inspection image displayed on the display section.

According to one or more embodiments of the present invention, a gas detection device, a gas detection method, a display control method, and a non-transitory computer-readable recording medium storing a program capable of adding supplementary information to a specific image of inspection images can be provided.

DETAILED DESCRIPTION OF EMBODIMENTS

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to the configuration of the below embodiments.

Gas detection device1according to one or more embodiments will be described with reference toFIGS.1to7B.FIG.1is a block diagram of gas detection device1. Gas detection device1, for example, images an inspection region including an inspection target (e.g., a plant) in gas fields, and generates infrared image data of the inspection region. Then, detection device1generates an inspection image, in which the gas is visualized by performing image processing on the infrared image data. In addition, when using gas detection device1of one or more embodiments, a user can add supplementary information to the inspection image at any timing, while visually recognizing the inspection image displayed on the display section. In the following description, images include moving images as well as still images.

As illustrated inFIG.1, gas detection device1includes imaging device2and gas detection device body3. Imaging device2and gas detection device body3are connected with each other via cable4. Imaging device2may be connected to gas detection device body3via wireless communication. Imaging device2may also be connected to gas detection device body3via a network such as the Internet.

Imaging device2is, for example, a portable camera device. Imaging device2may be a camera device that is fixed to a predetermined position. Imaging device2may be controlled by, for example, control section35of gas detection device body3to be described below, and a control section (not illustrated) or the like included in imaging device2.

Imaging device2starts imaging, for example, when an instruction to start imaging (hereinafter referred to as “imaging start instruction”) is input from a user through operation input section33of gas detection device body3. However, even when the imaging start instruction is input, imaging device2does not need to start imaging in a case where no imaging information is input from a user.

In particular, imaging device2includes visible light imaging section21and infrared imaging section22.

Visible light imaging section21includes, by way of example, a first optical system (not illustrated), a first optical filter (not illustrated), and a visible light sensor (not illustrated).

The first optical system forms an image of the visible light incident from the inspection region to be an object on the visible light sensor.

The first optical filter is, in one example, an infrared cut filter disposed on an optical path connecting between the optical system and the visible light sensor. The infrared cut filter cuts infrared light from the light which has passed through the optical system.

The visible light sensor is, for example, a CMOS image sensor, and receives black-and-white BW visible light, or color RGB visible light to generate visible image data.

Visible light imaging section21having this configuration images, for example, an image of the inspection region including the inspection target (e.g., plant6aillustrated inFIG.5A) in gas fields, and sequentially outputs visible image data to processing section31(specifically, image processing section31a).

The visible image data generated by visible light imaging section21is a still image or a moving image. Note that, visible light imaging section21may be omitted when inspection image7displayed on display section32described below (seeFIG.5A) is infrared image data to be described later.

Infrared imaging section22includes, by way of example, a second optical system (not illustrated), a second optical filter (not illustrated), and an infrared sensor (not illustrated).

The second optical system forms an image of the infrared light incident from the inspection region to be an object on the infrared sensor.

The second optical filter is, in one example, a bandpass filter disposed on an optical path connecting between the second optical system and the infrared sensor. The second optical filter transmits only infrared light included in a predetermined wavelength band in the infrared light that has passed through the optical system. The pass wavelength band of the second optical filter is substantially set to an absorption wavelength band of a gas to be detected. For example, when the pass wavelength band is set to a middle wavelength range of 3.2 to 3.4 μm, a methane gas or the like can be detected.

The infrared sensor is, for example, a quantum indium antimonide (INSb) image sensor, a heat-type thermopile array sensor, or a microbolometer, and receives infrared light to generate infrared image data. Infrared imaging section22having such a configuration images an image of the inspection region in a state of being synchronized with visible light imaging section21and sequentially outputs infrared image data to processing section31(specifically, image processing section31a).

The infrared image data generated by infrared imaging section22is a still image or a moving image. Such infrared image data indicates a temperature distribution in the inspection region.

Gas detection device body3converts a gas generated in the inspection region into a visible image by using received information from imaging device2. Gas detection device body3having this configuration is a mobile terminal such as a tablet terminal, a smartphone, a laptop terminal, or a wearable terminal, which is communicably connected to imaging device2.

Gas detection device body3includes, for example, processing section31, display section32, operation input section33, storage section34, and control section35.

Processing section31(i.e., processor) comprises at least one dedicated hardware (an electronic circuit) in accordance with various kinds of each processing, such as a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), or a Programmable Logic Device (PLD). Processing section31includes, as functional blocks, image processing section31a, display processing section31b, and output processing section31c. Each function of processing section31to be described below is realized under the control of control section35.

A function of image processing section31awill be described below. The function of image processing section31ais realized under the control of control section35.

Image processing section31areceives infrared image data (hereinafter referred to as “infrared image data before image processing”) in the inspection region from infrared imaging section22. Image processing section31adetects a part having a gas by performing a predetermined image processing on the infrared image data in the inspection region and visualizes the detected part (hereinafter referred to as “gas visualization processing”). Image processing section31aapplies a specific color (red or the like) to the part having a gas of the infrared image data before image processing. The infrared image data obtained after gas visualization processing is referred to as “infrared image data after image processing”.

A method for detecting a gas from infrared image data in the inspection region will be briefly described. When a gas leak has occurred in the inspection region, a temperature of the part having a gas of infrared image data in the inspection region changes (i.e., luminance of infrared image data in the inspection region changes). Image processing section31adetects the part having a gas based on the change in temperature. Since a method for detecting a gas is a well-known image processing method, it will not be described in detail.

Furthermore, image processing section31areceives visible image data from (hereinafter referred to as “visible image data before image processing”) visible light imaging section21. Image processing section31a, then, generates inspection image data, in which the visible image data before image processing and the infrared image data after image processing are combined. Inspection image data is displayed on the display section as inspection image7(seeFIG.5A). Gas image7a(seeFIG.5A) illustrating the gas in inspection image7is colored in the specific color. Note that, the infrared image data after image processing described above can be infrared image data without combining the visible image data.

Image processing section31aoutputs inspection image data to display processing section31b.

Image processing section31aoutputs inspection image data to storage section34. Image processing section31amay outputs the infrared image data after image processing to storage section34. In addition, image processing section31amay output the visible image data before image processing to storage section34.

Hereinafter, a function of display processing section31bwill be described. The function of display processing section31bis realized under the control of control section35. Display processing section31bhaving such a configuration controls display of display section32to be described below.

Display processing section31bdisplays an imaging information input image (not illustrated) for inputting imaging information on display section32. Image data to be the basis of the imaging information input image is prestored in storage section34.

Display processing section31bconverts the inspection image data received from image processing section31ainto a display signal corresponding to display section32, and outputs the display signal to display inspection image7(seeFIG.5A) on display section32.

Display processing section31bdisplays supplementary information input image5(seeFIG.5A) for inputting supplementary information with inspection image7on display section32.

FIG.5Aillustrates examples of inspection image7and supplementary information input image5displayed on display section32. Supplementary information input image5is, for example, an icon. Image data to be the basis of supplementary information input image5is prestored in storage section34. Supplementary information input image5may be comprised of a plurality of images to be sequentially pop-up displayed corresponding to touch operations by a user.

In one or more embodiments, supplementary information input image5is comprised of first input image51(seeFIG.5A) always displayed on display section32with inspection image7, and second input image52(seeFIG.5B) displayed on display section32when the user operates (e.g., by touch operation) first input image51.

Display processing section31bdisplays second input image52on display section32when first input image51is operated by the user. In a case where an end instruction is input via operation input section33while second input image52displayed on display section32, display processing section31bdeletes second input image52from display section32. Display processing section31bmay delete second input image52after a predetermined time passes. That is, the pop-up displayed screen as second input image52may be automatically deleted after a predetermined time passes from the start of display.

When an instruction for reproduction start (hereinafter referred to as “reproduction start instruction”) is input via operation input section33, display processing section31bconverts the inspection image data stored in storage section34into a display signal corresponding to display section32, and outputs the display signal to display inspection image7on display section32. In this case, display processing section31bdisplays supplementary information input image5with inspection image7on display section32.

Display processing section31bdisplays seek bar image53(seeFIGS.7A and7B) on display section32when the reproduction start instruction is input. Image data to be the basis of seek bar image53is prestored in storage section34. Seek bar image53enables the user to recognize a reproduction status. In addition, the user can adjust a reproduction start position by operating seek bar image53.

Seek bar image53will be described with reference toFIG.7A. First bar elements53a(parts having slanted lattice) each mean the part being already reproduced in inspection image data. Furthermore, in seek bar image53, second bar elements53b(hatched parts) each mean the part where a gas leak has been mechanically detected based on the detection result of image processing section31a.

In seek bar image53, first mark53cmeans the part that has been checked by the user. In seek bar image53, second mark53dmeans the unnecessary image data. Furthermore, in seek bar image53, third mark53eand fourth mark53fmean the parts to which supplementary information is added by the user. Between these, third mark53emeans the nearest supplementary information (evidence) from reproducing position mark53gindicating the position under reproduction. Besides, in seek bar image53, white painted parts mean the unreproduced parts. Additionally, in seek bar image53, black painted parts mean the deleted parts.

Output processing section31cgenerates output information including the imaging information and the inspection image data under the control of control section35. Output processing section31cgenerates output information when an output instruction is input from operation input section33.

When a range of the inspection image data is input from operation input section33, output processing section31cextracts the inspection image data of the range, and generates information as output information. Note that, output information may include inspection image data associated with supplementary information.

Output processing section31coutputs the output information to, for example, an output device such as printer. The output device may be connected to detection device body3by a wired or wireless connection. The output device also may be connected to detection device body3via a network such as the Internet. Output processing section31cmay output the output information to a portable storage medium, such as an optical disk, a magneto-optical disk, or a memory card.

Note that, when gas detection device1is connected to a server via a network, output processing section31cmay output the output information to the server.

Display section32is, for example, a display of a mobile terminal constituting gas detection device body3. As the display, a liquid crystal display, an organic EL display, or the like can be used. In one or more embodiments, the display is a flat panel display having a touch panel.

Display section32displays various images based on the display signals from display processing section31bunder the control of control section35. On display section32, inspection image7for the user to visually detect a gas, supplementary information input image5for the user to input the supplementary information, and seek bar image53for the user to recognize a reproduction status of the inspection image data and/or the like are displayed (seeFIGS.5A to7A).

Operation input section33(i.e., input interface) is an input section that receives, for example, input of imaging information and input of supplementary information. Operation input section33also receives an operation relating to reproduction of the inspection image data and an operation relating to imaging of imaging device2. Note that, imaging information includes various pieces of information required to start imaging by imaging device2. Imaging information will be described below.

Operation input section33receives an output instruction. Operation input section33may receive, for example, designation of items to be included in the output information, together with the output instruction. The items of the output information include imaging information described below and any other information (e.g., weather information during imaging).

Operation input section33may receive designation of a range of the inspection image data to be output as output information. The user, by way of example, designates the range of the inspection image data to be output from seek bar image53(seeFIG.7A) displayed on display section32.

Operation input section33may permit receiving input of the output instruction only when imaging information corresponding to the inspection region to be imaged is input (i.e., when the imaging information is stored in storage section34).

Conversely, operation input section33may reject receiving input of the output instruction when imaging information corresponding to the inspection region to be imaged is not input (i.e., when the imaging information is not stored in storage section34).

Furthermore, operation input section33may permit receiving input of the output instruction only when supplementary information associated with the inspection image data is input (i.e., when the supplementary information is stored in storage section34).

Conversely, operation input section33may reject receiving input of the output instruction when supplementary information associated with the inspection image data is not input (i.e., when the supplementary information is not stored in storage section34).

In other words, operation input section33may permit receiving input of the output instruction only when the imaging information corresponding to the inspection region to be imaged and the supplementary information associated with the inspection image data are input.

In one or more embodiments, operation input section33comprises a flat panel display with a touch panel that is integrally provided with display section32. The user can input imaging information, input supplementary information, operate imaging device2, and perform reproducing operations of the inspection image data via operation input section33.

Operation input section33is not limited to a flat display with a touch panel, and may be, for example, an input device such as a keyboard, a mouse, or a microphone instead.

Control section35(i.e., controller) includes Central Processing Unit (CPU)35aas a calculation/control device, Random Access Memory (RAM)35band Read Only Memory (ROM)35cas a main storage device. ROM35cstores basic programs and basic setting data. CPU35areads out programs corresponding to processing contents from ROM35cor storage section34, loads the programs into RAM35b, and performs centralized control of operations of the respective blocks of gas detection device1by executing the loaded programs. Control section35having such a configuration controls imaging device2, display section32, operation input section33, and storage section34depending on their functions and thereby controls the entire gas detection device1.

In one or more embodiments, functions of each functional block can be realized by the cooperation of each hardware constituting the functional blocks and control section35. Note that, a part or all of the functions of each functional block may be realized by execution of the programs by control section35.

Storage section34(i.e., storage) is, for example, an auxiliary storage device such as a nonvolatile semiconductor memory (a so-called flash memory) or a hard disk drive. Storage section34may be a disk drive for reading and writing information by driving an optical disk such as a Compact Disc (CD) or a Digital Versatile Disc (DVD), or a Magneto-Optical Disk (MO). In addition, for example, storage section34may be a memory card such as a USB memory or an SD card.

Storage section34stores the imaging information input from operation input section33. Writing of data into storage section34and reading of data from storage section34are controlled by control section35.

Storage section34stores the inspection image data received from image processing section31a. Storage section34stores the inspection image data in association with the imaging information.

Storage section34may store the infrared image data after image processing received from image processing section31a. Storage section34may store the infrared image data in association with the imaging information.

Storage section34may store the infrared image data before image processing generated by infrared imaging section22. Storage section34may store the infrared image data before image processing in association with the imaging information.

Storage section34may store the visible image data generated by visible light imaging section21. Storage section34may store the visible image data in association with the imaging information.

Storage section34stores various pieces of information input from operation input section33. In particular, storage section34stores the supplementary information input from operation input section33. Storage section34stores the supplementary information in association with inspection image7(seeFIG.5A) displayed on display section32when the supplementary information is input. When inspection image7is a moving image, storage section34stores the supplementary information in association with a frame constituting inspection image7(seeFIG.5A) displayed on display section32when the supplementary information is input.

Storage section34stores image data relating to supplementary information input image5. Storage section34also stores image data relating to seek bar image53. The image data relating to seek bar image53include image data relating to first bar element53a, second bar element53b, and first mark53cto fourth mark53fdescribed above.

Next, an exemplary operation of gas detection device1according to one or more embodiments of the present invention will be described with reference toFIGS.2to4.FIG.2is a flowchart illustrating an exemplary imaging flow of gas detection device1.FIG.3is a flowchart illustrating an exemplary reproduction flow of gas detection device1.FIG.4is a flowchart illustrating an exemplary output flow of gas detection device1.

An operation of gas detection device1when the user inputs the supplementary information at any timing during imaging by gas detection device1will be described with reference toFIGS.1,2,5A, and5B. Imaging by gas detection device1is performed while gas detection device1is placed in a predetermined position from where the inspection region including the inspection target can be imaged. Gas detection device1is placed in, for example, a predetermined position in a supported state by a tripod.

When an imaging start instruction is input from operation input section33, gas detection device1starts the imaging flow illustrated inFIG.2. The processing described below realized, for example, by CPU35aexecuting a predetermined program stored in ROM35c(seeFIG.1) after the imaging start instruction is input in gas detection device1.

In step S101inFIG.2, display processing section31bdisplays an imaging information input image (not illustrated) for inputting imaging information on display section32under the control of control section35. In other words, in step S101inFIG.2, gas detection device1requests the user to input imaging information.

In step S101inFIG.2, imaging information requested to the user by gas detection device1is, in one example, the information illustrated in table 1.

In step S101inFIG.2, in a case where an inspection region to be imaged has been imaged in the past, control section35may obtain the imaging information from imaging history. The imaging history is stored in storage section34. Such imaging information is stored in association with the inspection region in storage section34.

In step S102inFIG.2, control section35determines the presence or absence of input of imaging information (including the imaging information from the imaging history).

In step S102, when it is determined that no imaging information is input (“NO” in step S102), control processing shifts to step S101. By contrast, in step S102, when it is determined that imaging information is input (“YES” in step S102), control processing shifts to step S103. Note that, the determination in step S102may be omitted as a modified example of the flowchart illustrated inFIG.2. That is, the control processing may shift to step S103regardless of whether the imaging information is input in step S101.

In step S103inFIG.2, imaging device2starts imaging of the inspection region under the control of control section35. Imaging device2sequentially outputs visible image data to processing section31(specifically image processing section31a) during imaging. In addition, imaging device2sequentially outputs infrared image data to processing section31(specifically image processing section31a) during imaging. The visible image data and the infrared image data generated by imaging device2may be stored in storage section34.

During imaging by imaging device2, image processing section31areceives infrared image data from infrared imaging section22. Then, image processing section31aperforms the gas visualization processing described above on the received infrared image data to generate infrared image data after image processing.

During imaging by imaging device2, image processing section31areceives visible image data from visible light imaging section21. Then, image processing section31agenerates inspection image data in which the received visible image data is combined with the infrared image data after image processing.

Image processing section31asequentially outputs the generated inspection image data to display processing section31bduring imaging by imaging device2. Display processing section31bconverts the received inspection image data into a display signal corresponding to display section32, and outputs the display signal to display inspection image7(seeFIG.5A) on display section32. Thus, during imaging by imaging device2, inspection image7of the inspection image is displayed in real time on display section32.

Note that, when gas detection device1is connected to a server via a network, display processing section31cmay transmit inspection image7to the server. Inspection image7received in the server may be displayed on a display section (e.g., a display) connected to the server (including a connection via a network). Such a configuration allows a person other than a person who took the image to visually recognize inspection image7of the inspection region from a remote place in real time. Gas detection device1may also be configured so that the other person can input the supplementary information described below from the remote place.

In addition, display processing section31balways displays supplementary information input image5(particularly first input image51) for inputting supplementary information on display section32during imaging by imaging device2.

In step S104inFIG.2, control section35determines the presence or absence of an input instruction of supplementary information. The presence or absence of an input instruction is determined, for example, whether first input image51is touch-operated by the user.

In step S104, when it is determined that no input of supplementary information is instructed (“NO” in step S104), control processing shifts to step S106. By contrast, in step S104, when it is determined that input of supplementary information is instructed (“YES” in step S104), control processing shifts to step S105.

In step S105inFIG.2, display processing section31bdisplays second input image52on display section32(seeFIG.5B) under the control of control section35. The user, in step S105, inputs the supplementary information from second input image52displayed on display section32. Specifically, the user, in step S105, inputs the displayed supplementary information related to inspection image7from second input image52while inspection image7is displayed on display section32. The processing of gas detection device1in step S105may be referred to as supplementary information input processing.

FIG.5Billustrates a screen of display section32on which second input image52is displayed. Second input image52includes importance input section52aand comment input section52b. The user can optionally input information related to importance of inspection image7displayed on display section32to importance input section52a. The information related to importance includes, for example, the terms “important”, “normal”, or “unnecessary”.

Furthermore, the user can input any comment related to inspection image7displayed on display section32to comment input section52b. The comment includes, for example, a comment related to a gas leak, such as “Gas leak is occurring”. The information related to importance and the comment as described above are supplementary information.

Note that, importance input section52amay be an input section having a multiple-choice system, such as importance input section52cillustrated inFIG.6A. In addition, importance input section52bmay be an input section having a multiple-choice system, such as importance input section52dillustrated inFIG.6B.

In importance input section52dillustrated inFIG.6B, display processing section31bobtains options of the comment (also referred to as “supplementary information candidates”) from storage section34, and displays on comment input section52bof display section32. The option of the comment may be, for example, information related to gas leak status information or regulation, which is prestored in storage section34.

The option of the comment may also be, for example, the comment that has been input in the past by the user. Furthermore, the option of the comment may change depending on inspection image7displayed on display section32. By way of example, the option of the comment may be determined based on the learning result that has been obtained by Artificial Intelligence (AI) learning the relationship between the comment that has been input in the past by the user and inspection image7having the comment.

In step S105, when the supplementary information is input, control section35stores in the storage section34the inspection image data that has been displayed on display section32(specifically, the frame constituting inspection image) in association with the supplementary information. The inspection image data to be associated with the supplementary information is the inspection image data displayed on display section32while second input image52is displayed on display section32.

The inspection image data to be associated with the supplementary information may only be the inspection image data displayed on display section32at the timing when second input image52is displayed on display section32(the timing when first input image51on display section32illustrated inFIG.5Ais operated).

Note that, in supplementary information input processing in step S105, the range of the inspection image data to be associated with the supplementary information may be designated by a selecting operation by the user.

In step S106inFIG.2, control section35determines the presence or absence of an imaging completion instruction. The imaging completion instruction is input from operation input section33by the user.

In step S106, when it is determined that no instruction to end imaging is input (“NO” in step S106), control processing shifts to step S104. By contrast, in step S106, when it is determined that an instruction to end imaging is input (“YES” in step S106), control processing shifts to step S107.

In step S107, control section35ends imaging by imaging device2. Thus, the control processing ends.

An operation of gas detection device1when the user inputs the supplementary information at any timing during reproduction of the inspection image data stored in storage section34will be described with reference toFIGS.1,3,7A, and7B.

When a reproduction start instruction is input from operation input section33, gas detection device1starts the reproduction flow illustrated inFIG.3. The processing described below is realized, for example, by CPU35aexecuting a predetermined program stored in ROM35cafter the reproduction start instruction is input in gas detection device1.

In step S201inFIG.3, display processing section31bobtains inspection image data from storage section34under the control of control section35. Display processing section31bconverts the obtained inspection image data into a display signal corresponding to display section32, and outputs the display signal to display inspection image7on display section32. Thus, the inspection image data stored in storage section34is displayed on display section32.

Display processing section31balways displays supplementary information input image5(particularly first input image51) for inputting supplementary information on display section32(seeFIG.7A) during reproduction of the inspection image data.

Further, display processing section31balways displays seek bar image53(seeFIG.7A) on display section32during reproduction of the inspection image data.

In step S202inFIG.3, control section35determines the presence or absence of an input instruction of supplementary information. The presence or absence of an input instruction is determined, for example, whether first input image51is touch-operated by the user.

In step S202, when it is determined that no input of supplementary information is instructed (“NO” in step S202), control processing shifts to step S204. By contrast, in step S202, when it is determined that input of supplementary information is instructed (“YES” in step S202), control processing shifts to step S203.

In step S203inFIG.3, display processing section31bdisplays second input image52on display section32(seeFIG.7B) under the control of control section35. The user, in step S203, inputs the supplementary information from second input image52displayed on display section32. Specifically, the user, in step S203, inputs the reproducing displayed supplementary information related to inspection image7from second input image52while inspection image7is reproducing displayed on display section32. The processing of gas detection device1in step S203may be referred to as supplementary information input processing. Since the supplementary information input processing is the same as the above imaging flow, a description thereof is omitted.

In step S203, when the supplementary information is input, control section35stores in storage section34the inspection image data that has been displayed on display section32(specifically, the frame constituting inspection image) in association with the supplementary information. The inspection image data to be associated with the supplementary information is the inspection image data displayed on display section32while second input image52is displayed on display section32.

In addition, when the supplementary information is input, display processing section31bcontrols display section32so as to additionally display third mark53eindicating the position where the supplementary information is added in the inspection image data on seek bar image53.

Note that, during reproduction of the inspection image data, display processing section31bmay display a content of the supplementary information on display section32when the reproducing position in seek bar image53(i.e., reproducing position mark53g) and the position of the supplementary information that has been input (e.g., third mark53e) approach to a predetermined range.

Furthermore, display processing section31bcontrols display section32so as to end displaying the content of supplementary information when the reproducing position in seek bar image53(i.e., the positon of reproducing position mark53gin seek bar image53) separates by a predetermined distance from third mark53e.

In step S204inFIG.3, control section35determines the presence or absence of a reproduction completion instruction. The reproduction completion instruction is input from operation input section33by the user.

In step S204, when it is determined that no instruction to end reproduction is input (“NO” in step S204), control processing shifts to step S202. By contrast, in step S204, when it is determined that an instruction to end reproduction is input (“YES” in step S204), control processing shifts to step S205.

In step S205, control section35ends reproduction. Thus, the control processing ends.

An operation of gas detection device1when generating output information and outputting the output information will be described with reference toFIG.4.

When an output instruction is input from operation input section33, gas detection device1starts the output flow illustrated inFIG.4. The processing described below is realized, for example, by CPU35aexecuting a predetermined program stored in ROM35cafter the output instruction is input in gas detection device1.

In step S301inFIG.4, control section35determines the presence or absence of imaging information.

In step S301, when it is determined that no imaging information is input (“NO” in step S301), the control processing ends. That is, gas detection device1prohibits generating output information in a case where no imaging information is input even when an output instruction has been input.

By contrast, in step S301, when it is determined that imaging information is input (“YES” in step S301), control processing shifts to step S302.

In step S302inFIG.4, output processing section31cgenerates output information including the imaging information and the inspection image data under the control of control section35. Note that, the output information may include information other than the imaging information and the image data. The user can designate information included in the output information via operation control section33.

In step S302, output processing section31cmay generate output information by extracting the inspection image data associated with the supplementary information from the inspection image data. In other words, the output information may include the inspection image data associated with the supplementary information in the inspection image data.

In step S302, the user may designate a range of the inspection image data to be extracted as output information from operation input section33. In this case, the output information includes the inspection image data corresponding to the range in the inspection image data.

Note that, the imaging information that is included in the output information generated in step S302may include at least, for example, the items listed in the above Table 1.

In step S303inFIG.4, output processing section31coutputs the output information to the output terminal (e.g., a printer) designated by the user or the storage medium (portable storage medium such as an optical disk, a magneto-optical disk, or a memory card) under the control of control section35. Output processing section31cmay automatically attach the output information to a certificate (a certificate file) related to the inspection target. The control processing of output flow then ends.

Functions and Effects

Using gas detection device1according to the embodiments described above, the user can input any supplementary information at any timing, while visually recognizing inspection image7displayed on display section32during imaging and reproduction by gas detection device1. Such supplementary information is stored in storage section34in association with inspection image7displayed on display section32when the supplementary information is input. The user can distinguish between an important part and an unimportant part in inspection image7by adding the supplementary information. In addition, the user can distinguish between an important part and an unimportant part in inspection image7by giving a meaning to inspection image7using the supplementary information. As a result, for example, data volume can be reduced by deleting the unimportant part from the inspection image data when inspection image7is stored. Furthermore, when the user checks inspection image7later, efficiency of checking operation can be improved by mainly checking the part having the supplementary information in inspection image7. Moreover, when the output information is generated to output, data volume of the output information can be reduced, and efficiency of checking operation of the output information can be improved by extracting, as the output information, the inspection image data to which the supplementary information has been added.

Other Embodiments

Next, gas detection device1according to one or more embodiments of the present invention will be described with reference to the drawings. Gas leakage detector1disclosed in PTL 1 allows an inspector to visually identify with ease a gas leak spot in an inspection region by visually recognizing an inspection image displayed on a display section. Incidentally, for the inspector, the importance of an inspection image in a normal time when an inspection target has no gas leak is significantly different from that of an inspection image in an emergency time when an inspection target has a gas leak. By way of example, the inspector needs to partially visually recognize only the inspection image in the emergency time while needing to continuously visually recognize the inspection image in a predetermined time including the inspection image in the normal time and the inspection image in the emergency time. However, the gas leakage detector disclosed in PTL 1 does not have a configuration satisfying such necessity.

FIG.8is a block diagram of gas detection device1according to one or more embodiments. Gas detection device1, for example, images an inspection region including an inspection target (e.g., a plant) in gas production facility. Then, gas detection device1performs image processing to detect a gas on the imaged data.

As illustrated inFIG.8, gas detection device1according to one or more embodiments of the present invention includes imaging device2and gas detection device body3. Hereinafter, the configuration that is different from imaging device2and gas detection device body3included in gas detection device1according to the above embodiments will be mainly described. The same reference signs are used for the same configurations, and thus, a description thereof is omitted.

The infrared sensor used for a second optical system of imaging device2is, for example, a quantum indium antimonide (INSb) image sensor, a heat-type thermopile array sensor, or a microbolometer, and receives infrared light to generate infrared image data. Infrared imaging section22having such a configuration images an inspection region including an inspection target (e.g., plant6ainFIG.9A) and sequentially outputs infrared image data to processing section31(specifically, image processing section31a).

Gas detection device body3includes, for example, processing section31, display section32, operation input section33, storage section34, and control section35.

Processing section31comprises at least one dedicated hardware (an electronic circuit) in accordance with a various kind of processing, such as a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), or a Programmable Logic Device (PLD).

Processing section31includes, as functional blocks, image processing section31a, display processing section31b, and output processing section31c, and time information generating section31d. Each function of processing section31to be described below is realized under the control of control section35.

Hereinafter, a function of image processing section31awill be described.

Image processing section31areceives infrared image data in the inspection region from infrared imaging section22.

Image processing section31aperforms a predetermined image processing on the infrared image data in the inspection region to detect a part having a gas.

Image processing section31a, for example, detects a part having a gas from the infrared image data and generates gas image data by visualizing the detected part. A well-known method can be used for detecting the part having a gas. Image processing section31aapplies a specific color (red or the like) to the part having a gas of the infrared image data. Image processing section31acorresponds to “gas detection section.”

Image processing section31areceives visible image data from visible light imaging section21. Image processing section31a, then, generates inspection image data in which the visible image data is combined with the gas image data. Image processing section31aalso generates temperature image data from the infrared image data. Image processing section31amay generate inspection image data in which the infrared image data is combined with the gas image data.

Image processing section31aoutputs the inspection image data to image processing section31band storage section34. Storage section34stores the inspection image data in association with a time of imaging of the infrared image data to be the basis of the inspection image data. More specifically, storage section34stores the inspection image data in association with detection time information indicating the time when a gas is detected by image processing section31a. Detection time information will be described below in detail.

Inspection image data is displayed on display section32as inspection image7(seeFIG.9A). Gas image7a(seeFIG.9A) illustrating the gas in inspection image7is colored in the specific color.

Hereinafter, a function of display processing section31bwill be described. The function of display processing section31bis realized under the control of control section35. Display processing section31bhaving such a configuration controls display of display section32to be described below.

Display processing section31bdisplays an imaging information input image (not illustrated) for inputting imaging information on display section32. The imaging information includes various pieces of information required to start imaging by imaging device2. By way of example, the imaging information includes; customer Identification (ID), user ID, inspector (Name), inspector (Company/Dept), inspection date, inspection type, site name, facility name, facility ID, latitude and longitude of the facility positioned by Global Positioning System (GPS), and/or the like. Image data to be the basis of the imaging information input image is prestored in storage section34.

Display processing section31bconverts the inspection image data received from image processing section31ainto a display signal corresponding to display section32, and outputs the display signal to display inspection image7(seeFIG.9A) on display section32.

Display processing section31bdisplays supplementary information input image5(seeFIG.9A) for inputting supplementary information related to inspection image7on display section32with inspection image7. The supplementary information includes information related to importance of and a comment on inspection image7displayed on display section32. The information related to importance includes, for example, the terms “important”, “normal”, or “unnecessary”. The comment includes, for example, comment related to a gas leak, such as “Gas leak is occurring”.

FIG.9Aillustrates examples of inspection image7and supplementary information input image5displayed on display section32. Information input image5is, for example, an icon. Image data to be the basis of supplementary information input image5is prestored in storage section34. Supplementary information input image5may be comprised of a plurality of images to be sequentially pop-up displayed respectively for input items corresponding to touch operations by a user.

In one or more embodiments, supplementary information input image5is comprised of first input image51(seeFIG.9A) always displayed on display section32with inspection image7, and second input image52(seeFIG.9B) displayed on display section32when the user operates (e.g., by touch operation) first input image51.

Display processing section31bdisplays second input image52on display section32when first input image51is operated by the user. Second input image52includes importance input section52aand comment input section52b. The user can optionally input information related to importance of inspection image7displayed on display section32to importance input section52a. Furthermore, the user can input a comment related to inspection image7displayed on display section32to comment input section52b. Note that, importance input section52amay be an input section in which input items selectively displayed in a pull-down system, such as importance input section52cillustrated inFIG.10A. Comment input section52bmay be an input section in which input items selectively displayed in a pull-down system, such as importance input section52dillustrated inFIG.10B.

The time when first input image51is operated is stored in storage section34in association with the image that is imaged by imaging device2and time information of inspection image7. The supplementary information may be stored during reproduction as well as during recording.

In a case where OK button52eis pressed via operation input section33while second input image52is displayed on display section32, display processing section31bdeletes second input image52from display section32. Display processing section31bmay delete second input image52after a predetermined time passes from the start of pop-up display of second input image52.

When an instruction for reproduction start (hereinafter referred to as “reproduction start instruction”) is input via operation input section33, display processing section31bconverts the inspection image data stored in storage section34into a display signal corresponding to display section32, and outputs the display signal to display inspection image7on display section32. In this case, display processing section31bdisplays supplementary information input image5with inspection image7on display section32.

Output processing section31cgenerates output information including the inspection image data under the control of control section35. Output processing section31cgenerates output information when an output instruction is input from operation input section33.

Output processing section31coutputs the output information to, for example, an output device such as printer. The output device may be connected to detection device body3by a wired or wireless connection. The output device also may be connected to detection device body3via a network such as the Internet. Output processing section31cmay output the output information to a portable storage medium, such as an optical disk, a magneto-optical disk, or a memory card.

Note that, when gas detection device1is connected to a server via a network, output processing section31cmay output the output information to the server.

Control section35includes Central Processing Unit (CPU)35aas a calculation/control device, Random Access Memory (RAM)35band Read Only Memory (ROM)35cas a main storage device. ROM35cstores basic programs and basic setting data. CPU35areads out programs corresponding to processing contents from ROM35cor storage section34, loads the programs into RAM35b, and performs centralized control of operations of the respective blocks of gas detection device1by executing the loaded programs. Control section35having such a configuration controls imaging device2, display section32, operation input section33, and storage section34depending on their functions and thereby controls the entire gas detection device1.

In one or more embodiments, functions of each functional block can be realized by the cooperation of each hardware constituting the functional blocks and control section35. Note that, a part or all of the functions of each functional block may be realized by execution of the programs by control section35.

Control section35determines reliability of the gas detection based on signals from temperature sensor81, wind speed sensor82and peripheral sensor8of vibration sensor83. Temperature sensor81measures an ambient temperature around gas detection device1. Wind speed sensor82measures wind speed around gas detection device1or the inspection target. The wind speed can be obtained as wind speed information around the imaging spot using a network. Vibration sensor83measures a vibration state of imaging device2. Control section35determines the reliability of the gas detection is low in cases where: a difference in temperature between the temperature indicated by the inspection image of the inspection region imaged by infrared imaging section22and the temperature indicated by temperature sensor81is lower than or equal to a predetermined temperature; a wind speed indicated by wind speed sensor82is greater than or equal to a predetermined value; and a value indicated by vibration sensor83is greater than or equal to a predetermined value. Control section35, then, determines the gas detection information obtained by the image processing in this time slot is invalid in these cases. Control section35stores in storage section34the time information of inspection image7and the invalid information in association with each other.

Storage section34is, for example, an auxiliary storage device such as a nonvolatile semiconductor memory (a so-called flash memory) or a hard disk drive. Storage section34may be a disk drive for reading and writing information by driving an optical disk such as a Compact Disc (CD) or a Digital Versatile Disc (DVD), or a Magneto-Optical Disk (MO). In addition, for example, storage section34may be a memory card such as a USB memory or an SD card.

Storage section34stores the imaging information input from operation input section33. Writing of data into storage section34and reading of data from storage section34are controlled by control section35.

Storage section34stores the inspection image data received from image processing section31a. Storage section34stores the inspection image data in association with the imaging information. Storage section34stores the inspection image data in association with the detection time information indicating the time when a gas is detected by image processing section31a.

Storage section34may store the infrared image data after image processing received from image processing section31a. Storage section34may store the infrared image data after image processing in association with the imaging information. Storage section34may store the infrared image data after image processing in association with the detection time information.

Storage section34may store the infrared image data before image processing generated by infrared imaging section22. Storage section34may store the infrared image data before image processing in association with the imaging information. Storage section34may store the infrared image data before image processing in association with the detection time information.

Storage section34may store the visible image data generated by visible light imaging section21. Storage section34may store the visible image data in association with the imaging information. Storage section34may store the visible image data in association with the detection time information.

Storage section34may store the temperature image data. Storage section34may store the temperature image data in association with the detection time information.

Storage section34stores various pieces of information input from operation input section33. In particular, storage section34stores the supplementary information input from operation input section33. Storage section34stores the supplementary information in association with inspection image7(seeFIG.11A) displayed on display section32when the supplementary information is input. When inspection image7is a moving image, Storage section34stores the supplementary information in association with a frame constituting inspection image7displayed on display section32when the supplementary information is input. The supplementary information may be stored in association with the infrared image data after image processing, the infrared image data before image processing the visible image data or the temperature image data, individually.

In addition, the information related to the reliability of the gas detection is stored in association with the image data. The information related to the reliability of the gas detection may be stored in association with the infrared image data after image processing, the infrared image data before image processing the visible image data or the temperature image data, individually.

Storage section34stores image data related of supplementary information input image5.

Display section32is, for example, a display of a mobile terminal constituting gas detection device body3. As the display, a liquid crystal display, an organic EL display, or the like can be used. In one or more embodiments, the display is a flat panel display having a touch panel.

Display section32displays various kinds of images based on the display signals from display processing section31b(seeFIG.8) under the control of control section35. Specifically, display section32displays inspection image7for the user to visually detect a gas (seeFIG.9A) and the like.

Operation input section33is an input section that receives, for example, input of imaging information. Operation input section33also receives an operation relating to reproduction of the inspection image data and an operation relating to imaging of imaging device2.

Operation input section33receives an output instruction related to imaging. Operation input section33may receive, for example, designation of items to be included in the output information, together with the output instruction. The items of the output information include imaging information and any other information (e.g., weather information during imaging).

In one or more embodiments, operation input section33comprises a flat panel display with a touch panel that is integrally provided with display section32. The user can input imaging information, operate imaging device2, and perform reproducing operations of the inspection image data via operation input section33.

Operation input section33is not limited to a flat display with a touch panel, and may be, for example, an input device such as a keyboard, a mouse, or a microphone instead.

According to gas detection device1described above, when a gas is detected in an inspection region, a gas detection report is prepared and submitted to a requester (a client). For preparation of the report, the inspection image data is reproduced to confirm the inspection image. When a reproduction start instruction is input via operation input section33, display processing section31bconverts the inspection image data read out from storage section34into a display signal corresponding to display section32, and then outputs the display signal to display inspection image7(seeFIG.9A) on display section32. The user (the inspector) identifies specifies, for example, a gas leak spot in the inspection region, gas leak occurrence time, and a situation after occurrence of the gas leak by visually recognizing inspection image7.

Incidentally, for the user, the importance of an inspection image in a normal time when an inspection target has no gas leak is significantly different from that of an inspection image in an emergency time when an inspection target has a gas leak. By way of example, the inspector needs to partially visually recognize only the inspection image in the emergency time while needing to continuously visually recognize the inspection image in a predetermined time including the inspection image in the normal time and the inspection image in the emergency time. That is, the user requires to visually recognize inspection image7effectively in accordance with user's own desire.

Thus, in one or more embodiments, when a reproduction start instruction is input, display processing section31bconverts the inspection image data read out from storage section34into a display signal corresponding to display section32, and then outputs the display signal to display inspection image7on display section32. In this case, display processing section31bdisplays seek bar image53(seeFIG.11A) visualizing a display position on a time axis with inspection image7on display section32.

Image data to be the basis of seek bar image53is prestored in storage section34. InFIGS.11A and11B, as components of seek bar image53, first bar element53a, second bar element53b, third bar element53p, fourth bar element53q, fifth bar element53r, and sixth bar element53s. First bar element53ameans time when no gas is detected. Second bar element53bmeans time when a gas is detected by image processing section31a. Third bar element53pmeans a part where inspection image data are absent or deleted. Fourth bar element53qmeans an invalid part of the inspection image data. Fifth bar element53rmeans a reproduced part of inspection image7. Sixth bar element53smeans an unreproduced part of inspection image7. Note that, second bar element53bcorresponds to “detection time information.”

Hereinafter, a function of time information generating section31dwill be described. The function of time information generating section31dis realized under the control of control section35.

Time information generating section31dgenerates image data to be the basis of first bar element53aand second bar element53bbased on the time when the infrared image data to be the basis of the inspection image data is imaged. Time information generating section31dgenerates image data to be the basis of fourth bar element53qbased on the reliability information stored in storage section34.

Time information generating section31dgenerates fifth bar element53rand sixth bar element53saccording to the reproduced part of inspection image7.

Display processing section31bdisplays first bar element53a, second bar element53b, third bar element53p, fourth bar element53q, fifth bar element53r, and sixth bar element53son display section32, being reflected in seek bar image53.

Another element to be displayed, being reflected in seek bar image53will be described with reference toFIGS.11A and11B. In the following description, each mark of first mark53cto fourth mark53fis referred to as evidence mark. The evidence mark is displayed on seek bar image53. A position where the evidence mark is displayed indicates time (reception time information) when input of the supplementary information is received. The evidence mark is a part indicating the supplementary information added by the user.

Display processing section31bemphatically displays (for example, display in bold or highlighted) third mark53e, which is located on after reproducing position mark53g(seeFIG.11A, also referred to as a “slider”) indicating a position where the inspection image is reproduced, and which is the nearest mark from reproducing position mark53g. In a case where third mark53eis emphatically displayed, time information generating section31dgenerates selection range information53hindicating the time slot selected in accordance with third mark53e.

Specifically, time information generating section31dgenerates, as selection range information53h, a certain time (a time slot) starting from a position prior to and apart from third mark53eby a predetermined time to a position later than and apart from third mark53eby a predetermined time.

InFIGS.11A and11B, fifth mark53imeans a front of selection range information53h. Sixth mark53jmeans a rear of selection range information53h. The user can optionally change selection range information53hby moving positions of fifth mark53ior sixth mark53jvia operation input section33.

Another element to be displayed, being reflected in seek bar image53will be described with reference toFIG.11A. First mark53cto be displayed, being reflected in seek bar image53means a part to which supplementary information having high importance is added. Second mark53dmeans a part to which supplementary information having low importance is added. Third mark53eand fourth mark53fmean a part to which other supplementary information is added.

As illustrated inFIGS.11A and11B, selection range information53hincludes third mark53e. InFIGS.11A and11B, third mark53eis selected, and selection range information53hcorresponding to third mark53eis displayed. When fourth mark53fis selected, selection range information corresponding to fourth mark53f(not illustrated) is displayed.

When designation of third mark53e(or fourth mark53f) is input from operation section33, output processing section31cgenerates the supplementary information related to third mark53e(or fourth mark53f) as output information and outputs the supplementary information to another device. The other device includes: for example, a local folder of a Personal Computer (PC) or a flash memory such as an SD card in a case where gas detection device1is connected to a PC via a network, an output device such as a server or a printer in a case where gas detection device1is connected to a server via a network, and a portable storage medium such as an optical disk.

When outputting the supplementary information, output processing section31creads out the inspection image data associated with third mark53e(or fourth mark53f) from storage section34and outputs the inspection image data to another device.

An exemplary operation of gas detection device1will be described with reference toFIG.12.FIG.12is a flowchart illustrating an exemplary operation of the gas detection device1.

Firstly, in step S400illustrated inFIG.12, image processing section31areceives infrared image data from infrared imaging section22and receives visible light image data from visible light imaging section21.

Next, in step S410, image processing section31agenerates an inspection image data based on the infrared image data and the visible light image data.

Next, in step S420, control section35stores the inspection image data in storage section34.

Next, in step S430, control section35determines whether an instruction to reproduce inspection image data7is input via operation section33. When the reproduction instruction is input (“YES” in step S430), processing shifts to step S440. When the reproduction instruction is not input (“NO” in step S430), processing returns to the condition before step S430.

Next, in step S440, processing section31generates a reproduction screen. Specifically, time information generating section31dgenerates the image data of first bar element53a, second bar element53b, third bar element53p, and fourth bar element53q.

Next, in step S450, display processing section31bdisplays the reproduction screen on display section32. Thus, seek bar image53is displayed in the first region of the reproduction screen. Seek bar image53is displayed in the second region of the reproduction screen. Supplementary information input image5is displayed in the third region of the reproduction screen.

Gas detection device1according to the embodiments described above includes: image processing section31athat visualizes a gas in the inspection region by performing the image processing on the infrared image data in the inspection region imaged by infrared imaging section22; a gas detection section (image processing section31a) that detects the gas based on a result of the image processing; and display processing section31bthat displays inspection image7reflecting the result of the image processing and displays second bar element53b(detection time information) indicating a time when the gas is detected by image processing section31a. Such gas detection device1enables visually recognizing inspection image7efficiently based on second bar element53b. As a result, the user can select with ease inspection image7corresponding to second bar element53bfrom among inspection images7and submit, to a requester (a client), selected inspection image7attaching a report.

In the above embodiments, display processing section31bemphatically displays an evidence mark according to a position of reproducing position mark53g(a slider). For example, when the position of the slider is located in a predetermined time of an evidence mark, display processing section31bemphatically displays the next evidence mark in the same predetermined time. This enables visually recognizing inspection image7efficiently based on the importance of the emphatically displayed evidence mark.

In the above embodiments, when any one of first mark53cto fourth mark53fis designated via operation input section33, display processing section31bmay display reproducing position mark53g(the slider) returning to the position corresponding the initial frame of an offset value (e.g., an amount of data in a predetermined few seconds) from the designated mark.

In the above embodiments, when a position other than the slider in seek bar53is tapped via operation input section33, display processing section31bmay display the slider, moving the slider to the tapped position. Thus, the reproduction of inspection image7is continued from the tapped position. In addition, when the slider is held via operation input section33, display processing section31bmay display the slider, holding the slider in the hold position. Thus, the reproduction of inspection image7is stopped when inspection image7is being reproduced. Furthermore, when the slider is released via operation input section33, display processing section31bmay display the slider in a released state. Thus, the reproduction of inspection image7is resumed.

In the above embodiments, an evidence (supplementary information) having high importance may be set in a higher layer. By contrast, an evidence having low importance or an unnecessary evidence may be set in a lower layer. When the importance is the same among evidences, the more recently updated evidence may be set in a higher layer. When an evidence mark is emphatically displayed, the evidence may be moved to the higher layer so as to be easily selected. Since the position of the layer changes depending on the importance of the evidence, the evidence can be handled easily.

In the above embodiments, time information generating section31dgenerates selection range information53hsuch that fourth bar element53qthat means an invalid part of the inspection image data is not included in selection range information53h.

In the above embodiments, display processing section31bmay display second bar element53bindicating a time when a gas is detected, while changing the depth of a color according to an amount of leaked gas. This enables the user to recognize the degree of risk. Display processing section31bmay display second bar element53bmore emphatically when the amount of leaked gas exceeds a predetermined amount. In this case, display processing section31b, for example, may display a screen of inspection image7so as to surround the screen of inspection image7by a red frame.

In the above embodiments, display processing section31bmay display seek bar image53, while reflecting thereon a mark indicating a separation position for every predetermined time of data.

In the above embodiments, display processing section31bdisplays seek bar image53during reproduction of inspection image7; however, seek bar image53is not limited to this and may be displayed during imaging.

In the above embodiments, display processing section31bdisplays seek bar image53corresponding to inspection image7; however, seek bar image53may be displayed corresponding to infrared image data after image processing, infrared image data before image processing, visible image, or temperature image.

Although the disclosure has been described with respect to only a limited number of embodiments, those skill in the art, having benefit of this disclosure, will appreciate that various other embodiments may be devised without departing from the scope of the present invention. Accordingly, the scope of the invention should be limited only by the attached claims.

REFERENCE SIGNS LIST