Patent ID: 12243217

DETAILED DESCRIPTION OF THE EMBODIMENTS

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the drawings are only schematically illustrated to the extent that the present invention can be sufficiently understood. Therefore, the present invention is not limited only to illustrated examples. Further, in the drawings, the same reference numerals are given to common components and similar components, and redundant description thereof will be omitted.

<Configuration of Data Input Device and Data Input System>

Hereinafter, configurations of a data input device11and a data input system10implemented by the data input device11according to one or more embodiments of the present invention will be described with reference toFIGS.1and2.FIG.1is a diagram illustrating a configuration of the data input system10including the data input device11according to one or more embodiments.FIG.2is a block diagram mainly illustrating a configuration of the data input device11according to one or more embodiments.

As illustrated inFIG.1, the data input system10includes the data input device11, a camera12, a universal serial bus (USB) memory13, a support terminal14, and a data server15.

The data input device11is operated by an operator (worker) to input data of various inspection items. In one or more embodiments, it will be described assuming that the data input device11is formed by a portable terminal such as a tablet device, a notebook personal computer, or a smartphone.

The camera12is a device that captures an image of an inspection location. In one or more embodiments, the camera12has a function of acquiring a color captured image (a visible light image, in particular, a visible light moving image), an infrared image (in particular, an infrared moving image), and GPS data (position data).

The USB memory13is a portable storage medium that stores various control instructions (programs) and data. In one or more embodiments, it will be described assuming a case where the storage medium is formed by the USB memory13. However, the storage medium can be formed by, for example, a semiconductor memory other than a USB memory, an HDD device, an optical medium such as a CD-ROM or a DVD, a magnetic medium such as a flexible disk, or other forms.

The support terminal14is a device that performs providing various control instructions and data to the data input device11, transferring the inspection record (inspection form) from the data input device11to the data server15, and the like. The support terminal14can read the inspection record (inspection form) from the data server15, edit the inspection record (inspection form) into a predetermined format, and print the inspection record (inspection form) on paper by a printer that is not illustrated. Note that, in one or more embodiments, it will be described assuming that definitively registered inspection data D16(seeFIG.2) to be described later corresponds to the inspection record (inspection form).

The data server15is a server that stores various data. In one or more embodiments, the data server15stores the definitively registered inspection data D16(seeFIG.2) to be described later as the inspection record (inspection form).

The data input device11is communicably connected to the camera12via, for example, a communication cable or wirelessly. Further, the data input device11is communicably connected to the USB memory13by inserting the USB memory13into a USB port provided therein. As in the data input device11, the support terminal14is communicably connected to the USB memory13by inserting the USB memory13into a USB port provided therein. The data input device11and the support terminal14indirectly transmit and receive various instructions and data via the USB memory13. However, the data input device11and the support terminal14may directly transmit and receive various instructions and data via a communication line. The support terminal14is communicably connected to the data server15via a communication line.

As illustrated inFIG.2, the data input device11includes a control unit (“controller”)21, a storage unit (“storage”)22, and a display unit (“display”)23.

The control unit21is a means that intensively controls each unit of the data input device11. The control unit21includes a microcomputer or the like. By executing control instructions (a program) Pr stored in the storage unit22, the microcomputer constituting the control unit21functions as a display control unit21a, an operation detection unit21b, an inspection data creation unit21c, a GPS data acquisition unit21d, a captured image acquisition unit21e, an infrared image acquisition unit21f, and an image analysis unit21g.

The display control unit21ais a means that controls display on the display unit23. The display control unit21acreates various screens and displays the screens on the display unit23.

The operation detection unit21bis a means that detects an operation of an operator (worker).

The inspection data creation unit21cis a means that creates inspection data (temporarily registered inspection data D15and the definitively registered inspection data D16to be described later) related to a facility.

The GPS data acquisition unit21dis a means (position data acquisition unit) that acquires GPS data D14(position data) to be described later from the camera12. However, by incorporating a GPS circuit in the data input device11, the GPS data acquisition unit21dcan also acquire GPS data (position data) indicating position coordinates of its own current location point from a GPS satellite using the GPS circuit.

The captured image acquisition unit21eis a means that acquires a captured image91(seeFIGS.7B to7F) from the camera12. In the captured image91, a facility (in particular, a component of the facility to be inspected) is captured. In one or more embodiments, it will be described assuming that the captured image91is a moving image.

The infrared image acquisition unit21fis a means that acquires an infrared image92(seeFIG.7F) from the camera12. In the infrared image92, infrared rays radiated from the facility (in particular, the component of the facility to be inspected) are captured. In one or more embodiments, it will be described assuming that the infrared image92is a moving image.

The image analysis unit21gis a means that creates an analysis image obtained by analyzing a situation of the facility (in particular, the component of the facility to be inspected) on the basis of an infrared image acquired from the camera12. Note that the image analysis unit21gcan create an analysis image on the basis of not only the infrared image but also both the infrared image and the captured image (visible light image).

In one or more embodiments, it will be described assuming that the image analysis unit21gcreates, for example, an intermediate image93, a temperature image94, an infrared-gas cloud superimposed image95, and a visible light-gas cloud superimposed image96each illustrated inFIG.7Gas analysis images. Note that the image analysis unit21gmay further create a high-sensitivity intermediate image (not illustrated) obtained by increasing sensitivity of the intermediate image93.

The intermediate image93(seeFIG.7G) is an image obtained by visualizing a temperature change due to gas fluctuation, and is an image obtained by extracting gas cloud candidates.

The temperature image94(seeFIG.7G) is a colorized image obtained by converting a luminance value obtained from the infrared image into a temperature value.

The infrared-gas cloud superimposed image95(seeFIG.7G) is an image in which a gas region extracted by performing image processing on the intermediate image93is superimposed on the infrared image.

The visible light-gas cloud superimposed image96(seeFIG.7G) is an image in which a gas region extracted by performing image processing on the intermediate image93is superimposed on the captured image (visible light image).

In one or more embodiments, it will be described assuming that the analysis images (in the example illustrated inFIG.7G, the intermediate image93, the temperature image94, the infrared-gas cloud superimposed image95, and the visible light-gas cloud superimposed image96) are moving images.

The storage unit22stores the control instructions Pr, inspection item data D11, facility data D12, registered image data D13, the GPS data D14, the temporarily registered inspection data D15, and the definitively registered inspection data D16.

The control instructions Pr are instructions that cause the microcomputer constituting the control unit21to execute a predetermined operation.

The inspection item data D11is data specifying an inspection item.

The facility data D12is data related to each facility to be inspected.

The registered image data D13is the captured image (visible light image) of a facility acquired in the past.

The GPS data D14is position data indicating position coordinates of the camera12acquired by the GPS data acquisition unit21d. The GPS data D14indicates the position of the camera12by longitude and latitude. Note that since the camera12captures an image of a facility in the vicinity of the facility, the position coordinates of the camera12are substantially the same as position coordinates of the facility.

The temporarily registered inspection data D15is inspection data of a temporarily registered facility.

The definitively registered inspection data D16is inspection data of a facility that is registered definitively. The definitively registered inspection data D16is obtained by definitively registering the temporarily registered inspection data D15.

Details of the inspection item data D11, the facility data D12, the temporarily registered inspection data D15, and the definitively registered inspection data D16will be described later.

The display unit23includes, for example, a touch panel display, and also serves as an input unit. The display unit23displays, for example, a login screen (not illustrated), an input screen50(seeFIGS.7A to7G), and the like.

The camera12connected to the data input device11is configured as a unit including a visible light camera31, an infrared camera32, and a GPS circuit33.

The visible light camera31is a means that acquires the captured image (visible light image) of the facility.

The infrared camera32is a means that acquires an infrared image of the facility. The infrared camera32is arranged near the visible light camera31and captures an image of the same object as the visible light camera31.

The GPS circuit33is a circuit that acquires the GPS data D14indicating the position coordinates of the current location point from the GPS satellite.

The data input device11acquires the captured image, the infrared image, and the GPS data D14from the camera12.

The USB memory13inserted into the USB port (not illustrated) of the data input device11stores the control instructions Pr, the inspection item data D11, and the facility data D12each described above. The data input device11acquires the control instructions Pr, the inspection item data D11, and the facility data D12from the USB memory13, and stores them in the storage unit22.

<Configuration of Main Data>

Hereinafter, a configuration of main data will be described with reference toFIGS.3to5B.FIG.3is an explanatory diagram illustrating a configuration of the inspection item data D11.FIG.4is an explanatory diagram illustrating a configuration of the facility data D12.FIG.5Ais an explanatory diagram illustrating a configuration of the temporarily registered inspection data D15.FIG.5Bis an explanatory diagram illustrating a configuration of the definitively registered inspection data D16.

In the example illustrated inFIG.3, the inspection item data D11includes a “date” field, an “inspectors name” field, a “facility name” field, an “equipment name” field, an “image capturing distance” field, an “initial inspection/reinspection” field, a “presence or absence of leak” field, and an “inspection completed/incomplete” field.

The “date” field is a field for registering date data. The “date” field may include hour, minute, and second data.

The “inspector name” field is a field for registering an inspector name.

The “facility name” field is a field for registering a facility name.

The “equipment name” field is a field for registering an equipment name.

The “image capturing distance” field is a field for registering an image capturing distance from the camera12to the facility (in particular, the component of the facility to be inspected).

The “initial inspection/reinspection” field is a field for registering data indicating whether the inspection is a first-time inspection (initial inspection) or a reinspection.

The “presence or absence of leak” field is a field for registering data indicating whether or not there is a gas leak.

The “inspection completed/incomplete” field is a field for registering data indicating whether or not the inspection is completed.

In the example illustrated inFIG.4, the facility data D12includes the “position coordinates” field, the “facility name” field, the “equipment name” field, the “component name” field, a “registered image” field, and the “image capturing distance” field. Here, description of the same field as described above is omitted.

The “position coordinates” field is a field for registering data indicating the position coordinates of each facility. The “position coordinates” field may include data indicating the altitude of each facility.

The “facility name” field and the “equipment name” field are as described above.

The “component name” field is a field for registering a component name.

The “registered image” field is a field for registering data (or the registered image data D13itself) for reading the registered image data D13stored in the storage unit22.

The “image capturing distance” field is a field for registering data indicating the image capturing distance of the registered image.

In the example illustrated inFIG.5A, the temporarily registered inspection data D15includes the “date” field, the “inspector name” field, the “facility name” field, the “equipment name” field, the “component name” field, a “captured image” field, the “image capturing distance” field, an “infrared image” field, an “analysis image” field, the “initial inspection/reinspection” field, the “presence or absence of leak” field, and the “inspection completed/incomplete” field. Here, description of the same field as described above is omitted.

The “date” field, the “inspector name” field, the “facility name” field, the “equipment name” field, and the “component name” field are as described above.

The “captured image” field is a field for registering the captured image (visible light image) of the facility acquired from the camera12.

The “image capturing distance” field is a field for registering the image capturing distance at the time of capturing the captured image (visible light image). In the “image capturing distance” field, the image capturing distance may be registered in stages, for example, “large”, “medium”, “small”, and the like.

The “infrared image” field is a field for registering an infrared image of the facility acquired from the camera12.

The “analysis image” field is a field for registering the above-described analysis images (for example, the intermediate image93, the temperature image94, the infrared-gas cloud superimposed image95, the visible light-gas cloud superimposed image96, and the like each illustrated inFIG.7G).

The “initial inspection/reinspection” field, the “presence or absence of leak” field, and the “inspection completed/incomplete” field are as described above.

The definitively registered inspection data D16illustrated inFIG.5Bis similar in configuration to the temporarily registered inspection data D15illustrated inFIG.5A. In the definitively registered inspection data D16, data that is blank in the “presence or absence of leak” field and the “inspection completed/incomplete” field of the temporarily registered inspection data D15is registered.

<Operation of Data Input Device>

Hereinafter, an operation of the data input device11will be described with reference toFIGS.6A to7G.FIGS.6A and6Bare flowcharts each illustrating the operation of the data input device11.FIGS.7A to7Gare explanatory diagrams each illustrating a configuration of the input screen50.

The display control unit21aof the data input device11displays the login screen (not illustrated) on the display unit23when the data input device11is activated. The operator (worker) starts application instructions of the data input device11by inputting an ID and a password in an identification (ID: identification number) input field and a password input field provided on the login screen (not illustrated).

Thereafter, the operator performs an operation for creating the inspection record (inspection form). In response to this, as illustrated inFIG.6A, the display control unit21aof the data input device11creates the input screen50(seeFIG.7A) and displays the input screen50on the display unit23(step S105).

In the example illustrated inFIG.7A, the input screen50includes an acquisition button51, an image capturing mode button52, a reproduction mode button53, a date display field54, a distance setting operation field55, a position adjustment operation field56, a first inspection start button57, a second inspection start button58, an inspection location input field70, and an image display field80.

The acquisition button51is a button for instructing the data input device11to acquire the GPS data D14from the camera12.

The image capturing mode button52is a button for instructing the camera12to capture an image.

The reproduction mode button53is a button for instructing reproduction of a captured image captured by the camera12.

The date display field54is a field in which date data is displayed. The inspection data creation unit21cautomatically inputs date data acquired from a timer (not illustrated) to the date display field54.

The distance setting operation field55is a button for performing an operation of setting the image capturing distance. In a state immediately after the input screen50is displayed on the display unit23, the image capturing distance is set to a default value (“40 m” in the illustrated example).

The position adjustment operation field56is a button for performing an adjustment operation of a position where the captured image91(seeFIG.7F) to be described later and the infrared image92(seeFIG.7F) to be described later are overlaid.

The first inspection start button57is a button for instructing the data input device11to start the initial inspection.

The second inspection start button58is a button for instructing the data input device11to start the reinspection.

The inspection location input field70is a field for inputting the inspection location. In the example illustrated inFIG.7A, the inspection location input field70includes a facility input field71(first input field), an equipment input field72(second input field), an equipment detail input field73, a component input field74(third input field), and a component detail input field75.

The facility input field71(first input field) is a field for inputting a facility candidate.

The equipment input field72(second input field) is a field for inputting an equipment candidate provided in the facility candidate.

The equipment detail input field73is a field for inputting details of the equipment candidate.

The component input field74(third input field) is a field for inputting a component candidate provided in the equipment candidate.

The component detail input field75is a field for inputting details of the component candidate.

The image display field80is a field for displaying various images. In the example illustrated inFIG.7A, the image display field80includes an enlarged display field81and reduced display fields82a,82b, and82c.

The enlarged display field81is a field in which an enlarged image is displayed.

The reduced display fields82a,82b, and82care fields in which reduced images are displayed.

The display control unit21acan display the captured image91(seeFIG.7F) to be described later, the infrared image92(seeFIG.7F) to be described later, and the above-described analysis images in the reduced display fields82a,82b, and82c, respectively. Further, the display control unit21acan display an image freely selected from among the images displayed in the respective reduced display fields82a,82b, and82cin the enlarged display field81. In addition, the display control unit21acan exchange and display the image displayed in any of the reduced display fields82a,82b, and82cand the image displayed in the enlarged display field81.

Note that the example illustrated inFIG.7Ais merely an example, and the input screen50can be changed as needed according to the operation. For example, the input screen50can be changed to a configuration in which the number of enlarged display fields81or reduced display fields82a,82b, and82cis increased.

The operator who sees the input screen50illustrated inFIG.7Apresses the acquisition button51to perform a data acquisition operation. Returning toFIG.6A, after step S105, the operation detection unit21bof the data input device11detects the data acquisition operation (that is, a pressing operation on the acquisition button51) by the operator. Then, the inspection data creation unit21cstarts creation of the temporarily registered inspection data D15(seeFIG.5A) (step S110).

At this time, the inspection data creation unit21cautomatically inputs the date data displayed in the date display field54to the “date” field of the temporarily registered inspection data D15(seeFIG.5A). Further, the inspection data creation unit21cspecifies the operator name with the ID of the operator input on the login screen (not illustrated) at the time of activation of the data input device11using operator list data (not illustrated) prepared in advance, and automatically inputs the specified operator name as the inspector name in the “inspector name” field of the temporarily registered inspection data D15(seeFIG.5A).

Next, the GPS data acquisition unit21dand the captured image acquisition unit21eof the data input device11acquire the GPS data D14and captured image data from the camera12(step S115). At this time, the GPS data acquisition unit21dmay acquire the GPS data D14from the camera12, and the captured image acquisition unit21emay acquire the captured image data from the camera12. Alternatively, at this time, the captured image acquisition unit21emay acquire the captured image data in which the GPS data D14is embedded from the camera12, and the GPS data acquisition unit21dmay acquire the GPS data D14from the captured image data.

Next, the display control unit21aof the data input device11displays the captured image data on the input screen50(seeFIG.7B) (step S120). In the example illustrated inFIG.7B, the captured image91is displayed in the enlarged display field81.

Next, the inspection data creation unit21cof the data input device11specifies the position coordinates of the image capturing location of the camera12in the facility on the basis of the GPS data D14(step S125).

Next, the inspection data creation unit21cof the data input device11estimates, on the basis of the facility data D12, one or a plurality of facility candidates existing near the current position coordinates of the camera12, one or a plurality of equipment candidates provided in each facility candidate, and one or a plurality of component candidates to be inspected of each equipment candidate. At this time, the inspection data creation unit21ccan acquire the facility name of each facility candidate, the equipment name of the equipment candidate, and the component name of the component candidate from the facility data D12. Then, the inspection data creation unit21cdisplays facility candidates as options for selection in the facility input field71(seeFIG.7B) of the input screen50in a pull-down list in order of proximity to the position coordinates (step S130).

At this time, in the equipment input field72, the equipment detail input field73, the component input field74, and the component detail input field75(seeFIG.7B), equipment candidates and component candidates of the facility candidate closest from the position coordinates may be displayed as options for selection in a pull-down list. However, depending on the operation, it is possible to configure these fields to display other facility candidates, or to configure these fields to display nothing.

The operator who sees the input screen50illustrated inFIG.7Bperforms an operation of selecting the corresponding facility (facility to be inspected) from among the facility candidates displayed in a pull-down list in the facility input field71. Returning toFIG.6A, after step S130, the operation detection unit21bof the data input device11detects the operation of selecting the facility by the operator (step S135). Then, the inspection data creation unit21cdetermines whether or not there is registered image data D13(seeFIG.2) acquired in the past of the selected facility (whether it is stored in advance in the storage unit22) (step S140).

When it is determined in the determination of step S140that there is registered image data D13(in a case of “Yes”), the inspection data creation unit21ccompares the registered image data D13with the captured image data (step S145). The comparison method is not particularly limited, and various methods can be used. For example, the comparison method can be performed by causing the data input device11or the like to learn a suitable technique in artificial intelligence (AI) learning.

Note that, when capturing an image of a facility with the camera12, the operator mainly captures an image of a component to be inspected. Thus, the component to be inspected is almost at the center of the captured image data. Accordingly, when comparing the registered image data D13with the captured image data in step S145, the inspection data creation unit21ccompares a component appearing at substantially the center of the captured image data with a component appearing at a corresponding portion in the registered image data D13. Thus, the inspection data creation unit21cestimates an equipment candidate and a component candidate to be inspected, and, displays, as options for selections in a pull-down list, equipment data indicating the estimated equipment candidate and component data indicating the estimated component candidate in the equipment input field72, the equipment detail input field73, the component input field74, and the component detail input field75, on the basis of the facility data D12. Note that, in one or more embodiments, it is assumed that display contents of both the equipment input field72and the equipment detail input field73represent one equipment. Further, it is assumed that display contents of both the component input field74and the component detail input field75represent one component. Then, the inspection data creation unit21cautomatically inputs the facility candidate, the equipment candidate, and the component candidate displayed in the facility input field71, the equipment input field72, the equipment detail input field73, the component input field74, and the component detail input field75to the “facility name” field, the “equipment name” field, and the “component name” field of the temporarily registered inspection data D15(seeFIG.5A) (step S150). Thereafter, the process proceeds to step S160inFIG.6B.

When it is determined in the determination of step S140that there is no registered image data D13described above (in a case of “No”), as illustrated inFIGS.7C and7D, the operator manually performs an operation of selecting the equipment and the component, and thus the operation detection unit21bof the data input device11detects the operation of selecting the equipment and the component. Then, the inspection data creation unit21cinputs the automatically selected facility candidate in the facility input field71, the manually selected equipment, and the manually selected component to the “facility name” field, the “equipment name” field, and the “component name” field of the temporarily registered inspection data D15(seeFIG.5A) (step S155). Thereafter, the process proceeds to step S160inFIG.6B.

After step S150or step S155, the operator determines whether or not to change the image capturing distance of the camera12by viewing the captured image91(seeFIG.7E) appearing on the input screen50, and if necessary, operates the distance setting operation field55(seeFIG.7E) to perform a distance setting operation.

As illustrated inFIG.6B, when the operator has performed the distance setting operation, the operation detection unit21bof the data input device11detects the distance setting operation (step S160). However, there may be a case where the distance setting operation is not performed. In that case, the process of step S160is not performed, and a process of step S170is performed.

After step S160, the operator presses the first inspection start button57(seeFIG.7F) or the second inspection start button58(seeFIG.7F) to perform an inspection starting operation. The operator presses the first inspection start button57(seeFIG.7F) when performing the initial inspection, or presses the second inspection start button58(seeFIG.7F) when performing the reinspection.

Returning toFIG.6B, at this time, the operation detection unit21bof the data input device11detects the inspection starting operation (step S165). Then, the operation detection unit21bdetermines which operation has been performed (step S170).

When it is determined in the determination of step S170that it is a pressing operation on the first inspection start button57(in the example illustrated inFIG.7F, the button displayed as “Inspection Start”), the inspection data creation unit21cof the data input device11temporarily registers that it is the first inspection in the “initial inspection/reinspection” field of the temporarily registered inspection data D15(seeFIG.5A) (step S175).

On the other hand, when it is determined in the determination of step S170that it is a pressing operation on the second inspection start button58(in the example illustrated inFIG.7F, the button displayed as “Remonitoring Start”), the inspection data creation unit21cof the data input device11temporarily registers that it is the reinspection in the “initial inspection/reinspection” field of the temporarily registered inspection data D15(seeFIG.5A) (step S180).

After step S175or step S180, the infrared image acquisition unit21fof the data input device11acquires infrared image data from the camera12(step S185).

Next, the operator alternately displays the captured image91and the infrared image92in the enlarged display field81(seeFIG.7F), or displays the captured image91and the infrared image92by overlaying on the enlarged display field81(seeFIG.7F), so as to view the displayed image. Thus, the operator determines whether or not to adjust the position where the captured image91and the infrared image92are overlaid, and if necessary, operates the position adjustment operation field56(seeFIG.7F) to perform an adjustment operation of the position where the captured image91and the infrared image92are overlaid.

Returning toFIG.6B, the operation detection unit21bof the data input device11determines whether or not the adjustment operation of the position where the captured image91and the infrared image92are overlaid has been performed (step S190).

When it is determined, in the determination of step S190, that the position adjustment operation has been performed (in a case of “Yes”), the data input device11executes the position adjustment instructed by the operator (step S195). Thereafter, the process returns to step S185.

On the other hand, when it is determined, in the determination of step S190, that the position adjustment operation has not been performed (in a case of “No”), the image analysis unit21gof the data input device11creates the above-described analysis images obtained by analyzing the situation of the facility on the basis of the infrared image92. Then, the inspection data creation unit21c(or the image analysis unit21gor the display control unit21a) displays the analysis images on the input screen50(seeFIG.7G) (step S200).

Note that, when displaying the analysis images on the input screen50in step S200, the display control unit21achanges the input screen50from the configuration illustrated inFIG.7Fto the configuration illustrated inFIG.7G, for example. In the example illustrated inFIG.7G, the input screen50has a configuration in which a temperature distribution display field59is displayed instead of the distance setting operation field55and the position adjustment operation field56each illustrated inFIG.7F. Further, the input screen50has a configuration in which a normal button61, a leak button62, and a stop button63are displayed instead of the first inspection start button57and the second inspection start button58each illustrated inFIG.7F. The temperature distribution display field59indicates a color distribution of colors corresponding to the temperatures of the analysis images. The normal button61is a button pressed in a case of instructing the data input device11to end the inspection and when an abnormality (in one or more embodiment, gas leak) is not present in the facility. The leak button62is a button pressed in a case of instructing the data input device11to end the inspection and when an abnormality (in one or more embodiments, gas leak) is present in the facility. The stop button63is a button pressed in a case of instructing the data input device11to interrupt the inspection. Hereinafter, the normal button61, the leak button62, and the stop button63may be referred to as a “first end button”, a “second end button”, and an “interruption instruction button”, respectively.

Then, the analysis images are displayed on the input screen50. In the example illustrated inFIG.7G, as the analysis images, the intermediate image93, the temperature image94, and the infrared-gas cloud superimposed image95are displayed in the reduced display fields82a,82b, and82c, respectively, and the visible light-gas cloud superimposed image96is displayed in the enlarged display field81. As described above, in one or more embodiments, the analysis images (in the example illustrated inFIG.7G, the intermediate image93, the temperature image94, the infrared-gas cloud superimposed image95, and the visible light-gas cloud superimposed image96) are moving images. The data input device11generates various analysis images as moving images on the basis of the captured image (visible light moving image) and the infrared moving image of the facility captured by the camera12, and displays the analysis images on the input screen50of the display unit23.

The operator who sees the input screen50illustrated inFIG.7Gcan easily determine the presence or absence of gas leak by identifying the presence or absence of gas fluctuation by viewing the various analysis images generated as moving images. Then, the operator presses any one of the normal button61, the leak button62, and the stop button63depending on the situation. Thus, the operator performs an interruption operation or an end operation of the inspection.

Returning toFIG.6B, after step S200, the operation detection unit21bof the data input device11detects the interruption operation or the end operation by the operator (step S205). Then, the operation detection unit21bdetermines which operation has been performed (step S210).

When it is determined, in the determination of step S210, that it is a pressing operation on the stop button63(in the example illustrated inFIG.7G, the button displayed as “Stop”), the inspection data creation unit21cof the data input device11performs definitive registration with “interrupted” and “incomplete” (step S215). At this time, the inspection data creation unit21cregisters the inspection data of the facility registered in the temporarily registered inspection data D15(seeFIG.5A) in the definitively registered inspection data D16(seeFIG.5B). Then, the inspection data creation unit21cautomatically inputs data indicating “interrupted” and data indicating “incomplete” to the “presence or absence of leak” field and the “inspection completed/incomplete” field of the definitively registered inspection data D16(seeFIG.5B). Thus, the input of data to the definitively registered inspection data D16is completed. In this case, the worker continues the inspection later.

Further, when it is determined, in the determination of step S210, that it is a pressing operation on the leak button62(in the example illustrated inFIG.7G, the button displayed as “LEAK”), the inspection data creation unit21cof the data input device11performs the definitive registration with “leak present” and “incomplete” (step S220). At this time, the inspection data creation unit21cregisters the inspection data of the facility registered in the temporarily registered inspection data D15(seeFIG.5A) in the definitively registered inspection data D16(seeFIG.5B). Then, the inspection data creation unit21cautomatically inputs data indicating “leak present” and the data indicating “incomplete” to the “presence or absence of leak” field and the “inspection completed/incomplete” field of the definitively registered inspection data D16(seeFIG.5B). Thus, the input of data to the definitively registered inspection data D16is completed. In this case, the worker arranges another worker to repair the gas leak site. When another worker repairs the gas leak site, the worker reinspects the presence or absence of gas leak.

Further, when it is determined, in the determination of step S210, that it is a pressing operation on the normal button61(in the example illustrated inFIG.7G, the button displayed as “NORMAL”), the inspection data creation unit21cof the data input device11performs the definitive registration with “no leak” and “completed” (step S225). At this time, the inspection data creation unit21cregisters the inspection data of the facility registered in the temporarily registered inspection data D15(seeFIG.5A) in the definitively registered inspection data D16(seeFIG.5B). Then, the inspection data creation unit21cautomatically inputs data indicating “no leak” and data indicating “completed” to the “presence or absence of leak” field and the “inspection completed/incomplete” field of the definitively registered inspection data D16(seeFIG.5B). Thus, the input of data to the definitively registered inspection data D16is completed.

The data input device11ends the series of routine processes by performing the processes of step S215, step S220, or step S225. The inspection data of the facility input to the definitively registered inspection data D16is transmitted to and stored in the support terminal14and the data server15.

<Main Features of Data Input Device>

(1) As illustrated inFIG.2, a data input device11according to one or more embodiments includes a display control unit21athat creates various screens and displays the screens on a display unit23, an inspection data creation unit21cthat creates inspection data (temporarily registered inspection data D15and definitively registered inspection data D16) related to a gas inspection in a facility of either one or both of oil and gas, and a GPS data acquisition unit21d(position data acquisition unit) that acquires GPS data D14(position data) indicating position coordinates of the facility. The display control unit21acreates an input screen50for creating the inspection data. The inspection data creation unit21cestimates, on the basis of the GPS data D14, one or a plurality of facility candidates for which the inspection data is to be created, and displays the facility candidate or candidates as option(s) for selection on the input screen50.

The data input device11according to one or more embodiments as described above can automatically input facility candidates on the input screen50for creating the inspection record (inspection form). Thus, the data input device11can reduce the burden on the operator when inputting data.

(2) The inspection data creation unit21cof the data input device11according to one or more embodiments estimates one or a plurality of facility candidates existing near position coordinates indicated by the GPS data D14. Then, the inspection data creation unit21cmay display the facility candidates as options for selection on the input screen50in order of proximity to the position coordinates (see step S130andFIG.7BinFIG.6A).

The data input device11according to one or more embodiments as described above can narrow down the facility candidates having high applicability by estimating the facility candidates existing near the position coordinates indicated by the GPS data D14, and can display the facility candidates as options for selection on the input screen50in order of proximity to the position coordinates. Thus, the operator can select a facility having high applicability on the input screen50. Thus, the data input device11can further reduce the burden on the operator when inputting data.

(3) As illustrated inFIG.7A, the data input device11according to one or more embodiments further includes a captured image acquisition unit21ethat acquires a captured image in which the facility is captured. The display control unit21acreates, as the input screen50, a screen including a first input field (facility input field71) for inputting the facility candidate, a second input field (equipment input field72) for inputting an equipment candidate provided in the facility candidate, and a third input field (component input field74) for inputting a component candidate provided in the equipment candidate. The inspection data creation unit21cmay estimate, on the basis of facility data D12prepared in advance, one or a plurality of the equipment candidates provided in each facility candidate and one or a plurality of the component candidates provided in each equipment candidate, and display, as options for selection, each facility candidate, each equipment candidate, and each component candidate in the first input field (facility input field71), the second input field (equipment input field72), and the third input field (component input field74) corresponding thereto, respectively (seeFIGS.7B to7D).

The data input device11according to one or more embodiments as described above can estimate the equipment candidate and the component candidate having high applicability and display, as options for selection, the equipment candidate and the component candidate on the input screen50. Thus, the operator can select the equipment candidate and the component candidate having high applicability on the input screen50. Thus, the data input device11can further reduce the burden on the operator when inputting data.

(4) The inspection data creation unit21cof the data input device11according to one or more embodiments may estimate the component candidate by comparing a registered image (registered image data D13) acquired in the past with the captured image91(see steps S145and S150inFIG.6A).

The data input device11according to one or more embodiments as described above can narrow down the component candidates having high applicability by comparing the registered image (registered image data D13) acquired in the past with the captured image91. Thus, the data input device11can further reduce the burden on the operator when inputting data.

(5) As illustrated inFIG.2, the data input device11according to one or more embodiments further includes the infrared image acquisition unit21fthat acquires an infrared image92of the facility, and an image analysis unit21gthat creates an analysis image obtained by analyzing a situation of the facility on the basis of the infrared image92. As illustrated inFIG.7G, the inspection data creation unit21cmay display the captured image91, the infrared image92, and the analysis image (intermediate image93, temperature image94, infrared-gas cloud superimposed image95, visible light-gas cloud superimposed image96) on the input screen50.

The data input device11according to one or more embodiments as described above displays the captured image91, the infrared image92, and the analysis image on the input screen50, thereby allowing the operator to easily grasp the situation of the facility. Thus, the data input device11can further reduce the burden on the operator when inputting data.

(6) As illustrated inFIG.7A, the display control unit21aof the data input device11according to one or more embodiments creates, as the input screen50, a screen including a plurality of reduced display fields82a,82b, and82cin which reduced images are displayed and at least one enlarged display field81in which an enlarged image is displayed. Then, as illustrated inFIG.7G, the display control unit21amay display the captured image91, the infrared image92, and the analysis image in the reduced display fields82a,82b, and82c, respectively, and displays an image freely selected from among the images displayed in the respective reduced display fields82a,82b, and82cin the enlarged display field81.

The data input device11according to one or more embodiments as described above can improve the visibility of each image by displaying the image freely selected from among the images displayed in the respective reduced display fields82a,82b, and82cin the enlarged display field81. Thus, the operator can accurately grasp the situation of the facility. Therefore, the data input device11can improve accuracy of the inspection.

(7) As illustrated inFIG.7F, the display control unit21aof the data input device11according to one or more embodiments may create, as the input screen50, a screen including a first inspection start button57for an initial inspection and a second inspection start button58for a reinspection as inspection start buttons that instruct start of an inspection accompanied by creation of the analysis image.

The data input device11according to one or more embodiments as described above can receive two types of instructions, one is for a mode setting of the initial inspection or the reinspection and the other is for an inspection start, by one action by providing two types of inspection start buttons, the first inspection start button57and the second inspection start button58. Thus, the data input device11can improve operability and reduce the burden on the operator.

(8) As illustrated inFIG.7G, when either one of the first inspection start button57and the second inspection start button58is pressed, the display control unit21aof the data input device11according to one or more embodiments displays a first end button (normal button61) pressed when an abnormality is not present in the facility and a second end button (leak button62) pressed when an abnormality is present in the facility on the input screen50at any timing. When at least the second end button (leak button62) is pressed, the inspection data creation unit21cmay store any one or a plurality of images among the captured image91, the infrared image92, and the analysis image in a storage unit22in association with the inspection data.

The data input device11according to one or more embodiments as described above can reliably store an image serving as evidence only by pressing the second end button (leak button62) when an abnormality (for example, gas leak) is present in the facility. Thus, the data input device11can secure an evidence capability of the inspection.

(9) As illustrated inFIGS.7A and7E, the display control unit21aof the data input device11according to one or more embodiments may create, as the input screen50, a screen including a distance setting operation field55for performing an operation of setting an image capturing distance.

The data input device11according to one or more embodiments as described above can set the image capturing distance by operating the distance setting operation field55. Thus, the data input device11can easily capture images at various distances.

(10) As illustrated inFIGS.7A and7F, the display control unit21aof the data input device11according to one or more embodiments may create, as the input screen50, a screen including the position adjustment operation field56for performing an adjustment operation of a position where the captured image91and the infrared image92are overlaid.

The data input device11according to one or more embodiments as described above can adjust the position where the captured image91and the infrared image92are overlaid by operating the position adjustment operation field56. Thus, when an abnormality (for example, gas leak) is present, the data input device11can easily identify a site where the abnormality is present in the facility. Consequently, the data input device11can improve the accuracy of the inspection.

As described above, the data input device11according to one or more embodiments can reduce the burden on the operator when inputting data.

Note that the present invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the gist of the present invention.

For example, the above-described embodiments have been described in detail for easy understanding of the gist of the present invention. Thus, the present invention is not necessarily limited to one including all the components described. Further, in the present invention, another component can be added to a certain component, or a part of the components can be changed to other components. Further, in the present invention, a part of components can be eliminated.

Furthermore, for example, the procedure of the processing is not limited to those illustrated inFIGS.6A and6B. For example, depending on the operation, the data input device11can employ a procedure of simultaneously capturing and acquiring the visible light image and the infrared image.

Further, for example, the camera12and the data input device11can acquire position coordinate data from a satellite of a system other than the GPS. Examples of the system other than the GPS include “Michibiki” which is the Quasi-Zenith Satellite System of Japan, and the like.

Further, for example, the data input device11may allow the operator to directly input characters, numbers, and the like into the inspection location input field70(seeFIG.7A) of the input screen50. For example, it is assumed that the input screen50has a configuration in which blank data (not illustrated) can be selected when a facility candidate, an equipment candidate, a component candidate, or the like is selected in the inspection location input field70(seeFIG.7A). Then, when the operator selects blank data in the inspection location input field70, the data input device11displays a keyboard screen, a numeric keypad screen, or the like as an interrupt screen of the input screen50. The operator who sees this inputs characters, numbers, and the like by operating the keyboard screen or the numeric keypad screen. Then, the data input device11displays the input characters, numbers, and the like in the field where the blank data is input in the inspection location input field70. In this manner, the operator can directly input characters, numbers, and the like into the inspection location input field70of the input screen50.

Further, for example, the data input device11may allow the operator to change the contents of the temporarily registered inspection data D15and the definitively registered inspection data D16. For example, the data input device11prepares a read screen (not illustrated) for reading the temporarily registered inspection data D15and the definitively registered inspection data D16in advance. The operator operates the data input device11to display a read screen (not illustrated) on the display unit23. Then, the operator reads the temporarily registered inspection data D15and the definitively registered inspection data D16from the read screen (not illustrated), and changes contents of the temporarily registered inspection data D15and the definitively registered inspection data D16. Then, the data input device11stores the temporarily registered inspection data D15and the definitively registered inspection data D16in the storage unit22with the changed contents. In this manner, the operator can change the contents of the temporarily registered inspection data D15and the definitively registered inspection data D16.

Although the disclosure has been described with respect to only a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that various other embodiments may be devised without departing from the scope of the present invention. Accordingly, the scope of the invention should be limited only by the attached claims.

REFERENCE SIGNS LIST

10Data input system11Data input device (mobile terminal)12Camera13USB memory (storage medium)14Support terminal15Data server21Control unit21aDisplay control unit21bOperation detection unit21cInspection data creation unit21dGPS data acquisition unit (position data acquisition unit)21eCaptured image acquisition unit21fInfrared image acquisition unit21gImage analysis unit22Storage unit23Display unit (touch panel display)31Visible light camera32Infrared camera33GPS circuit50Input screen51Acquisition button52Image capturing mode button53Reproduction mode button54Date display field55Distance setting operation field56Position adjustment operation field57First inspection start button58Second inspection start button59Temperature distribution display field61Normal button (first end button)62Leak button (second end button)63Stop button “interruption instruction button”70Inspection location input field71Facility input field (first input field)72Equipment input field (second input field)73Equipment detail input field74Component input field (third input field)75Component detail input field80Image display field81Enlarged display field82aReduced display field82bReduced display field82cReduced display field91Captured image92Infrared image93Intermediate image (analysis image)94Temperature image (analysis image)95Infrared-gas cloud superimposed image (analysis image)96Visible light-gas cloud superimposed image (analysis image)D11Inspection item dataD12Facility dataD13Registered image dataD14GPS data (position data)D15Temporarily registered inspection dataD16definitively registered inspection dataPr Control instructions