Patent Description:
Technology for detecting whether or not an erroneous supply object has been supplied when a supply object is being supplied to a supply destination is disclosed in Patent Literature <NUM>. The technology of Patent Literature <NUM> is used to determine a type of oil when fuel oil such as gasoline as a supply object is supplied to a refueling tank and prevent erroneous refueling.

<CIT> relates to an apparatus for emptying a fluid container, wherein the apparatus comprises a pumping unit configured to pump fluids, and a display device.

In the above-described technology, a type of highly volatile fuel oil may not be correctly recognized when a type of oil is detected by a sensor. Thus, there is a need for a technology that more accurately reduces the number of operations in which an unintended supply object is supplied to a container of a supply destination due to not paying attention.

Therefore, an objective of the present invention is to provide a supply control apparatus, a supply device, a supply control method, and a program capable of solving the above-described problem.

In order to solve the above-described problem, the present invention provides a supply control apparatus according to independent claims <NUM> or <NUM>, a supply control method according to independent claims <NUM> or <NUM>, a computer program according to independent claims <NUM> or <NUM>.

According to the present invention, it is possible to reduce the number of operations in which an unintended supply object is supplied to a container of a supply destination due to the carelessness of a person.

<FIG> is a block diagram showing an example of a refueling device according to a first embodiment. A refueling device <NUM> shown in <FIG> is also referred to as a gasoline measurement device, a fixed refueling facility, or the like. The refueling device <NUM> is installed at a self-service type gas station or the like and used when a user <NUM> refuels an automobile <NUM> with fuel oil. The refueling device <NUM> includes an operation panel <NUM>, an image projection means <NUM>, an image-capturing means <NUM>, an image determination means <NUM>, a refueling nozzle <NUM>, and the like. The refueling device <NUM> supplies a plurality of types of fuel oil including gasoline and diesel. The refueling device <NUM> includes a refueling pump for sucking up fuel oil from an underground storage tank (not shown), a flowmeter, an indicator for indicating a measurement value of the flowmeter or the like, an electromagnetic valve inserted between the refueling pump and the flowmeter, and the like. The refueling device <NUM> locks (stops) refueling of fuel oil from the refueling nozzle <NUM> by stopping the refueling pump or closing the electromagnetic valve. The refueling device <NUM> unlocks refueling from the refueling nozzle <NUM> by activating the refueling pump or opening the electromagnetic valve.

The operation panel <NUM> is, for example, a liquid crystal touch panel. The operation panel <NUM> receives an operation <NUM> such as a fuel type selection operation of the user <NUM> and outputs operation information indicating details of the received operation <NUM> to the image projection means <NUM>, the image determination means <NUM>, and the refueling nozzle <NUM>. The operation panel <NUM> outputs, for example, information indicating the selected type of fuel to the image projection means <NUM>, the image determination means <NUM>, and the refueling nozzle <NUM>.

The image projection means <NUM> is a projector configured to include, for example, a video element such as a digital micro mirror device (DMD) and a light source such as a light-emitting diode (LED). The image projection means <NUM> generates and projects a fuel type confirmation image <NUM> on the basis of operation information according to the fuel type selection operation <NUM> input from the operation panel <NUM>.

<FIG> is a schematic diagram showing an example of the fuel type confirmation image <NUM> shown in <FIG>. The image projection means <NUM> is provided, for example, on the refueling nozzle <NUM>. For example, when the user <NUM> brings the refueling nozzle <NUM> close to a refueling port <NUM> of the automobile <NUM>, the image projection means <NUM> projects the fuel type confirmation image <NUM> on an automobile body in the vicinity of the refueling port <NUM>. The example shown in <FIG> shows an example of the fuel type confirmation image <NUM> when diesel has been selected by the fuel type selection operation <NUM> of the user <NUM>. In this case, the fuel type confirmation image <NUM> includes decision-prompting information <NUM> relative to the selected type of fuel "diesel" and decision indication information <NUM> and denial indication information <NUM> that are operation objects of an operation <NUM> according to the action (motion) of the user <NUM>. Here, the type of fuel represents a type of fuel oil and examples thereof include diesel, regular gasoline, high-octane gasoline, kerosene, and the like. In this case, the decision-prompting information <NUM> includes text information indicating "diesel" that is an identifier of the supply object. The decision indication information <NUM> is an object of an operation of deciding on the type of fuel. In this case, the decision indication information <NUM> is a button display including text "Yes". The denial indication information <NUM> is an object of an operation to deny the type of fuel. In this case, the denial indication information <NUM> is a button display including text "No".

The image-capturing means <NUM> shown in <FIG> is configured to include, for example, a camera. The image-capturing means <NUM> photographs the operation <NUM> according to the action of the user <NUM> on the fuel type confirmation image <NUM> and outputs the captured image information to the image determination means <NUM>.

For example, the image determination means <NUM> is configured using a computer (not shown) that controls the parts within the refueling device <NUM> and executes the following process by executing a prescribed program in the computer. That is, the image determination means <NUM> inputs information about an image captured by the image-capturing means <NUM> and performs a process such as a prescribed image recognition process on the input image information. The image determination means <NUM> determines that the operation <NUM> of the user <NUM> to decide on a type of fuel has been performed when the input image information includes the operation <NUM> of the user <NUM> such as pointing, touching with his/her finger or hand, or viewing to designate, for example, the decision indication information <NUM> within the fuel type confirmation image <NUM> shown in <FIG>, as an object. That is, the image determination means <NUM> detects an operation of the user <NUM> with respect to decision indication information (decision button display) <NUM> to prompt the user to decide on a type of fuel included in the fuel type confirmation image <NUM> projected in the vicinity of the refueling port <NUM> (a supply destination container) as a decision operation.

On the other hand, when the input image information includes the operation <NUM> of the user <NUM> such as pointing, touching with his/her finger or hand, or viewing to designate, for example, the denial indication information <NUM> within the fuel type confirmation image <NUM> shown in <FIG>, as an object, the image determination means <NUM> determines that the operation <NUM> of the user <NUM> to deny the type of fuel has been performed. For example, the image determination means <NUM> outputs, to the refueling nozzle <NUM>, a signal indicating the unlocking of the refueling nozzle <NUM> on the basis of a determination result.

As shown in <FIG>, the refueling nozzle <NUM> opens an internal main valve by gripping a lever <NUM> and performs refueling with fuel oil from the nozzle pipe <NUM>. For example, the user <NUM> inserts a nozzle pipe <NUM> into the refueling port <NUM> of the automobile <NUM> shown in <FIG> and grips the lever <NUM> after performing a confirmation operation on the fuel type confirmation image <NUM>. Thereby, the user <NUM> can perform refueling (fuel feeding) from the refueling nozzle <NUM> to a fuel tank <NUM>. In the present embodiment, the refueling nozzle <NUM> may include the following control unit. That is, a control unit provided in the refueling nozzle <NUM> is configured using a computer (not shown) that controls the parts within the refueling device <NUM> as in the image determination means <NUM> and executes the following process by executing a prescribed program in the computer. That is, the control unit provided in the refueling nozzle <NUM> performs control for locking (stopping) of the refueling with the fuel oil from the refueling nozzle <NUM> by stopping the refueling pump or closing the electromagnetic valve on the basis of an output signal of the image determination means <NUM>. The control unit provided in the refueling nozzle <NUM> performs control for unlocking the refueling from the refueling nozzle <NUM> by activating the refueling pump or opening the electromagnetic valve.

Next, an example of an operation of the refueling device <NUM> shown in <FIG> will be described with reference to <FIG>. The flowchart shown in <FIG> shows a flow of a process executed by the refueling device <NUM> until the refueling nozzle <NUM> is unlocked after the user <NUM> selects the type of fuel by operating the operation panel <NUM>. The process shown in <FIG> is started in a state in which the refueling nozzle <NUM> is locked. In the process shown in <FIG>, the operation panel <NUM> first waits until the user <NUM> performs the operation <NUM> of selecting the type of fuel (the iteration of "NO" in step S11). When the operation panel <NUM> selects the type of fuel in accordance with the operation <NUM> of the user <NUM> ("YES" in step S11), the image projection means <NUM> projects a fuel type confirmation image <NUM> indicating the selected type of fuel (step S12).

Next, the image determination means <NUM> waits until the prescribed operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is recognized on the basis of information about an image captured by the image-capturing means <NUM> (the iteration of "NO" in step S13). When the prescribed operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is recognized ("YES" in step S13), the image determination means <NUM> determines whether or not the prescribed operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is a decision operation (step S14). When the operation <NUM> according to the action of the user <NUM> on the fuel type confirmation image <NUM> is the decision operation (the case of "YES" in step S14), the image determination means <NUM> unlocks the refueling nozzle <NUM> (step S15). On the other hand, when the image determination means <NUM> determines that the operation <NUM> according to the action of the user <NUM> on the fuel type confirmation image <NUM> is not the decision operation (the case of "NO" in step S14), the operation panel <NUM> waits for the fuel type selection operation to be input again (step S11).

Next, an example of use of the refueling device <NUM> will be described with reference to <FIG> is a flowchart showing an example of use of the refueling device <NUM> by the user <NUM>. First, the user <NUM> operates the operation panel <NUM> to select the type of fuel for refueling (step S1). Next, the user <NUM> grips the refueling nozzle <NUM> and brings the tip of the nozzle pipe <NUM> close to the refueling port <NUM> of the automobile <NUM> (step S2). Next, the image projection means <NUM> displays a fuel type confirmation image <NUM> to confirm whether or not the type of fuel selected in step S1 is correct as the fuel oil for refueling in front of the refueling nozzle <NUM> (step S3). Next, the user <NUM> determines whether or not the type of fuel is correct on the basis of the fuel type confirmation image <NUM> (step S4). Next, the image determination means <NUM> recognizes a situation (an operation situation) from a determination action (hand or finger motion) of the user <NUM> on the basis of a camera image around the refueling nozzle <NUM> (step S5).

Next, when the image determination means <NUM> determines that the recognition result is the decision operation (the case of "YES" in step S6), the automobile <NUM> is refueled with the fuel oil selected in step S1 from the tip of the refueling nozzle <NUM> (step S7). That is, when the user <NUM> determines that the type of fuel is correct, refueling is performed. On the other hand, when the image determination means <NUM> determines that the recognition result is not the decision operation (the case of "NO" in step S6), the process is performed from step S1. That is, when the user <NUM> determines that the type of fuel is incorrect, the process returns to step S1.

As described above, according to the present embodiment, when fuel oil is supplied to the fuel tank <NUM>, the image projection means <NUM> outputs the fuel type confirmation image <NUM> to allow the user <NUM> (the user) to recognize the selected type of fuel and decision-prompting information <NUM> with respect to the type of fuel. That is, the image projection means <NUM> outputs the fuel type confirmation image <NUM> including an identifier of the fuel oil of the type of fuel selected from a plurality of types of fuel and decision button display to prompt the user to decide on the fuel oil. When an operation (a decision operation) in which the user <NUM> confirming the fuel type confirmation image <NUM> decides on the type of fuel has been detected, the image determination means <NUM> removes a supply limit for the fuel tank <NUM> of fuel oil of the type of fuel.

As described above, in the present embodiment, the decision operation on the fuel type confirmation image <NUM> is set as a requirement for unlocking. Thus, it is possible to reduce the number of erroneous operations in which unintended fuel oil is supplied to the fuel tank <NUM> due to the carelessness of a person.

In the present embodiment, the refueling device <NUM> is an example of a supply device and is also an example of a supply control apparatus. The image projection means <NUM> is an example of a display information output unit. The image determination means <NUM> is an example of a supply control unit and a user operation detection unit. The fuel type confirmation image <NUM> is an example of display information. The fuel tank <NUM> is an example of a supply destination container and is an example of a tank mounted in a vehicle. The fuel oil is an example of a supply object. The decision indication information <NUM> is an example of decision button display.

It is noted that the embodiment in the underlying paragraph and <FIG> do not form part of the invention, but represents the background art. The image projection means <NUM> is not limited to a projector and may be, for example, a display/input apparatus <NUM> with a touch panel installed near the refueling nozzle <NUM> (see <FIG>). In this case, the refueling device <NUM> can display the fuel type confirmation image <NUM> on the touch panel and unlock the refueling nozzle <NUM> when a touch operation on the decision indication information <NUM> that is the decision button display has been detected. The decision operation on the fuel type confirmation image <NUM> may be an operation of pushing a dedicated button for decision. In this case, for example, the dedicated button can be installed near the refueling nozzle <NUM>. That is, the refueling device <NUM> detects an operation of the user <NUM> on the decision indication information (decision button display) <NUM> to prompt the user <NUM> to decide on the type of fuel included in the fuel type confirmation image <NUM> displayed on the touch panel as a decision operation.

The refueling device <NUM> may include a decision information recording unit configured to record decision information (decision operation information) indicating that the user <NUM> has performed an operation of deciding on the type of fuel (a supply object) using the fuel type confirmation image <NUM> (display information). The decision information may be, for example, text information indicating the presence or absence of the decision operation or information about an image captured at the time of the decision operation. For example, the decision information recording unit records decision information when the user <NUM> has performed the decision operation on the decision indication information <NUM> in the fuel type confirmation image <NUM> in association with a date or identification information such as a series number printed on a receipt issued at the time of refueling. It is possible to confirm details of a previous decision operation by recording the decision information on the decision information recording unit.

Although the first embodiment is configured as the refueling device <NUM>, the present invention is not limited thereto. For example, the fuel tank <NUM> may be a mixing container of chemical substances and the like. In this case, the refueling device <NUM> can be used as a supply control apparatus of chemical substances used when a plurality of types of chemical substances other than fuel oil are mixed.

The image projection means <NUM> outputs a substance type confirmation image including an identifier of a chemical substance selected from a plurality of types of chemical substances and decision button display to prompt the user to decide on the chemical substance. The image determination means <NUM> removes a supply limit for a mixing container of a corresponding type of chemical substance when an operation in which the user <NUM> confirming the substance type confirmation image decides on the type has been detected. At this time, for example, the image determination means <NUM> detects an operation of the user <NUM> on the decision button display to prompt the user to decide on the type included in the substance type confirmation image projected near the mixing container as a decision operation.

<FIG> is a block diagram showing an example of a refueling device according to a second embodiment. The same components as those shown in <FIG> are denoted by the same reference signs in <FIG> and description thereof will be appropriately omitted. A refueling device 1a shown in <FIG> has the following differences from the refueling device <NUM> according to the first embodiment shown in <FIG>. That is, the refueling device 1a according to the second embodiment is different from the refueling device shown in <FIG> in that a motion analysis means <NUM> is provided instead of the image-capturing means <NUM> shown in <FIG> and a motion determination means <NUM> is provided instead of the image determination means <NUM> shown in <FIG>.

The motion analysis means <NUM> is configured to include, for example, an ultrasonic sensor. The motion analysis means <NUM> measures distances between the user <NUM> and a plurality of points around the user <NUM> and outputs detected distance information to the motion determination means <NUM>. Alternatively, the motion analysis means <NUM> includes, for example, an infrared light radiation unit that randomly radiates a plurality of dots and an infrared light-imaging unit that photographs reflected light of the radiated infrared light. In this case, the motion analysis means <NUM> generates distance image information in which distance information is added for each pixel on the basis of a deviation of a position according to the distance of each dot projected to the user <NUM> and outputs the distance image information to the motion determination means <NUM>.

The motion determination means <NUM> is configured using a computer (not shown) that controls the parts within the refueling device <NUM> and executes a prescribed program in the computer. Accordingly, the motion determination means <NUM> inputs the distance information generated by the motion analysis means <NUM> and performs a prescribed motion recognition process on the basis of the input distance information. For example, the motion determination means <NUM> extracts an outline of the user <NUM>, for example, on the basis of the input distance information, and recognizes a motion of the user <NUM>, for example, on the basis of a motion of an outline and a prescribed pattern change prepared in advance. The motion determination means <NUM> determines that the operation <NUM> of the user <NUM> to decide on a type of fuel has been performed when the recognized action of the user <NUM> corresponds to the operation <NUM> of the user <NUM> such as pointing or touching with his/her finger or hand to designate, for example, the decision indication information <NUM> within the fuel type confirmation image <NUM> shown in <FIG>, as an object. On the other hand, the motion determination means <NUM> determines that the operation <NUM> of the user <NUM> to deny a type of fuel has been performed when the recognized action of the user <NUM> corresponds to the operation <NUM> of the user <NUM> such as pointing or touching with his/her finger or hand to designate, for example, the denial indication information <NUM> within the fuel type confirmation image <NUM> shown in <FIG>, as an object. For example, the motion determination means <NUM> outputs a signal indicating unlocking of the refueling nozzle <NUM> to the refueling nozzle <NUM> on the basis of a determination result.

Next, as in the first embodiment, an example of an operation of the refueling device 1a shown in <FIG> will be described with reference to <FIG>. As described above, a flowchart shown in <FIG> shows a flow of a process executed by the refueling device until the refueling nozzle <NUM> is unlocked after the user <NUM> operates the operation panel <NUM> and selects a type of fuel. The process shown in <FIG> is started in a state in which the refueling nozzle <NUM> has been locked. In the process shown in <FIG> in the second embodiment, the operation panel <NUM> first waits until the user <NUM> performs the operation <NUM> to select the type of fuel (the iteration of "NO" in step S11). When the operation panel <NUM> selects a type of fuel in accordance with the operation <NUM> of the user <NUM> ("YES" in step S11), the image projection means <NUM> projects the fuel type confirmation image <NUM> indicating the selected type of fuel (step S12).

Next, the motion determination means <NUM> waits until a prescribed operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is recognized on the basis of distance information detected by the motion analysis means <NUM> (the iteration of "NO" in step S13). When the prescribed operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is recognized ("YES" in step S13), the motion determination means <NUM> determines whether or not the prescribed operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is a decision operation (step S14). When the operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is a decision operation (the case of "YES" in step S14), the motion determination means <NUM> unlocks the refueling nozzle <NUM> (step S15). On the other hand, when the motion determination means <NUM> determines that the operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is not the decision operation (the case of "NO" in step S14), the operation panel <NUM> waits for the fuel type selection operation to be input again (step S11).

As described above, according to the present embodiment, when fuel oil is supplied to the fuel tank <NUM>, the image projection means <NUM> outputs a fuel type confirmation image <NUM> to allow the user <NUM> (the user) to recognize a selected type of fuel and decision-prompting information <NUM> with respect to the type of fuel. When an operation in which the user <NUM> confirming the fuel type confirmation image <NUM> decides on the type of fuel has been detected, the motion determination means <NUM> removes a supply limit of the fuel oil of the type of fuel for the fuel tank <NUM>. As described above, in the present embodiment, the decision operation on the fuel type confirmation image <NUM> is set as a requirement for unlocking. Thus, it is possible to reduce the number of erroneous operations in which unintended fuel oil is supplied to the fuel tank <NUM> due to the carelessness of a person.

In the present embodiment, the refueling device 1a is an example of a supply device and is also an example of a supply control apparatus. The image projection means <NUM> is an example of a display information output unit. In the present embodiment, the motion determination means <NUM> is an example of a supply control unit and a user operation detection unit. The fuel type confirmation image <NUM> is an example of display information. The fuel tank <NUM> is an example of a supply destination container and is an example of a tank mounted in a vehicle. The fuel oil is an example of a supply object. The decision indication information <NUM> is an example of decision button display.

<FIG> is a block diagram showing an example of a refueling device according to a third embodiment. The same components as those shown in <FIG> are denoted by the same reference signs in <FIG> and description thereof will be appropriately omitted. A refueling device 1b shown in <FIG> has the following differences from the refueling device <NUM> according to the first embodiment shown in <FIG>. That is, the refueling device 1b according to the third embodiment is different from the refueling device shown in <FIG> in that a refueling nozzle 15b is provided instead of the refueling nozzle <NUM> shown in <FIG> and a gas detection means <NUM> and a gas sensor <NUM> are newly provided.

The gas sensor <NUM> is attached to, for example, the tip of the refueling nozzle 15b (the tip of a nozzle pipe <NUM>), and outputs a detection signal according to the type of fuel oil. The gas sensor <NUM> can output a detection signal even while the supply is being limited (locked state). The gas detection means <NUM> is configured using a computer (not shown) that controls the parts in the refueling device <NUM> and executes the following process by executing a prescribed program in the computer. That is, the gas detection means <NUM> inputs the detection signal output by the gas sensor <NUM>, generates a signal indicating the type of fuel oil detected on the basis of the input detection signal, and outputs the signal to the refueling nozzle 15b.

The refueling nozzle 15b is different from the refueling nozzle <NUM> in the first embodiment in terms of the following points. That is, in the present embodiment, the refueling nozzle 15b includes the following control unit. That is, the control unit provided in the refueling nozzle 15b is configured using a computer (not shown) that controls the parts in the refueling device <NUM> and executes the following process by executing a prescribed program in the computer. That is, the control unit provided in the refueling nozzle 15b inputs an output signal of the image determination means <NUM>. The control unit provided in the refueling nozzle 15b inputs a signal indicating the type of fuel oil output from the gas detection means <NUM> and also inputs a signal indicating a type of fuel oil output by the operation panel <NUM>. The control unit provided in the refueling nozzle 15b unlocks the refueling nozzle 15b as follows when the output signal of the image determination means <NUM> is a signal indicating unlocking of the refueling nozzle and a signal indicating the type of fuel oil input from the gas detection means <NUM> is the same a signal indicating the type of fuel oil input from the operation panel <NUM>. That is, the control unit provided in the refueling nozzle 15b performs control for unlocking refueling from the refueling nozzle <NUM> by activating the refueling pump and opening the electromagnetic valve.

That is, when the image determination means <NUM> detects the decision operation and the gas sensor <NUM> detects fuel oil of the type of fuel input from the operation panel <NUM>, the control unit unlocks the refueling nozzle 15b of the fuel oil.

Next, an example of an operation of the refueling device 1b shown in <FIG> will be described with reference to <FIG>. The flowchart shown in <FIG> shows a flow of a process executed by the refueling device 1b until the refueling nozzle 15b is unlocked after the user <NUM> operates the operation panel <NUM> to select the type of fuel. The process shown in <FIG> is started in a state in which the refueling nozzle 15b is locked. In the process shown in <FIG>, the operation panel <NUM> first waits until the user <NUM> performs the operation <NUM> of selecting the type of fuel (the iteration of "NO" in step S11). When the operation panel <NUM> selects a type of fuel in accordance with an operation <NUM> of the user <NUM> ("YES" in step S11), the image projection means <NUM> projects a fuel type confirmation image <NUM> indicating the selected type of fuel (step S12).

Next, the image determination means <NUM> waits, on the basis of information about an image captured by the image-capturing means <NUM>, until the prescribed operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is recognized (the iteration of "NO" in step S13). The prescribed operation <NUM> is, for example, an action (motion) of the user <NUM>. When the prescribed operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is recognized ("YES" in step S13), the image determination means <NUM> determines whether or not the prescribed operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is a decision operation (step S14). When the operation <NUM> according to the action of the user <NUM> on the fuel type confirmation image <NUM> is a decision operation (the case of "YES" in step S14), the gas detection means <NUM> waits until a gas (a type of fuel oil) is detected by the gas sensor <NUM> (the iteration of "NO" in step S14-<NUM>). Next, the refueling nozzle 15b determines whether or not the type of fuel oil indicated by the signal output by the gas detection means <NUM> is correct on the basis of a signal indicating the type of fuel oil output from the operation panel <NUM> (step S14-<NUM>). That is, the refueling nozzle 15b determines whether or not the signal indicating the type of fuel oil output from the gas detection means <NUM> is the same as the signal indicating the type of fuel oil output from the operation panel <NUM>.

When the type of fuel oil indicated by the signal output by the gas detection means <NUM> is correct (the case of "YES" in step S14-<NUM>), the refueling nozzle 15b unlocks the refueling nozzle 15b (step S15). That is, when the signal indicating the type of fuel oil output from the gas detection means <NUM> is the same as the signal indicating the type of fuel oil output from the operation panel <NUM>, the refueling nozzle 15b is unlocked. On the other hand, when the image determination means <NUM> determines that the operation <NUM> on the fuel type confirmation image <NUM> according to the action of the user <NUM> is not a decision operation (the case of "NO" in step S14), the operation panel <NUM> waits for the fuel type selection operation to be input again (step S11). When the refueling nozzle 15b determines that the type of fuel oil is not correct (the case of "NO" in step S14-<NUM>), the operation panel <NUM> waits for the fuel type selection operation to be input again (step S11).

As described above, according to the present embodiment, when fuel oil is supplied to the fuel tank <NUM>, the image projection means <NUM> outputs the fuel type confirmation image <NUM> to allow the user <NUM> (the user) to recognize the selected type of fuel and decision-prompting information <NUM> with respect to the selected type of fuel. When an operation in which the user <NUM> confirming the fuel type confirmation image <NUM> decides on the type of fuel has been detected, the image determination means <NUM> outputs, to the refueling nozzle 15b, a signal indicating the removal of the supply limit for the fuel tank <NUM> of the fuel oil of the type of fuel. The refueling nozzle 15b is unlocked when a signal indicating the removal of the supply limit is output from the image determination means <NUM> and a signal indicating a type of fuel oil input from the gas detection means <NUM> is the same as a signal indicating a type of fuel oil input from the operation panel <NUM>. That is, the refueling nozzle 15b detects the decision operation of the user <NUM> and removes the supply limit when a detection signal indicating that the gas sensor <NUM> detects the selected type of fuel oil is further input.

As described above, in the present embodiment, the condition that the decision operation on the fuel type confirmation image <NUM> matches the selected type of fuel with the detection signal of the gas sensor <NUM> is set as a requirement for unlocking. Thus, it is possible to prevent an erroneous operation in which unintended fuel oil is supplied to the fuel tank <NUM> due to the carelessness of a person.

<FIG> is a configuration diagram showing an example of a stirring device according to a fourth embodiment. A stirring device <NUM> shown in <FIG> is used when a worker <NUM> mixes and stirs a plurality of types of objects such as prescribed chemical substances. The stirring device <NUM> includes an image projection means <NUM>, an image-capturing means <NUM>, an object recognition means <NUM>, an image determination means <NUM>, a supply port <NUM>, a stirring container <NUM>, and the like.

Here, an example of the stirring container <NUM> shown in <FIG> will be described with reference to <FIG> is a perspective view schematically showing an example of the stirring container <NUM>. In the example of the configuration shown in <FIG>, the stirring container <NUM> includes a stirring unit <NUM> that stirs a plurality of objects supplied within the container by rotating a stirring blade (not shown). A supply port <NUM> (<FIG>) having an opening is provided at the upper part of the stirring container <NUM>. The supply port <NUM> includes a lid <NUM> that can open and close the opening by performing rotation in a direction of an arrow A1 about a rotation shaft <NUM>. The supply port <NUM> includes a sensor <NUM> configured to detect the closed state of the lid <NUM>, and an actuator <NUM> configured to limit the rotation of the lid <NUM> in an opening direction. That is, the actuator <NUM> limits the rotation of the lid <NUM> in the opening direction or removes the limited rotation. In the supply port <NUM>, the image projection means <NUM> (<FIG>) is attached at a position where an object confirmation image <NUM> (<FIG>) can be projected in the vicinity of the supply port <NUM>. At the supply port <NUM>, the image-capturing means <NUM> (<FIG>) is attached at a position where the operation of the worker <NUM> on the object confirmation image <NUM> can be photographed.

The image projection means <NUM> is a projector configured to include, for example, a video element such as a DMD and a light source such as an LED. The image projection means <NUM> generates and projects the object confirmation image <NUM> on the basis of information about the object recognized by the object recognition means <NUM> (<FIG>).

<FIG> is a schematic diagram showing an example of the object confirmation image <NUM> shown in <FIG> and <FIG>. The example shown in <FIG> shows an example of the object confirmation image <NUM> when the object recognition means <NUM> outputs an identifier of "chemical substance A". In this case, the object confirmation image <NUM> includes decision-prompting information <NUM> with respect to the object recognized by the object recognition means <NUM> and decision indication information <NUM> and denial indication information <NUM> that are operation objects of an operation <NUM> according to the action (motion) of the worker <NUM>. In this case, the decision-prompting information <NUM> includes text information indicating "chemical substance A" which is an identifier of a supply object. The decision indication information <NUM> is an object of the operation of deciding on the object. In this case, the decision indication information <NUM> is a button display including text "Yes". The denial indication information <NUM> is an object of an operation of denying the object. In this case, the denial indication information <NUM> is a button display including text "No".

The image-capturing means <NUM> shown in <FIG> is configured to include, for example, a camera. The image-capturing means <NUM> photographs the operation <NUM> according to the action of the worker <NUM> on the object confirmation image <NUM> or photographs an exterior <NUM> of an object <NUM>. The image-capturing means <NUM> outputs captured image information to the object recognition means <NUM> and the image determination means <NUM>.

The object recognition means <NUM> is configured using, for example, a computer (not shown) that controls the parts within the stirring device <NUM> and executes the following process by executing a prescribed program in the computer. That is, the object recognition means <NUM> identifies the object <NUM> on the basis of image information obtained by the image-capturing means <NUM> photographing the object <NUM> and outputs an identifier which is identification information about the object <NUM>. For example, the object recognition means <NUM> identifies the object <NUM> on the basis of an exterior image of a container of the object <NUM> or identifies the object <NUM> by reading a barcode printed on the container of the object <NUM>. The object recognition means <NUM> generates information indicating the identifier of the object <NUM> and outputs the information to the image projection means <NUM> and the image determination means <NUM>. However, the object recognition means <NUM> is not limited to a process of identifying the object <NUM> on the basis of an image recognition result. The object recognition means <NUM> may determine the identifier of the object <NUM> on the basis of, for example, an input operation of the worker <NUM> on the operation panel or the like.

The image determination means <NUM> is configured using, for example, a computer (not shown) that controls the parts in the stirring device <NUM> and executes the following process by executing a prescribed program in the computer. That is, the image determination means <NUM> inputs information about an image captured by the image-capturing means <NUM> and performs a process such as a prescribed image recognition process on the input image information. The image determination means <NUM> determines that the operation <NUM> of the worker <NUM> to decide on an object has been performed when the input image information includes the operation <NUM> of the worker <NUM> such as pointing, touching with his/her finger or hand, or viewing to designate, for example, the decision indication information <NUM> within the object confirmation image <NUM> shown in <FIG>, as an object. On the other hand, the image determination means <NUM> determines that the operation <NUM> of the worker <NUM> to deny the object has been performed when the input image information includes the operation <NUM> of the worker <NUM> such as pointing, touching with a finger or hand, or viewing to designate, for example, denial indication information <NUM> within the object confirmation image <NUM> shown in <FIG>, as an object. For example, the image determination means <NUM> outputs, to the supply port <NUM>, a signal indicating unlocking of the supply port <NUM> on the basis of a determination result.

The supply port <NUM> forms an opening for supplying an object to the stirring container <NUM> in a state in which the lid <NUM> is open. The supply port <NUM> may include the following control unit. That is, the control unit provided in the supply port <NUM> is configured using, for example, a computer (not shown) that controls the parts in the stirring device <NUM> and executes the following process by executing a prescribed program in the computer. That is, the control unit provided in the supply port <NUM> performs control for locking (limiting) or unlocking a rotation operation of the lid <NUM> by controlling the actuator <NUM> on the basis of an output signal of the image determination means <NUM>.

The stirring container <NUM> stirs a plurality of types of objects supplied from the supply port <NUM> by the stirring unit <NUM> shown in <FIG> and discharges the stirred object from a discharge port provided at the lower part of the stirring container <NUM> (not shown).

Next, an example of an operation of the stirring device <NUM> shown in <FIG> will be described with reference to <FIG>. For example, the flowchart shown in <FIG> shows a flow of a process executed by the stirring device <NUM> until the supply port <NUM> is unlocked after the worker <NUM> causes the image-capturing means <NUM> to capture the object <NUM> and the object recognition means <NUM> recognizes the object <NUM>. The process shown in <FIG> is started in a state in which the lid <NUM> of the supply port <NUM> is locked in the closed state. In the process shown in <FIG>, the object recognition means <NUM> first waits until the object <NUM> is recognized and an identifier is generated ("NO" in step S21). When the object recognition means <NUM> recognizes the object <NUM> ("YES" in step S21), the image projection means <NUM> projects an object confirmation image <NUM> showing the recognized object (step S22).

Next, the image determination means <NUM> waits until a prescribed operation <NUM> on the object confirmation image <NUM> according to the action of the worker <NUM> is recognized on the basis of information about an image captured by the image-capturing means <NUM> (the iteration of "NO" in step S23). When the prescribed operation <NUM> on the object confirmation image <NUM> according to the action (motion) of the worker <NUM> is recognized ("YES" in step S23), the image determination means <NUM> determines whether or not a prescribed operation <NUM> on the object confirmation image <NUM> according to the action of the worker <NUM> is a decision operation (step S24). When the operation <NUM> on the object confirmation image <NUM> according to the action of the worker <NUM> is the decision operation (the case of "YES" in step S24), the image determination means <NUM> unlocks the supply port <NUM> (step S25). On the other hand, when the image determination means <NUM> determines that the operation <NUM> on the object confirmation image <NUM> according to the action of the worker <NUM> is not the decision operation (the case of "NO" in step S24), the object recognition means <NUM> waits for a new object to be recognized again (step S21).

As described above, according to the present embodiment, when an object such as a chemical substance is supplied to the stirring container <NUM>, the image projection means <NUM> outputs the object confirmation image <NUM> to allow the worker <NUM> (the user) to recognize an identifier of the object and the decision-prompting information <NUM> with respect to the object. The image determination means <NUM> removes the supply limit for the stirring container <NUM> of the object when the operation of deciding on the object according to the worker <NUM> confirming the object confirmation image <NUM> has been detected. Thus, in the present embodiment, the decision operation on the object confirmation image <NUM> is set as a requirement for unlocking. Thus, it is possible to reduce the number of erroneous operations in which an unintended object is supplied to the stirring container <NUM> due to the carelessness of a person.

In the present embodiment, the stirring device <NUM> is an example of a supply device and is an example of a supply control apparatus. The image projection means <NUM> is an example of a display information output unit. In the present embodiment, the image determination means <NUM> is an example of a supply control unit and a user operation detection unit. The object confirmation image <NUM> is an example of display information. The stirring container <NUM> is an example of a supply destination container. An object is an example of a supply object. The decision indication information <NUM> is an example of decision button display.

Not according to the invention the image projection means <NUM> is not limited to a projector and may be, for example, a display and input device such as a touch panel installed near the supply port <NUM>. In this case, the stirring device <NUM> can display the object confirmation image <NUM> on the touch panel and unlock the supply port <NUM> when a touch operation on the decision indication information <NUM> which is decision button display has been detected. The decision operation on the object confirmation image <NUM> may be an operation of pushing a dedicated button for decision. In this case, the dedicated button can be installed, for example, in the vicinity of the supply port <NUM>.

<FIG> is a diagram showing a minimum configuration of the supply control apparatus. As shown in <FIG>, a supply control apparatus <NUM> may include at least functional units of a display information output unit <NUM> and a supply control unit <NUM>. Here, the supply control apparatus <NUM> corresponds to the above-described refueling devices <NUM>, 1a, and 1b and the stirring device <NUM>. The display information output unit <NUM> corresponds to the image projection means <NUM> and the image projection means <NUM>. The supply control unit <NUM> corresponds to the image determination means <NUM>, the motion determination means <NUM>, and the image determination means <NUM>.

As described above, according to each embodiment and the minimum configuration example, it is possible to reduce the number of unintended erroneous operations due to the carelessness of a person. According to the present invention, the following effects can be obtained. That is, according to each embodiment, by installing a projector (an image projection device), it is possible to construct an inexpensive and highly reliable erroneous refueling prevention system based on human awareness. If the user's determination action is recorded, the recorded action can be used as the proof of a determination error at the time of erroneous refueling. It is possible to use a conventional method (a gas sensor) or the like and it is possible to construct an erroneous refueling prevention system with higher accuracy in the future. Each embodiment can be applied to various fields because the each embodiment is based on human awareness and is a system to confirm a determination of the user under an environment where installation of a screen for displaying an image is conventionally difficult. For example, an application range is wide from a use scene of a general consumer to a business scene of a factory or an office including a system for preventing mixing of chlorine bleach and oxygen bleach, a system to confirm a type of gas of a gas range or a water heater (town gas and propane gas), and the like.

The embodiment is not limited to the above. For example, the display of a confirmation image (display information) may use a technique such as a stereo hologram. The number of image projection means and an attachment position thereof are not limited, and the number of image projection means may be two or more. For example, the image projection means may be attached to the tip of the refueling nozzle <NUM>. Some or all of the programs executed by one or more computers provided in the above embodiment can be distributed via a communication line or a computer-readable recording medium.

Claim 1:
A supply control apparatus (<NUM>, 1b), comprising:
an operation panel (<NUM>) configured to receive a selection, by a user, of a supply object to be supplied to a supply destination container;
an image projection means (<NUM>) configured to project, in a vicinity of the supply destination container, display information to allow the user to recognize an identifier of the selected supply object and information to prompt the user to decide on the selected supply object in a state in which a supply of the selected supply object to the supply destination container is locked;
an image determination means (<NUM>) configured to recognize a motion of the user, based on an image in which an action by the user on the display information is captured, and to detect a decision operation for confirming the selected supply object on the display information when the recognized motion corresponds to the decision operation; and
a supply control unit (<NUM>, 15b) configured to unlock a supply for the supply destination container of the selected supply object when the decision operation is detected.