Patent Description:
Conventionally, there has been used proposed a technique for detecting a child or a pet that cannot get out of a vehicle by himself or herself when he or she is left alone in a vehicle's interior, and informing a person outside the vehicle of presence. For example, Patent Literature <NUM> discloses a device that detects a child left alone in a vehicle's interior by using an infrared sensor, a pressure-sensitive sensor, a weight sensor, and an in-vehicle camera installed in the vehicle's interior. Patent literature <NUM> and <NUM> address the problem of detecting occupants in the parked vehicle by utilizing cameras, microphones and infrared sensors.

The device described in Patent Literature <NUM> has a problem that when a child is hidden at a location outside detection areas of the sensors or an image-capturing area of the in-vehicle camera in the vehicle's interior, the child cannot be detected even if he or she is left alone in the vehicle's interior.

The present invention is to solve the above-described problem, and an object of the present invention is to obtain a notification target detection device that can reduce failure to detect a notification target which is a child or a pet that cannot get out of a vehicle by himself or herself when he or she is left alone in a vehicle's interior.

The invention provides notification target detection devices according to claims <NUM>, <NUM> and a notification target detection method according to claim <NUM>. Preferable aspects are set forth in the dependent claims.

According to the present invention, the notification target detection device determines whether a source of generation of a voice in the vehicle's interior is a target of which a person outside the vehicle is to be informed, when vehicle speed is less than or equal to the threshold value or a shifter position is the park position and a passenger is not present in the vehicle's interior. As a result, even when it is determined that a passenger is not present in the vehicle's interior because a notification target is present at a location outside an image-capturing area of an in-vehicle camera, the notification target can be detected from the voice in the vehicle's interior. Thus, failure to detect the notification target which is a child or a pet left alone in the vehicle's interior can be reduced.

To describe the present invention in more detail, embodiments for carrying out the present invention will be described below by referring to the accompanying drawings.

<FIG> is a block diagram showing a functional configuration of an alarm system <NUM> according to a first embodiment of the invention. The alarm system <NUM> is a system that performs an alarm process for detecting a notification target left alone in a vehicle's interior and informing a person outside a vehicle of the detection of the notification target, and includes a notification target detection device <NUM>, an alarming unit <NUM>, and a communication unit <NUM>. Here, the notification target is a passenger who cannot get out of the vehicle by himself or herself when he or she is left alone in the vehicle's interior and includes, for example, a child (baby) or a pet.

A child or a pet that is still present in the vehicle's interior when the vehicle is parked is highly likely to be left alone in the vehicle's interior. Hence, the notification target detection device <NUM> detects, as a notification target, a child or a pet present in the vehicle's interior when the vehicle is parked. The notification target detection device <NUM> notifies the alarming unit <NUM> of the detection of the notification target present in the vehicle's interior.

When the alarming unit <NUM> receives the notification indicating the detection of the notification target from the notification target detection device <NUM>, the alarming unit <NUM> outputs an alarm to an area around the vehicle. For example, the alarming unit <NUM> outputs an alarm sound or a voice message from a speaker installed in the vehicle. In addition, the alarming unit <NUM> may flash headlights and taillights of the vehicle.

The communication unit <NUM> communicates with an external device. For example, the communication unit <NUM> transmits alarm information indicating that the notification target has been left alone in the vehicle's interior to the external device. The external device is, for example, a portable terminal carried by a passenger who has got out of the vehicle.

The notification target detection device <NUM> includes a vehicle information obtaining unit <NUM>, a video obtaining unit <NUM>, a passenger presence-or-absence determining unit <NUM>, a voice obtaining unit <NUM>, and a voice source determining unit <NUM>. The vehicle information obtaining unit <NUM> obtains vehicle information indicating vehicle speed or a shifter position. For example, the vehicle information obtaining unit <NUM> obtains vehicle information about vehicle speed from a vehicle speed sensor installed in the vehicle, and obtains vehicle information about a shifter position from an electronic control unit for in-vehicle use (hereinafter, referred to as ECU for in-vehicle use).

In addition, the vehicle information obtaining unit <NUM> determines whether the vehicle speed is less than or equal to a threshold value or whether the shifter position is a park position, on the basis of the vehicle information. The above-described threshold value is vehicle speed indicating that the vehicle is parked, and for example, <NUM> (km/h) is set. Note, however, that taking into account a case of moving the vehicle to a parking location by self-driving after a passenger gets out of the vehicle, a vehicle speed of, for example, about <NUM> (km/h) may be set as the threshold value.

The video obtaining unit <NUM> obtains video in which the vehicle's interior is shot. For example, the video obtaining unit <NUM> obtains video from an in-vehicle camera installed in the vehicle. Note that the video obtained by the video obtaining unit <NUM> is video shot by the in-vehicle camera from an angle that shows all seats in the vehicle's interior. As the in-vehicle camera, a camera included in a driver monitoring system (hereinafter, referred to as DMS) may be used.

The passenger presence-or-absence determining unit <NUM> determines whether a passenger is shown in the video of the vehicle's interior obtained by the video obtaining unit <NUM>. For example, since the video obtained by the video obtaining unit <NUM> shows all seats in the vehicle's interior, if the video shows even a single seat in which a passenger sits among the seats in the video, then the passenger presence-or-absence determining unit <NUM> determines that a passenger is present. In addition, if a seat in which a passenger sits is not shown in the video, then the passenger presence-or-absence determining unit <NUM> determines that there is no passenger in the vehicle's interior.

The voice obtaining unit <NUM> obtains a voice in the vehicle's interior. For example, the voice obtaining unit <NUM> obtains a voice picked up by a microphone provided in the vehicle's interior. Note that to obtain all voices generated in the vehicle's interior, a microphone may be disposed in each seat in the vehicle's interior, and a plurality of microphones may be arranged in rear seats. Voice information obtained by the voice obtaining unit <NUM> is outputted to the voice source determining unit <NUM>.

The voice source determining unit <NUM> determines whether a source of generation of the voice in the vehicle's interior obtained by the voice obtaining unit <NUM> is a notification target. For example, voice characteristics data representing the characteristics of a voice of the notification target is set in the voice source determining unit <NUM>. The voice source determining unit <NUM> analyzes characteristics of the voice obtained by the voice obtaining unit <NUM>, and refers to the above-described voice characteristics data on the basis of the characteristics of the voice, and thereby determines a source of generation of the voice.

In addition, the voice source determining unit <NUM> determines whether the source of generation of the voice in the vehicle's interior is the notification target, when it has been determined, on the basis of the vehicle information obtained by the vehicle information obtaining unit <NUM>, that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position and the passenger presence-or-absence determining unit <NUM> has determined that a passenger is not shown in the video of the vehicle's interior.

As such, when the passenger presence-or-absence determining unit <NUM> determines that a passenger is not shown in the video, i.e., there is no passenger in the vehicle's interior, the voice source determining unit <NUM> determines whether the source of generation of the voice in the vehicle's interior is the notification target to confirm a result of the determination. As a result, for example, even when the passenger presence-or-absence determining unit <NUM> makes an erroneous determination because the notification target is present at a location outside a shooting area of the in-vehicle camera, the notification target detection device <NUM> can detect the notification target from the voice in the vehicle's interior.

Next, a hardware configuration that implements functions of the notification target detection device <NUM> will be described.

Functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, and the voice source determining unit <NUM> in the notification target detection device <NUM> are implemented by a processing circuit.

Namely, the notification target detection device <NUM> includes a processing circuit for performing processes at step ST1 to ST5 which will be described later using <FIG>. The processing circuit may be dedicated hardware or may be a central processing unit (CPU) that executes programs stored in a memory.

<FIG> is a block diagram showing a hardware configuration that implements the functions of the notification target detection device <NUM>. <FIG> is a block diagram showing a hardware configuration that executes software that implements the functions of the notification target detection device <NUM>. In <FIG>, a camera <NUM> is an in-vehicle camera installed in the vehicle, and the video obtaining unit <NUM> shown in <FIG> obtains video of the vehicle's interior shot by the camera <NUM>.

A control interface <NUM> is an interface that relays vehicle information outputted from an ECU for in-vehicle use <NUM>. The vehicle information obtaining unit <NUM> shown in <FIG> obtains vehicle information from the ECU for in-vehicle use <NUM> through the control interface <NUM>. A microphone <NUM> is a microphone provided in the vehicle's interior. The voice obtaining unit <NUM> shown in <FIG> obtains a voice picked up by the microphone <NUM>. An alarming device <NUM> is the alarming unit <NUM> shown in <FIG>, and a communication device <NUM> is the communication unit <NUM> shown in <FIG>.

When the processing circuit is a processing circuit <NUM> which is dedicated hardware shown in <FIG>, the processing circuit <NUM> corresponds, for example, to a single circuit, a combined circuit, a programmed processor, a parallel programmed processor, an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a combination thereof. The functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, and the voice source determining unit <NUM> in the notification target detection device <NUM> may be implemented by different processing circuits, or the functions may be collectively implemented by a single processing circuit.

When the processing circuit is a processor <NUM> shown in <FIG>, the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, and the voice source determining unit <NUM> in the notification target detection device <NUM> are implemented by software, firmware, or a combination of software and firmware. Note that the software or firmware is described as programs and stored in a memory <NUM>.

The processor <NUM> implements the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, and the voice source determining unit <NUM> in the notification target detection device <NUM> by reading and executing the programs stored in the memory <NUM>. Namely, the notification target detection device <NUM> includes the memory <NUM> for storing programs, the execution of which by the processor <NUM> results in performing processes at step ST1 to ST5 shown in <FIG>.

The programs cause a computer to perform a procedure or a method for the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, and the voice source determining unit <NUM>. The memory <NUM> may be a computer readable storage medium having stored therein programs for causing the computer to function as the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, and the voice source determining unit <NUM>.

The memory <NUM> corresponds, for example, to a nonvolatile or volatile semiconductor memory such as a random access memory (RAM), a read only memory (ROM), a flash memory, an erasable programmable read only memory (EPROM), or an electrically-EPROM (EEPROM), a magnetic disk, a flexible disk, an optical disc, a compact disc, a MiniDisc, or a DVD.

Some of the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, and the voice source determining unit <NUM> may be implemented by dedicated hardware and some of the functions may be implemented by software or firmware. For example, the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, and the voice obtaining unit <NUM> are implemented by the processing circuit <NUM> which is dedicated hardware, and the functions of the passenger presence-or-absence determining unit <NUM> and the voice source determining unit <NUM> are implemented by the processor <NUM> reading and executing programs stored in the memory <NUM>. As such, the processing circuit can implement the above-described functions by hardware, software, firmware, or a combination thereof.

<FIG> is a flowchart showing a notification target detection method according to the first embodiment.

First, the vehicle information obtaining unit <NUM> obtains vehicle information indicating the vehicle speed or shifter position of the vehicle (step ST1). The vehicle information obtaining unit <NUM> determines whether the vehicle speed is less than or equal to the threshold value or whether the shifter position is the park position, on the basis of the obtained vehicle information (step ST2). In the determination, if the vehicle speed exceeds the threshold value or the shifter position is other than the park position (step ST2; NO), then the process of <FIG> ends.

If the vehicle speed is less than or equal to the threshold value or the shifter position is the park position (step ST2; YES), the vehicle information obtaining unit <NUM> notifies the video obtaining unit <NUM> of this fact.

When the video obtaining unit <NUM> receives the above-described notification from the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM> obtains video in which the vehicle's interior is shot (step ST3). For example, the video obtaining unit <NUM> obtains video of the vehicle's interior from the camera <NUM> shown in <FIG>. The video obtained by the video obtaining unit <NUM> is outputted to the passenger presence-or-absence determining unit <NUM>.

The passenger presence-or-absence determining unit <NUM> determines whether a passenger is shown in the video of the vehicle's interior inputted from the video obtaining unit <NUM> (step ST4). For example, the passenger presence-or-absence determining unit <NUM> determines whether a passenger is shown by performing image recognition on the video of the vehicle's interior. Determination-target passengers do not include a notification target. If a passenger is shown in the video of the vehicle's interior (step ST4; YES), it is determined that an adult stays in the vehicle's interior and thus the process of <FIG> ends.

If a passenger is not shown in the video of the vehicle's interior (step ST4; NO), the passenger presence-or-absence determining unit <NUM> notifies the voice source determining unit <NUM> of this fact. When the voice source determining unit <NUM> receives the above-described notification from the passenger presence-or-absence determining unit <NUM>, the voice source determining unit <NUM> determines whether a source of generation of a voice in the vehicle's interior obtained by the voice obtaining unit <NUM> is a notification target (step ST5). In this manner, the voice source determining unit <NUM> determines whether the source of generation of the voice in the vehicle's interior is the notification target, when it has been determined, on the basis of the vehicle information obtained by the vehicle information obtaining unit <NUM>, that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position and the passenger presence-or-absence determining unit <NUM> has determined that a passenger is not shown in the video of the vehicle's interior.

Note that when the following conditions hold true, the operation of the voice source determining unit <NUM> may be temporarily stopped. For example, a first condition includes a case in which a vehicle door is opened and closed in a state in which the passenger presence-or-absence determining unit <NUM> has determined, when the vehicle is parked, that there is no passenger in the vehicle's interior. In this case, it is conceivable that a person who has already got out of the vehicle has got the notification target out of the vehicle, and thus, the operation of the voice source determining unit <NUM> is stopped. A second condition includes, for example, a case in which an operation that cannot be obviously performed by the notification target has been performed on an in-vehicle device. Operations that cannot be performed by the notification target include, for example, text input and an operation of accurately selecting a branch function. In this case, it is conceivable that a person who stays in the vehicle's interior is not the notification target but is an adult who can get out of the vehicle anytime, and thus, the operation of the voice source determining unit <NUM> is stopped.

A third condition includes, for example, a case in which a passenger (adult) other than the notification target is determined to be a source of generation of a voice by the voice source determining unit <NUM>. In this case, it is determined that an adult stays in the vehicle's interior, and thus, the operation of the voice source determining unit <NUM> is stopped. A fourth condition includes, for example, a case in which a voice has not been obtained by the voice obtaining unit <NUM> within a certain period from when the vehicle is parked to when the voice source determining unit <NUM> operates. In this case, it is determined that a notification target that can be detected by voice is not present in the vehicle's interior, and thus, the operation of the voice source determining unit <NUM> is stopped. A fifth condition includes, for example, a case in which a factor that the notification target is not left alone in the vehicle's interior is set in the notification target detection device <NUM>. For example, a passenger sets the fact that the notification target is not in the vehicle in the voice source determining unit <NUM>. By this setting, the operation of the voice source determining unit <NUM> is stopped.

<FIG> is a flowchart showing an example of an alarm process of the first embodiment. A process at step ST1a shown in <FIG> is the same as the process at step ST5 shown in <FIG>.

The voice source determining unit <NUM> determines whether the source of generation of the voice in the vehicle's interior obtained by the voice obtaining unit <NUM> is the notification target (step ST1a). In the determination, if the source of generation of the voice is only the notification target (a child, a pet, etc.), then the voice source determining unit <NUM> determines that the source of generation of the voice is the notification target. Namely, when a plurality of sources of generation of voices include a voice other than the notification target, e.g., an adult's voice, it is not determined that the sources of generation of voices are the notification target.

If the source of generation of the voice in the vehicle's interior is not the notification target (step ST1a; NO), then the notification target is not left alone in the vehicle's interior, and thus, the process of <FIG> ends.

If the source of generation of the voice in the vehicle's interior is the notification target (step ST1a; YES), then the voice source determining unit <NUM> notifies the alarming unit <NUM> of the fact that the notification target has been left alone in the vehicle's interior. When the alarming unit <NUM> receives the above-described notification from the voice source determining unit <NUM>, the alarming unit <NUM> starts an alarm indicating that the notification target has been left alone (step ST2a). When the alarm starts, the communication unit <NUM> notifies an external device of the fact that the notification target has been left alone in the vehicle's interior (step ST3a). The external device is, for example, a portable terminal carried by a passenger who has got out of the vehicle.

As described above, the notification target detection device <NUM> according to the first embodiment determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the vehicle speed is less than or equal to the threshold value or the shifter position is the park position and a passenger is not shown in video of the vehicle's interior. As a result, even when it is determined that a passenger is not shown in the video of the vehicle's interior because the notification target is present at a location outside the image-capturing area of the in-vehicle camera, the notification target can be detected from the voice in the vehicle's interior. Thus, failure to detect the notification target left alone in the vehicle's interior can be reduced.

The alarm system <NUM> according to the first embodiment includes the notification target detection device <NUM>, the alarming unit <NUM>, and the communication unit <NUM>. Since failure to detect a notification target by the notification target detection device <NUM> is reduced, an alarm and notification to the external device about the fact that the notification target has been left alone can be accurately provided.

In the notification target detection method according to the first embodiment, a series of processes shown in <FIG> are performed, and thus, failure to detect a notification target left alone in the vehicle's interior can be reduced.

Although a case is shown in which the vehicle information obtaining unit <NUM> determines whether the vehicle speed is less than or equal to the threshold value or whether the shifter position is the park position, on the basis of vehicle information, the configuration is not limited thereto. For example, the voice source determining unit <NUM> may determine whether the vehicle speed is less than or equal to the threshold value or whether the shifter position is the park position, on the basis of vehicle information inputted from the vehicle information obtaining unit <NUM>.

Although the passenger presence-or-absence determining unit <NUM> determines whether a passenger is shown in video of the vehicle's interior obtained by the video obtaining unit <NUM>, the configuration is not limited thereto.

For example, the passenger presence-or-absence determining unit <NUM> may determine whether a passenger is present in the vehicle's interior, on the basis of detection information outputted from any of an infrared sensor, a pressure-sensitive sensor, and a weight sensor provided in the vehicle's interior. In this case, the video obtaining unit <NUM> may be omitted from the notification target detection device <NUM>, and the voice source determining unit <NUM> determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the vehicle speed is less than or equal to the threshold value or the shifter position is the park position and the passenger presence-or-absence determining unit <NUM> has determined that there is no passenger in the vehicle's interior. As a result, even when the notification target is present at a location outside a detection area of a sensor that detects the notification target in the vehicle's interior, the notification target can be determined from the voice in the vehicle's interior. Thus, failure to detect the notification target left alone in the vehicle's interior can be reduced.

In addition, the passenger presence-or-absence determining unit <NUM> may determine whether a passenger is shown in video of the vehicle's interior obtained by the video obtaining unit <NUM>, and further determine whether a passenger is present in the vehicle's interior, on the basis of detection information outputted from any of an infrared sensor, a pressure-sensitive sensor, and a weight sensor provided in the vehicle's interior. In this case, too, the voice source determining unit <NUM> determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the vehicle speed is less than or equal to the threshold value or the shifter position is the park position and the passenger presence-or-absence determining unit <NUM> has determined that there is no passenger in the vehicle's interior. As a result, even when the notification target is present at a location outside a detection area of a sensor that detects the notification target in the vehicle's interior, or the notification target is present at a location outside the image-capturing area of the in-vehicle camera, the notification target can be determined from the voice in the vehicle's interior. Thus, failure to detect the notification target left alone in the vehicle's interior can be reduced.

<FIG> is a block diagram showing a functional configuration of an alarm system 1A according to a second embodiment of the invention. In <FIG>, the same components as those of <FIG> are given the same reference signs and description thereof is omitted. The alarm system 1A is a system that detects a notification target left alone in the vehicle's interior and performs an alarm process when the notification target has been detected, and includes a notification target detection device 2A, the alarming unit <NUM>, and the communication unit <NUM>. In addition, the notification target detection device 2A is configured to include the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, a voice source determining unit 24A, and an object detecting unit <NUM>.

The voice source determining unit 24A determines whether a source of generation of a voice in the vehicle's interior is a notification target, when it has been determined that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that a passenger is not shown in video of the vehicle's interior, and the object detecting unit <NUM> has detected an object concerning the notification target in the vehicle's interior. The object detecting unit <NUM> detects an object concerning the notification target present in the vehicle's interior on the basis of video obtained by the video obtaining unit <NUM>.

The object concerning the notification target is an object related to the notification target in the vehicle's interior. For example, when the notification target is a child, an object concerning the child is a child seat installed in a vehicle's seat. In addition, when the notification target is a pet, an object concerning the pet is a pet carrier for keeping the pet. Note that an object concerning a notification target is used as a requirement indicating that the notification target is in the vehicle and thus does not include an object whose relationship with the notification target is unknown because the object is installed in advance in the vehicle's interior when the vehicle is shipped.

Functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24A, and the object detecting unit <NUM> in the notification target detection device 2A are implemented by a processing circuit. When the processing circuit is the processing circuit <NUM> which is dedicated hardware shown in <FIG>, the processing circuit <NUM> corresponds, for example, to a single circuit, a combined circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof. The functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24A, and the object detecting unit <NUM> in the notification target detection device 2A may be implemented by different processing circuits, or the functions may be collectively implemented by a single processing circuit.

When the processing circuit is the processor <NUM> shown in <FIG>, the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24A, and the object detecting unit <NUM> in the notification target detection device 2A are implemented by software, firmware, or a combination of software and firmware. Note that the software or firmware is described as programs and stored in the memory <NUM>.

The processor <NUM> implements the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24A, and the object detecting unit <NUM> in the notification target detection device 2A by reading and executing the programs stored in the memory <NUM>. Namely, the notification target detection device 2A includes the memory <NUM> for storing programs, the execution of which by the processor <NUM> results in performing processes at step ST1b to ST6b shown in <FIG> which will be described later.

The programs cause a computer to perform a procedure or a method for the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24A, and the object detecting unit <NUM>. The memory <NUM> may be a computer readable storage medium having stored therein programs for causing the computer to function as the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24A, and the object detecting unit <NUM>.

<FIG> is a flowchart showing a notification target detection method according to the second embodiment.

Note that processes at step ST1b to ST4b shown in <FIG> are the same as the processes at step ST1 to ST4 shown in <FIG> and thus description thereof is omitted.

The object detecting unit <NUM> detects an object concerning a notification target on the basis of video obtained by the video obtaining unit <NUM> at step ST3b (step ST5b). For example, the object detecting unit <NUM> detects an object concerning a notification target by performing image recognition on video of the vehicle's interior.

The following description is made assuming that the notification target is a child or a pet and the object concerning the notification target is a child seat or a pet carrier.

If a child seat or a pet carrier has not been detected (step ST5b; NO), there is no child or pet which is the notification target and thus the process of <FIG> ends.

On the other hand, if a child seat or a pet carrier has been detected (step ST5b; YES), the object detecting unit <NUM> notifies the voice source determining unit 24A of this fact.

When the voice source determining unit 24A receives the above-described notification from the object detecting unit <NUM>, the voice source determining unit 24A determines whether a source of generation of a voice in the vehicle's interior obtained by the voice obtaining unit <NUM> is the notification target (step ST6b). As such, the voice source determining unit 24A determines whether the source of generation of the voice in the vehicle's interior is the notification target, when it has been determined, on the basis of vehicle information obtained by the vehicle information obtaining unit <NUM>, that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that a passenger is not shown in the video of the vehicle's interior, and the object detecting unit <NUM> has detected an object concerning the notification target.

At step ST6b, the process at step ST1a shown in <FIG> is performed, and the processes after step ST1a are performed depending on a result of the determination. Namely, if the source of generation of the voice in the vehicle's interior is only the notification target, then the alarming unit <NUM> starts an alarm indicating that the notification target has been left alone. When the alarm starts, the communication unit <NUM> notifies the external device of the fact that the notification target has been left alone in the vehicle's interior.

As described above, the notification target detection device 2A according to the second embodiment includes the object detecting unit <NUM> that detects an object concerning a notification target. The voice source determining unit 24A determines whether a source of generation of a voice in the vehicle's interior is the notification target, when it has been determined, on the basis of vehicle information obtained by the vehicle information obtaining unit <NUM>, that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that a passenger is not shown in video of the vehicle's interior, and the object detecting unit <NUM> has detected an object concerning the notification target. As a result, even when it is determined that a passenger is not shown in the video of the vehicle's interior because the notification target is present at a location outside the image-capturing area of the in-vehicle camera, the notification target can be detected from the voice in the vehicle's interior. Particularly, in the second embodiment, since a determination as to whether the source of generation of the voice is the notification target is made when an object concerning the notification target has been detected, the accuracy of detection of the notification target improves and failure to detect the notification target can be further reduced over the configuration of the first embodiment.

The alarm system 1A according to the second embodiment includes the notification target detection device 2A, the alarming unit <NUM>, and the communication unit <NUM>. Since failure to detect a notification target by the notification target detection device 2A is reduced, an alarm and notification to the external device about the fact that the notification target has been left alone can be accurately provided.

In the notification target detection method according to the second embodiment, a series of processes shown in <FIG> are performed, and thus, failure to detect a notification target left alone in the vehicle's interior can be reduced.

Although a case is shown in which the vehicle information obtaining unit <NUM> determines whether the vehicle speed is less than or equal to the threshold value or whether the shifter position is the park position, on the basis of vehicle information, the configuration is not limited thereto. For example, the voice source determining unit 24A may determine whether the vehicle speed is less than or equal to the threshold value or whether the shifter position is the park position, on the basis of vehicle information inputted from the vehicle information obtaining unit <NUM>.

For example, the passenger presence-or-absence determining unit <NUM> may determine whether a passenger is present in the vehicle's interior, on the basis of detection information outputted from any of an infrared sensor, a pressure-sensitive sensor, and a weight sensor provided in the vehicle's interior. In this case, the video obtaining unit <NUM> may be omitted from the notification target detection device 2A, and the voice source determining unit 24A determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that there is no passenger in the vehicle's interior, and an object concerning the notification target has been detected in the vehicle's interior. As a result, even when the notification target is present at a location outside a detection area of a sensor that detects the notification target in the vehicle's interior, the notification target can be determined from the voice in the vehicle's interior. Thus, failure to detect the notification target left alone in the vehicle's interior can be reduced.

In addition, the passenger presence-or-absence determining unit <NUM> may determine whether a passenger is shown in video of the vehicle's interior obtained by the video obtaining unit <NUM>, and further determine whether a passenger is present in the vehicle's interior, on the basis of detection information outputted from any of an infrared sensor, a pressure-sensitive sensor, and a weight sensor provided in the vehicle's interior. In this case, too, the voice source determining unit 24A determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that there is no passenger in the vehicle's interior, and an object concerning the notification target has been detected in the vehicle's interior. As a result, even when the notification target is present at a location outside a detection area of a sensor that detects the notification target in the vehicle's interior, or the notification target is present at a location outside the image-capturing area of the in-vehicle camera, the notification target can be determined from the voice in the vehicle's interior. Thus, failure to detect the notification target left alone in the vehicle's interior can be reduced.

<FIG> is a block diagram showing a functional configuration of an alarm system 1B according to a third embodiment of the invention. In <FIG>, the same components as those of <FIG> are given the same reference signs and description thereof is omitted. The alarm system 1B is a system that detects a notification target left alone in the vehicle's interior and performs an alarm process when the notification target has been detected, and includes a notification target detection device 2B, the alarming unit <NUM>, and the communication unit <NUM>. In addition, the notification target detection device 2B is configured to include the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, a voice source determining unit 24B, and a temperature obtaining unit <NUM>.

The voice source determining unit 24B determines whether a source of generation of a voice in the vehicle's interior is a notification target, when it has been determined that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that a passenger is not shown in video of the vehicle's interior, and a temperature obtained by the temperature obtaining unit <NUM> is out of an allowable temperature range. In addition, the temperature obtaining unit <NUM> obtains temperature information of the vehicle's interior from a temperature sensor installed in the vehicle. Though depiction of the temperature sensor is omitted in <FIG>, any sensor may be used as long as the sensor is installed at a location where the temperature of the vehicle's interior can be detected and has the ability to detect the temperature of the vehicle's interior.

The allowable temperature range is a temperature range in which the health of a notification target left alone in the vehicle's interior is maintained, and is defined by an allowable temperature on a low-temperature side and an allowable temperature on a high-temperature side. For example, when the lower allowable temperature limit is <NUM> and the upper allowable temperature limit is <NUM>, the allowable temperature range is a range between <NUM> and <NUM> inclusive. When the temperature of the vehicle's interior is out of the allowable temperature range, there is a possibility of harming the health of a notification target left alone in the vehicle's interior for a long period of time. Hence, there is a need to promptly output an alarm to an area around the vehicle and provide notification to the external device.

On the other hand, when the temperature of the vehicle's interior is within the allowable temperature range, the voice source determining unit 24B does not determine a source of generation of a voice, the alarming unit <NUM> does not give an alarm, and the communication unit <NUM> does not provide notification. This indicates that if the temperature of the vehicle's interior is within the allowable temperature range when an adult has left a notification target in the vehicle's interior on purpose, then an alarm and notification are not provided. This configuration enables the alarm system 1B according to the third embodiment to provide an alarm and notification about the fact that the notification target has been left alone in the vehicle's interior, at appropriate timing at which the temperature of the vehicle's interior goes out of the allowable temperature range.

Functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24B, and the temperature obtaining unit <NUM> in the notification target detection device 2B are implemented by a processing circuit. When the processing circuit is the processing circuit <NUM> which is dedicated hardware shown in <FIG>, the processing circuit <NUM> corresponds, for example, to a single circuit, a combined circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof. The functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24B, and the temperature obtaining unit <NUM> in the notification target detection device 2B may be implemented by different processing circuits, or the functions may be collectively implemented by a single processing circuit.

When the processing circuit is the processor <NUM> shown in <FIG>, the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24B, and the temperature obtaining unit <NUM> in the notification target detection device 2B are implemented by software, firmware, or a combination of software and firmware. Note that the software or firmware is described as programs and stored in the memory <NUM>.

The processor <NUM> implements the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24B, and the temperature obtaining unit <NUM> in the notification target detection device 2B by reading and executing the programs stored in the memory <NUM>. Namely, the notification target detection device 2B includes the memory <NUM> for storing programs, the execution of which by the processor <NUM> results in performing processes at step ST1c to ST7c shown in <FIG> which will be described later.

The programs cause a computer to perform a procedure or a method for the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24B, and the temperature obtaining unit <NUM>. The memory <NUM> may be a computer readable storage medium having stored therein programs for causing the computer to function as the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the passenger presence-or-absence determining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24B, and the temperature obtaining unit <NUM>.

<FIG> is a flowchart showing a notification target detection method according to the third embodiment.

Note that processes at step ST1c to ST4c shown in <FIG> are the same as the processes at step ST1 to ST4 shown in <FIG> and thus description thereof is omitted.

The temperature obtaining unit <NUM> obtains a temperature of the vehicle's interior from the temperature sensor installed in the vehicle (step ST5c). Temperature information obtained by the temperature obtaining unit <NUM> is outputted to the voice source determining unit 24B.

The voice source determining unit 24B determines whether the temperature of the vehicle's interior obtained by the temperature obtaining unit <NUM> is out of the allowable temperature range (step ST6c). In the determination, if the temperature of the vehicle's interior is not out of the allowable temperature range (step ST6c; NO), then processing returns to the process at step ST5c. By doing so, a future change in the temperature of the vehicle's interior is monitored.

On the other hand, if the temperature of the vehicle's interior is out of the allowable temperature range (step ST6c; YES), then the voice source determining unit 24B determines whether a source of generation of a voice in the vehicle's interior obtained by the voice obtaining unit <NUM> is a notification target (step ST7c).

In this manner, the voice source determining unit 24B determines whether the source of generation of the voice in the vehicle's interior is the notification target, when it has been determined, on the basis of vehicle information obtained by the vehicle information obtaining unit <NUM>, that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that a passenger is not shown in video of the vehicle's interior, and the temperature obtained by the temperature obtaining unit <NUM> is out of the allowable temperature range.

At step ST7c, the process at step ST1a shown in <FIG> is performed, and the processes after step ST1a are performed depending on a result of the determination. Namely, if the source of generation of the voice in the vehicle's interior is only the notification target, then the alarming unit <NUM> starts an alarm indicating that the notification target has been left alone. When the alarm starts, the communication unit <NUM> notifies the external device of the fact that the notification target has been left alone in the vehicle's interior.

As described above, the notification target detection device 2B according to the third embodiment includes the temperature obtaining unit <NUM> that obtains a temperature of the vehicle's interior. The voice source determining unit 24B determines whether a source of generation of a voice in the vehicle's interior is a notification target, when it has been determined that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that a passenger is not shown in video of the vehicle's interior, and the temperature of the vehicle's interior is out of the allowable temperature range. As a result, even when it is determined that a passenger is not shown in the video of the vehicle's interior because the notification target is present at a location outside the image-capturing area of the in-vehicle camera, the notification target can be detected from the source of generation of the voice in the vehicle's interior.

Particularly, in the third embodiment, since a determination as to whether the source of generation of the voice is the notification target is made when the temperature of the vehicle's interior is out of the allowable temperature range, an alarm and notification about the fact that the notification target has been left alone in the vehicle's interior can be provided at appropriate timing that takes into account the health of the notification target.

The alarm system 1B according to the third embodiment includes the notification target detection device 2B, the alarming unit <NUM>, and the communication unit <NUM>. Since failure to detect a notification target by the notification target detection device 2B is reduced, an alarm and notification to the external device about the fact that the notification target has been left alone can be accurately provided.

In the notification target detection method according to the third embodiment, a series of processes shown in <FIG> are performed, and thus, failure to detect a notification target left alone in the vehicle's interior can be reduced.

Although a case is shown in which the vehicle information obtaining unit <NUM> determines whether the vehicle speed is less than or equal to the threshold value or whether the shifter position is the park position, on the basis of vehicle information, the configuration is not limited thereto. For example, the voice source determining unit 24B may determine whether the vehicle speed is less than or equal to the threshold value or whether the shifter position is the park position, on the basis of vehicle information inputted from the vehicle information obtaining unit <NUM>.

For example, the passenger presence-or-absence determining unit <NUM> may determine whether a passenger is present in the vehicle's interior, on the basis of detection information outputted from any of an infrared sensor, a pressure-sensitive sensor, and a weight sensor provided in the vehicle's interior. In this case, the video obtaining unit <NUM> may be omitted from the notification target detection device 2B, and the voice source determining unit 24B determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that there is no passenger in the vehicle's interior, and the temperature of the vehicle's interior is out of the allowable temperature range. As a result, even when the notification target is present at a location outside a detection area of a sensor that detects the notification target in the vehicle's interior, the notification target can be determined from the voice in the vehicle's interior. Thus, failure to detect the notification target left alone in the vehicle's interior can be reduced.

In addition, the passenger presence-or-absence determining unit <NUM> may determine whether a passenger is shown in video of the vehicle's interior obtained by the video obtaining unit <NUM>, and further determine whether a passenger is present in the vehicle's interior, on the basis of detection information outputted from any of an infrared sensor, a pressure-sensitive sensor, and a weight sensor provided in the vehicle's interior. In this case, too, the voice source determining unit 24B determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that there is no passenger in the vehicle's interior, and the temperature of the vehicle's interior is out of the allowable temperature range. As a result, even when the notification target is present at a location outside a detection area of a sensor that detects the notification target in the vehicle's interior, or the notification target is present at a location outside the image-capturing area of the in-vehicle camera, the notification target can be determined from the voice in the vehicle's interior. Thus, failure to detect the notification target left alone in the vehicle's interior can be reduced.

Although a configuration in which the temperature obtaining unit <NUM> is added to the notification target detection device <NUM> shown in <FIG> is shown so far, the notification target detection device according to the third embodiment may have a configuration in which the temperature obtaining unit <NUM> is added to the notification target detection device 2A shown in <FIG>. In this case, the voice source determining unit 24B determines whether a source of generation of a voice in the vehicle's interior is a notification target, when it has been determined that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the passenger presence-or-absence determining unit <NUM> has determined that a passenger is not shown in video of the vehicle's interior, the object detecting unit <NUM> has detected an object concerning the notification target, and the temperature of the vehicle's interior is out of the allowable temperature range. By such a configuration, too, failure to detect a notification target left alone in the vehicle's interior can be reduced.

<FIG> is a block diagram showing a functional configuration of an alarm system 1C according to a fourth embodiment of the invention. In <FIG>, the same components as those of <FIG> are given the same reference signs and description thereof is omitted. The alarm system 1C is a system that detects a notification target left alone in the vehicle's interior and performs an alarm process when the notification target has been detected, and includes a notification target detection device 2C, the alarming unit <NUM>, and the communication unit <NUM>. In addition, the notification target detection device 2C is configured to include the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the voice obtaining unit <NUM>, a voice source determining unit 24C, and a notification target detecting unit <NUM>.

The voice source determining unit 24C determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the notification target detecting unit <NUM> has detected the notification target when the vehicle speed exceeds a threshold value and it has been determined, on the basis of vehicle information obtained by the vehicle information obtaining unit <NUM>, that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position. The threshold value is vehicle speed indicating that the vehicle is parked, and for example, <NUM> (km/h) is set. The voice source determining unit 24C uses the fact that the notification target detecting unit <NUM> has detected a notification target when the vehicle speed exceeds the threshold value, i.e., during travel of the vehicle, as a condition for starting a determination as to whether the notification target has been left alone in the vehicle's interior.

The notification target detecting unit <NUM> detects a notification target in the vehicle's interior on the basis of video obtained by the video obtaining unit <NUM>. For example, the notification target detecting unit <NUM> detects a notification target by performing image recognition on video of the vehicle's interior. The DMS is generally a system for monitoring a state of a driver who is driving the vehicle, and thus, the in-vehicle camera included in the DMS starts up and shoots the vehicle's interior when the vehicle is traveling, and when the vehicle is parked, the operation of the in-vehicle camera is stopped. Hence, when the video obtaining unit <NUM> obtains video of the vehicle's interior from the in-vehicle camera included in the DMS, the video obtaining unit <NUM> obtains only video shot when the vehicle is traveling. The notification target detecting unit <NUM> detects whether a notification target is present in the vehicle's interior during travel of the vehicle during which the DMS is up and running.

Functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24C, and the notification target detecting unit <NUM> in the notification target detection device 2C are implemented by a processing circuit. When the processing circuit is the processing circuit <NUM> which is dedicated hardware shown in <FIG>, the processing circuit <NUM> corresponds, for example, to a single circuit, a combined circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof. The functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24C, and the notification target detecting unit <NUM> in the notification target detection device 2C may be implemented by different processing circuits, or the functions may be collectively implemented by a single processing circuit.

When the processing circuit is the processor <NUM> shown in <FIG>, the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24C, and the notification target detecting unit <NUM> in the notification target detection device 2C are implemented by software, firmware, or a combination of software and firmware. Note that the software or firmware is described as programs and stored in the memory <NUM>.

The processor <NUM> implements the functions of the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24C, and the notification target detecting unit <NUM> in the notification target detection device 2C by reading and executing the programs stored in the memory <NUM>. Namely, the notification target detection device 2C includes the memory <NUM> for storing programs, the execution of which by the processor <NUM> results in performing processes at step ST1d to ST5d shown in <FIG> which will be described later.

The programs cause a computer to perform a procedure or a method for the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24C, and the notification target detecting unit <NUM>. The memory <NUM> may be a computer readable storage medium having stored therein programs for causing the computer to function as the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24C, and the notification target detecting unit <NUM>.

<FIG> is a flowchart showing a notification target detection method according to the fourth embodiment.

First, the video obtaining unit <NUM> obtains video in which the vehicle's interior is shot (step ST1d). For example, the video obtaining unit <NUM> obtains video of the vehicle's interior from the camera <NUM> shown in <FIG> and outputs the video to the notification target detecting unit <NUM>. The notification target detecting unit <NUM> detects a notification target in the vehicle's interior on the basis of the video obtained by the video obtaining unit <NUM>. Detection information indicating whether a notification target is present is outputted to the voice source determining unit 24C from the notification target detecting unit <NUM>.

The vehicle information obtaining unit <NUM> obtains vehicle information indicating the vehicle speed or shifter position of the vehicle and outputs the vehicle information to the voice source determining unit 24C (step ST2d).

The voice source determining unit 24C determines whether a notification target has been detected in the vehicle's interior when the vehicle speed exceeds the threshold value, on the basis of the vehicle information obtained by the vehicle information obtaining unit <NUM> and the detection information inputted from the notification target detecting unit <NUM> (step ST3d). If a notification target has not been detected in the vehicle's interior when the vehicle speed exceeds the threshold value (step ST3d; NO), it is determined that a notification target is not in the vehicle and thus the process of <FIG> ends.

If a notification target has been detected in the vehicle's interior when the vehicle speed exceeds the threshold value (step ST3d; YES), the voice source determining unit 24C determines whether the vehicle speed of the vehicle is less than or equal to the threshold value or whether the shifter position is the park position, on the basis of the vehicle information obtained by the vehicle information obtaining unit <NUM> (step ST4d). If the vehicle speed exceeds the threshold value or the shifter position is other than the park position (step ST4d; NO), the vehicle is traveling and thus the process of <FIG> ends.

On the other hand, if the vehicle speed is less than or equal to the threshold value or the shifter position is the park position (step ST4d; YES), the voice source determining unit 24C determines whether a source of generation of a voice in the vehicle's interior obtained by the voice obtaining unit <NUM> is the notification target (step ST5d).

In this manner, the voice source determining unit 24C determines whether the source of generation of the voice in the vehicle's interior is the notification target, when the notification target detecting unit <NUM> has detected the notification target when the vehicle speed exceeds the threshold value and it has been determined, on the basis of the vehicle information obtained by the vehicle information obtaining unit <NUM>, that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position.

At step ST5d, the process at step ST1a shown in <FIG> is performed, and the processes after step ST1a are performed depending on a result of the determination. Namely, if the source of generation of the voice in the vehicle's interior is only the notification target, then the alarming unit <NUM> starts an alarm indicating that the notification target has been left alone. When the alarm starts, the communication unit <NUM> notifies the external device of the fact that the notification target has been left alone in the vehicle's interior.

As described above, the notification target detection device 2C according to the fourth embodiment includes the vehicle information obtaining unit <NUM>, the video obtaining unit <NUM>, the voice obtaining unit <NUM>, the voice source determining unit 24C, and the notification target detecting unit <NUM>. The voice source determining unit 24C determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the notification target detecting unit <NUM> has detected the notification target when the vehicle speed exceeds the threshold value and it has been determined, on the basis of vehicle information obtained by the vehicle information obtaining unit <NUM>, that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position. As a result, failure to detect a notification target left alone in the vehicle's interior can be reduced. In addition, the voice source determining unit 24C determines a source of generation of a voice in the vehicle's interior at timing at which the vehicle is parked, when a notification target has been detected in the vehicle's interior during travel of the vehicle. Thus, a determination as to whether a passenger is present does not need to be made using video of the vehicle's interior when the vehicle is parked, and a processing load of the notification target detection device 2C can be reduced.

The alarm system 1C according to the fourth embodiment includes the notification target detection device 2C, the alarming unit <NUM>, and the communication unit <NUM>. Since failure to detect a notification target by the notification target detection device 2C is reduced, an alarm and notification to the external device about the fact that the notification target has been left alone can be accurately provided.

In addition, in the notification target detection method according to the fourth embodiment, a series of processes shown in <FIG> are performed, and thus, failure to detect a notification target left alone in the vehicle's interior can be reduced.

In addition, the object detecting unit <NUM> shown in the second embodiment may be added to the notification target detection device 2C according to the fourth embodiment. In this case, the voice source determining unit 24C determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the notification target has been detected when the vehicle speed exceeds the threshold value, it has been determined that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, and the object detecting unit <NUM> has detected an object concerning the notification target. By such a configuration, too, failure to detect a notification target left alone in the vehicle's interior can be reduced.

Furthermore, the temperature obtaining unit <NUM> shown in the third embodiment may be added to the notification target detection device 2C according to the fourth embodiment. In this case, the voice source determining unit 24C determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the notification target has been detected when the vehicle speed exceeds the threshold value, it has been determined that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, and the temperature of the vehicle's interior obtained by the temperature obtaining unit <NUM> is out of the allowable temperature range. By such a configuration, too, failure to detect a notification target left alone in the vehicle's interior can be reduced.

Furthermore, the object detecting unit <NUM> shown in the second embodiment and the temperature obtaining unit <NUM> shown in the third embodiment may be added to the notification target detection device 2C according to the fourth embodiment. In this case, the voice source determining unit 24C determines whether a source of generation of a voice in the vehicle's interior is a notification target, when the notification target has been detected when the vehicle speed exceeds the threshold value, it has been determined that the vehicle speed is less than or equal to the threshold value or the shifter position is the park position, the object detecting unit <NUM> has detected an object concerning the notification target, and the temperature of the vehicle's interior obtained by the temperature obtaining unit <NUM> is out of the allowable temperature range.

By such a configuration, too, failure to detect a notification target left alone in the vehicle's interior can be reduced.

Note that the present invention is not limited to the above-described embodiments, and a free combination of the embodiments, modifications to any component of the embodiments, or omissions of any component in the embodiments are possible within the scope defined by the appended claims.

Notification target detection devices according to the invention can reduce failure to detect a notification target left alone in a vehicle's interior, and thus, can be used in systems for monitoring passengers in a vehicle.

Claim 1:
A notification target detection device comprising:
a vehicle information obtaining unit (<NUM>) for obtaining vehicle information indicating a vehicle speed or a shifter position;
a video obtaining unit (<NUM>) for obtaining video in which a vehicle's interior is shot;
a passenger presence-or-absence determining unit (<NUM>) for determining that a passenger is present in the vehicle's interior when an image of the passenger except for a child or a pet that is a notification target, of which a person outside a vehicle is to be informed, is included in the video in the vehicle's interior obtained by the video obtaining unit (<NUM>) and determining that the passenger is not present in the vehicle's interior when the image of the passenger that is not the notification target is not included in the video in the vehicle's interior obtained by the video obtaining unit (<NUM>);
a voice obtaining unit (<NUM>) for obtaining a voice in the vehicle's interior;
a voice source determining unit (<NUM>, 24A to 24C) for determining whether a source of generation of the voice in the vehicle's interior is the notification target alone of which the person outside the vehicle is to be informed, based on the voice in the vehicle's interior obtained by the voice obtaining unit (<NUM>); and
an object detecting unit (<NUM>) for detecting an object related to the notification target in the vehicle's interior on a basis of the video obtained by the video obtaining unit (<NUM>),
wherein the voice source determining unit (<NUM>, 24A to 24C) determines whether the source of generation of the voice in the vehicle's interior is the notification target alone when it has been determined that the vehicle speed is less than or equal to a threshold value or the shifter position is a park position on a basis of the vehicle information obtained by the vehicle information obtaining unit (<NUM>), and when the passenger presence-or-absence determining unit (<NUM>) has determined that a passenger is not present in the vehicle's interior and the object detecting unit (<NUM>) has detected an object related to the notification target in the vehicle's interior.