A camera device of one embodiment is provided with an image capturing unit configured to capture image of a room interior; a receiving unit configured to receive an image capturing instruction for capturing image of the room interior by way of a home appliance; and a camera-side controller being configured to standby in a low-power mode consuming relatively less electric power compared to a normal-operation mode and being configured to capture image of the room interior through the image capturing unit by returning to the normal-operation mode when the receiving unit receives the image capturing instruction.

FIELD

Embodiments disclosed herein relate to a camera device, an in-room image capturing system, and an in-room information acquiring device.

BACKGROUND

Conventionally, systems have been known in which information of food, etc. stored in a refrigerator for example can be acquired from remote locations by providing a camera for example in the refrigerator.

However, since it is not possible to know when instruction for acquiring in-room information will be given from a remote user, the system has been required to keep running in a state capable of receiving such instructions which may be given at any given time and thus, resulted in increased electric power consumption.

DESCRIPTION

A camera device of one embodiment is provided with an image capturing unit configured to capture image of a room interior; a receiving unit configured to receive an image capturing instruction for capturing image of the room interior by way of a home appliance; and a controller being configured to standby in a low-power mode consuming relatively less electric power compared to a normal-operation mode and being configured to capture image of the room interior through the image capturing unit by returning to the normal-operation mode when the receiving unit receives the image capturing instruction.

A description will be given on one embodiment with reference toFIGS. 1 to 11.

As illustrated inFIG. 1, an in-room image capturing system100of the present embodiment is configured by a refrigerator1being one example of a home appliance, a camera device2for capturing an in-room image, an access point3for communicating with the refrigerator1side, a mobile terminal4serving as an operation terminal, etc. The access point3is connected to an external network5and is configured to communicably interconnect the mobile terminal4and a server6, etc. located in remote locations with the refrigerator1side by way of the external network5. In the present embodiment, a Bluetooth (registered trademark) wireless communication is exchanged between the refrigerator1and the access point3; between the access point3and the mobile terminal4; and between the camera device2and the access point3.

The mobile terminal4is an operation terminal configured to input image capturing instruction to the camera device2for capturing in-room images. Examples of the mobile terminal4envisaged in the present embodiment include the so-called smart phone (highly functional mobile phone). Examples of the operation terminal include, apart from the mobile terminal4discussed herein, a tablet PC for example. When the mobile terminal4is located inside a residence7, the mobile terminal4is communicably connected to the access point3by a close-range wireless communication. When the mobile terminal4is located outside the residence7, the mobile terminal4is communicably connected to the access point3by a wide-range wireless communication byway of external network5. The mobile terminal4is further capable of connecting to the access point3by way of the external network5through wide-range communication even when located inside of the residence7. The mobile terminal4located inside the residence7is further capable of communicating directly with the refrigerator1side without the intervention of the access point3

The server6is configured by a computer system known in the art. The server6stores information (such as an IP address) for accessing the refrigerator1. The server6further stores captured image data containing images captured by the camera device2in the present embodiment. Though only the refrigerator1is illustrated inFIG. 1, other home appliances such as an air conditioner, etc. not illustrated is also interconnected over a network.

By interconnecting the home appliances over a network, it is possible to: visualize the electric power consumption of each home appliance for the user's reference; shift the peak of electric power consumption during the day time in summer for example when there is a large demand for electric power; perform various controls of electric power consumption such as peak cutting in which a momentary use of electric power exceeding the rated level in a general household is inhibited; perform failure diagnosis of home appliances, etc. The network of home appliances provides a user friendly, convenient, and an easy to use system by offering functionalities such as those exemplified above. It becomes further possible to check the status (status of things stored) inside the compartments of the refrigerator1by installing the camera device2inside the refrigerator1for example. By storing various information and captured image data, etc. in the server6, it is possible to view such information through the mobile terminal4, etc. over the external network5even from remote locations.

Next, a description is given on the camera device2.

The camera device2is configured by a body10shaped like a cuboid and an image capturing portion11(seeFIG. 4) including a lens12provided on the body10in an exposed manner as illustrated inFIGS. 2 and 3. In the present embodiment, a couple of image capturing lights13and an optical sensor14are further provided on the surface of the body10in an exposed manner. The lens12, image capturing lights13, and the optical sensor14may be hidden under a cover, etc. instead of being exposed outside the body10. A description is given hereinafter with an assumption that the exposed side of the lens12, etc. (the right side inFIG. 3) is the front surface of the camera device2and the opposite side (the left side inFIG. 3) as is the rear surface.

As illustrated inFIG. 3, a control substrate15, a battery16, a communication module17, a sound sensor19, a vibration sensor20, etc. are stored inside the body10of the camera device2. The lens12, the image capturing portion11provided with an image capturing element not illustrated, image capturing lights13, and a camera-side controller18(seeFIG. 4) are provided on the control substrate15. The image capturing element is configured by elements such as CCD and CMOS known in the art. The image capturing lights13are configured by LED. Though not illustrated, power switches are provided to the camera device2.

The battery16supplies electric power to the control portion, the communication module17, the optical sensor14, the sound sensor19, the vibration sensor20, etc. That is, the camera device2is driven by the battery16installed therein. The camera device2is capable of running without power plug cable, etc. and thus, may be installed in any location. In the present embodiment, the camera device2is installed inside the refrigeration chamber as described above.

The communication module17transmits the image data of the fridge interior captured by the image capturing portion11to the mobile terminal4, the server6, etc. byway of the access point3. The captured image data is transmitted to the server6to store the captured image data to the server6. The captured image data contains in-room images. Examples of the captured image data include an image data (still image, moving image) of known formats such as a bit map format and JPEG/MPEG format and compressed/encrypted forms of such data as well as converted forms of such data converted by image processing. The image data may come in any format as long the interior of a room can be viewed through the mobile terminal or the like.

As illustrated inFIG. 4, the camera-side controller18is configured by a microcomputer provided with a CPU18a, a ROM18b, a RAM18c, RTC18d, etc. and is responsible for the overall control of the camera device2. More specifically, the camera-side controller18performs controls such as: a control of timing of capturing images by the image capturing portion11; a control to prepare image capturing environment (control of illuminating the image capturing light13); transmitting the captured image data through the communication module17; and a control for receiving (accepting) a later described image capturing instruction by each of the sensors. In the present embodiment, the camera-side controller18is also configured to perform image processing such as modification of the captured images. The camera-side controller18serves as a controller.

The optical sensor14connected to the camera-side controller18is a so-called illuminance sensor configured to detect the illuminance of the periphery of the camera device2. More specifically, the optical sensor14is configured to detect optical energy (optical energy emitted from a later described in-room LED in the present embodiment) belonging to a predetermined wavelength band. The optical energy detected by the optical sensor14is converted into electric signal and outputted to the camera-side controller18.

The sound sensor19is configured to detect sound produced in the periphery of the camera device2. More specifically, the sound sensor19is configured to detect sound energy (sound energy produced by a later described panel buzzer29and in-room buzzer33in the present embodiment) produced in a certain frequency band. The sound energy detected by the sound sensor19is converted into electric signal and outputted to the camera-side controller18.

The vibration sensor20is configured to detect vibration of the camera device2. The vibration sensor20is configured by a 3-axis acceleration sensor for example. The vibration energy detected by the vibration sensor20is converted into electric signal and outputted to the camera-side controller18. The camera-side controller18is configured to detect vibration of the camera device2based on acceleration.

As later described in detail, the optical sensor14, the sound sensor19, and the vibration sensor20are sensors configured to detect physical energy and serve as a receiving unit configured to receive the image capturing instruction. It is not mandatory to provide the optical sensor14, the sound sensor19, and the vibration sensor20at the same time. If the image capturing instruction is only given through optical energy for example, it is possible to only provide the optical sensor14.

The camera-side controller18is configured to judge whether or not the detected energy is an image capturing instruction based on intensity and pattern of the detected energy. In the present embodiment, image capturing instruction given by the user is provided as energy produced according to a predetermined pattern. The camera-side controller18serves as a judging unit configured to judge whether or not the pattern of energy detected by each sensor matches the pattern indicated in the image capturing instruction.

The camera device2configured as described above normally stands by in low-power mode which consumes relatively less electric power compared to the normal-operation mode. When receiving the image capturing instruction, the camera device2returns to the normal-operation mode and captures an in-room image. In the present embodiment, the camera device2is provided inside the refrigeration chamber and thus, an image inside the refrigeration chamber is captured.

The refrigerator1in which the camera device2is installed is provided with a fridge-side controller21. The fridge-side controller21is configured by a microcomputer provided with a CPU21a, a ROM21b, a RAM21c, timer21d, etc. and is responsible for the overall control of the refrigerator1. More specifically, the fridge-side controller21is configured to control the operational status of the refrigeration cooling mechanism25and freeze cooling mechanism26that configure the refrigeration cycle known in the art based on the temperature inside the chambers detected by a temperature sensor23or opened/closed state of the door detected by a door sensor24, so that the operational status specified from the control panel22can be achieved.

The control panel22is provided with a panel display27, a panel LED28, and a panel buzzer29. The panel display27displays the specified settings, etc. The panel LED28is provided to illuminate the operation switches and operational status indicators, etc. The panel buzzer29is configured by a piezoelectric buzzer for example and notifies the type of operations made by producing a sound (sound energy) depending upon the operation made. In the present embodiment, the panel buzzer29is capable of outputting a sound of 6 kHz. As later described, the panel buzzer29also serves as a transmitting unit configured to produce sound energy in order to transmit image capturing instruction to the camera device2.

An in-room light30is provided inside the refrigeration chamber, etc. which is illuminated when the door is opened. That is, the in-room light30produces optical energy. The in-room light30is capable of flickering under the control of the fridge-side controller21. A blower31is provided for circulating cool air inside the refrigerator1when operated normally. The blower31is capable of producing sound energy such as wind noise and motor sound by increasing the rotation count to be greater than the rotation count observed during normal operation.

The in-room LED32is configured to produce optical energy for transmitting image capturing instruction to the camera device2. In the present embodiment, the in-room LED32is configured to produce light belonging to a certain frequency band capable of being detected by the optical sensor14. The in-room LED32is capable of flickering in a certain pattern. The in-room LED32serves as a transmitting unit configured to transmit image capturing instruction to the camera device2side by flickering in a pattern corresponding to the image capturing instruction. The in-room light30, also configured to produce optical energy, may be used as the transmitting unit instead of the in-room LED32. When the in-room light30is used as the transmitting unit, it is not necessary to provide the in-room LED32.

The in-room buzzer33comprises a piezoelectric buzzer for example configured to produce sound energy for transmitting image capturing instruction to the camera device2. The in-room buzzer33is capable of outputting sound of 20 kHz for example (i.e. sound beyond the audible range). While the sound produced by the in-room buzzer33is detectable by the sound sensor19, it is not audible to human. It is not necessary to provide the in-room buzzer33when the panel buzzer29is used as the transmitting unit or when the blower31is used as the transmitting unit. The in-room buzzer serves as the transmitting unit.

The communication adaptor34is configured to exchange communication with the access point3and with the mobile terminal4, etc. located in the room and is provided detachably to the refrigerator1in the present embodiment. Though only the refrigerator1is illustrated inFIG. 1, the communication adaptor34is also provided to other home appliances such as an air conditioner to establish a network of home appliances. The communication adaptor34serves as a communication unit. The communication adaptor34is further configured to be capable of communicating directly with the camera device2without the intervention of the access point3. The communication adaptor34is also used for visualization of system status, etc. as described earlier and thus, is basically operative while the refrigerator1is in service.

Next, a description is given on the operation of the above described configuration.

It is possible to capture an image inside the room of the residence7or an image inside the refrigeration chamber, etc. by providing the camera device2described above. It is possible to acquire the captured image data at any given timing from a remote location by transmitting image capturing instruction to the camera device2from the mobile terminal4over the external network5. As it is not possible to predict when the image capturing instruction will be transmitted, the communication module17needs to be constantly operative, which increases electric power consumption. As a result, the battery16needs to be replaced (or charged) in a day or few days.

Thus, the camera device2and the in-room image capturing system100is configured to suppress electric power consumption while enabling acquisition of in-room information such as captured image data at any given timing by transmitting image capturing instruction from home appliances such as the refrigerator1(by cooperating with the home appliances). Examples of transmitting image capturing instruction using: optical energy; sound energy; vibration energy; and a combination of the foregoing (optical energy and vibration energy) will be described one by one for ease of explanation.

When transmitting image capturing instruction using optical energy, the refrigerator1executes a fridge-side process indicated inFIG. 5and the camera device2executes a camera-side process indicated inFIG. 6.

In the fridge-side process indicated inFIG. 5, The refrigerator1judges whether the image capturing instruction has been received (R1). The image capturing instruction given by the user is transmitted by way of the access point3and received by the refrigerator1at the communication adaptor34(seeFIG. 4). The refrigerator1stands by when it has not received the image capturing instruction (R1: NO). When receiving the image capturing instruction, on the other hand (R1: YES), the refrigerator1judges whether the door is closed (R2), and when the door is opened (R2: NO), the refrigerator1stands by until the door is closed.

When the door is closed (R2: YES), the refrigerator1issues an alert through the control panel22, etc. that image is being captured (R3) and thereafter produces energy (which is optical energy in this case). At step R3, the refrigerator1produces optical energy by flickering the in-room LED32in a certain pattern corresponding to the image capturing instruction. More specifically, the refrigerator1repeatedly turns the in-room LED32ON/OFF as illustrated inFIG. 7for a preset flickering period when receiving the image capturing instruction. That is, in the present embodiment, a flickering pattern in which optical energy is flickered at 5 Hz is used as the image capturing instruction. This flickering pattern is a pattern which will not occur when the refrigerator1is under normal use. The in-room light30is illuminated when the door is opened. However, the door is not expected to be opened and closed at 5 Hz (0.2 S period) and thus, there is no possibility of the opening and closing of the door to be misunderstood as the image capturing instruction.

When power is turned ON (S1) in the camera-side process indicated inFIG. 6, the camera device2proceeds to the sleep mode (S2). The sleep mode is one example of a low-power mode which consumes less power compared to a normal operation mode. Then, the camera device2judges whether energy has been detected (S3). More specifically, the camera-side controller18stands by in the sleep mode at step S3, and judges whether or not detection of optical energy has been notified by the optical sensor14. The notification is issued as an interruption signal, etc. known in the field of microcomputers.

When energy has not been detected (S3: NO), the camera device2stands by, whereas when energy has been detected (S3: YES), transition is made to revert to the normal operation mode (S4). Then, judgment is made as to whether the pattern of the detected energy matches the pattern of image capturing instruction (S5). More specifically, the camera device2detects the ON/OFF edges of optical energy and when the edges are detected 10 or more times in 5 seconds for example, the pattern is judged as the image capturing instruction.

When the detected pattern matches the pattern of the image capturing instruction (S5: YES), the camera device2captures the in-room image (S6) and transmits the captured image data to the mobile terminal4etc. or stores the captured image data to the server6, etc. (S7) and a transition is thereafter made to the sleep mode of step S2. The camera device2also makes a transition to the sleep mode when the detected pattern does not match the pattern of the image capturing instruction (S5: NO). It is thus, possible to transmit the image capturing instruction to the camera device2in sleep mode through optical energy.

When transmitting the image capturing instruction using sound energy, the refrigerator1executes the fridge-side process indicated inFIG. 5and the camera device2executes the camera-side process indicated inFIG. 6as was the case when using optical energy. A description will be given hereinafter on the differences of the processes.

When receiving the image capturing instruction (R1: YES), the refrigerator1judges whether the door is closed (R2: YES), and after issuing a notification that image capturing is ongoing (R3), energy (sound energy in this case) is produced. In this example, the refrigerator1produces sound energy by ringing the panel buzzer29in a certain pattern. More specifically, the refrigerator1rings the panel buzzer29so as to be turned ON (ring) for 0.5 seconds and turned OFF (stop) for 0.5 seconds for a preset ringing period when receiving the image capturing instruction as illustrated inFIG. 8. That is, in the present embodiment, a ringing pattern being configured to ring intermittently at a predetermined period (0.5 second period) and belonging to a preset frequency band of 6 kHz (non-audible region of 20 kHz when the in-room buzzer33is used) is used as the pattern of image capturing instruction. This ringing pattern is a pattern which is different from normal operation (user operation) and which is not expected to occur in situations other than issuance of image capturing instruction.

In the camera-side process indicated inFIG. 6, when power is turned ON (S1), the camera device makes a transition to the sleep mode and stands by (S2). When a notification is issued, by interruption signal, etc., from the sound sensor19informing that sound energy has been detected; that is, when detecting sound energy (S3: YES), the refrigerator1makes a transition to the normal-operation mode (S4) and a judgement is made whether the pattern of the sound energy matches the pattern of the image capturing instruction (S5). In this example, the camera device2detects the ON/OFF edges of the sound energy and judges that the sound energy is an image capturing instruction when the edges are detected 10 or more times in 5 seconds for example.

When the detected pattern matches the pattern of the image capturing instruction (S5: YES), the camera device2captures the in-room image (S6) and transmits the captured image data to the mobile terminal4etc. or stores the captured image data to the server6, etc. (S7) and a transition is thereafter made to the sleep mode of step S2. It is thus, possible to transmit the image capturing instruction to the camera device2in sleep mode through sound energy.

In the examples in which optical energy and sound energy were used, image capturing instruction was given by the user in real time. In this example, the image capturing instruction is preset to be given for capturing images when the door of the refrigerator1is opened/closed (when there is a possibility that status of items stored in the refrigerator1may have been changed). That is, the receiving unit is configured to be capable of receiving (accepting) image capturing instruction given based on preset conditions in addition to receiving image capturing instruction given in real time.

The refrigerator1executes the fridge-side process indicated inFIG. 9and the camera device2executes the camera-side process indicated inFIG. 10. The process flow of the camera-side process indicated inFIG. 10is substantially the same as the camera-side process indicated inFIG. 6and thus, a description will be given in detail on the differences. In the fridge-side process indicated inFIG. 9, the refrigerator1judges whether the door has been opened/closed (R10) and stands by when the door has not been opened/closed (R10: NO). When the door has been opened/closed (R10: YES) on the other hand, the refrigerator1issues a notification that image capturing is ongoing (R11) and thereafter transmits image capturing instruction (R12) to the camera device2from the communication adaptor34.

When power is turned ON (S10) in the camera-side process indicated inFIG. 10, transition is made to the sleep mode (S11) and judgment is made as to whether vibration (vibration energy) is detected (S12). When the door of the refrigerator1is opened/closed as described above, vibration is produced. When detecting vibration (S12: YES), the camera device2returns to the normal-operation mode (S13) and judges whether image capturing instruction has been received from the refrigerator1(S14). At step S14, the image capturing instruction is received through the communication module17.

Then, when receiving an image capturing instruction (S14: YES), the camera device2captures an in-room image (S15) and transmits the captured image data or stores the captured image data to the server6, etc. (S16) and a transition is thereafter made to the sleep mode. The data is transmitted to the mobile terminal4, etc. at step S16. That is, when the door of the refrigerator1is opened/closed, the camera device2is configured to notify the user that the storage status of items, etc. stored in the refrigerator1may have changed in the form of captured image data.

It is thus, possible to transmit image capturing instruction by vibration energy to the camera device2in sleep mode.

<Using Optical Energy and Vibration Energy>

In this example, optical energy and vibration energy are used to capture images using camera device2alone, when the image capturing instruction is preset to be given when the door of the refrigerator1is opened/closed. The camera device2is configured to execute the camera-side process indicated inFIG. 11. The camera-side process indicated inFIG. 11is substantially the same as the camera-side process indicated inFIG. 10and thus, description will be given on the differences.

When the power is turned ON (S20) in the camera-side process indicated inFIG. 11, the camera device2makes a transition to the sleep mode (S21) and judges whether the optical energy has been detected (S22). When the door of the refrigerator1has been opened, the refrigerator1illuminates the in-room light30for example. Further, when the door has been opened, light is shed on the camera device2by the light outside the fridge. That is, it is possible to detect the opened/closed status of the door by detecting optical energy. Thus, when optical energy has been detected (S22: YES), the camera device2returns to the normal-operation mode (S23) assuming that the door of the refrigerator1has been opened.

Then, the camera device2judges whether the door is in a state corresponding to the door being closed (S24). The “state corresponding to the door being closed” indicates the state in which the door has been closed after being opened. More specifically, the following judgments are made at step S24.a) Whether the time period in which optical energy was being detected was not a momentary but lasted for a time period that would be required for taking items, etc. out of the refrigerator1.b) Whether vibration energy produced when the door was closed has been detected.

The camera device2judges whether the door of the refrigerator1was opened/closed by making the above described judgments. When judging that the refrigerator1is in the “state corresponding to the door being closed” (S24: YES), in-room image is captured (S25) and the captured image data is transmitted or stored in the server6, etc. (S26), whereafter transition is made to the sleep mode. The data is transmitted to the mobile terminal4, etc. at step S26.

It is possible to transmit the image capturing instruction to the camera device2in sleep mode by combining optical energy with vibration energy.

The following effects can be obtained by the above described embodiments.

The camera device2is provided with the image capturing unit11configured to capture image of a room interior; the receiving unit configured to receive an image capturing instruction for capturing image of the room interior by way of a home appliance; and the camera-side controller18being configured to standby in a low-power mode consuming relatively less electric power compared to a normal-operation mode and being configured to capture image of the room interior through the image capturing unit by returning to the normal-operation mode when the receiving unit receives the image capturing instruction. It is thus not required to stand by in the normal-operation mode even when it is not possible to expect when image capturing instruction will be transmitted. As a result, it is possible to reduce electric power consumption when in standby. It is further possible to capture image of the room interior regardless of when the image capturing instruction is transmitted since the receiving unit is provided. It is thus, possible to suppress electric power consumption while allowing captured image data providing information of the room interior to be acquired at any given timing.

The image capturing instruction is configured to be transmitted through physical energy produced by home appliances and the receiving unit comprises the optical sensor14, the sound sensor19, the vibration sensor20, etc. configured to detect the produced energy. It is thus, possible to utilize items provided to the home appliances such as the panel buzzer29, in-room light30, etc. for transmitting the image capturing instruction. Hence, it is possible to transmit image capturing instruction to the camera device2without providing additional components.

Components such as the in-room LED32and the in-room buzzer33may be provided which are dedicated to serve as the receiving unit. For example, it is possible to transmit the image capturing instruction without affecting the user by configuring the in-room LED32to produce light energy belonging to wavelength band exclusive of the wavelength band of visible light or by configuring the in-room buzzer33to produce sound energy of approximately 20 kHz or greater which is beyond the audible region.

The image capturing instruction is transmitted by producing energy in a predetermined pattern and image is captured provided that the detected pattern matches the produced pattern. It is thus, possible to reliably transmit the image capturing instruction without being affected by disturbance and thereby prevent detection errors and image capturing errors.

A transition is made to the sleep mode (low-power mode) when image capturing has been completed and the pattern of the detected energy and the pattern of the image capturing instruction do not match. It is thus, possible to reduce electric power consumption.

For example, when components preinstalled to the home appliance such as the panel buzzer29and the in-room light30are used, such components may produce energy apart from energy produced for issuing image capturing instruction. It is thus, possible to prevent image capturing errors by issuing the image capturing instruction in a pattern which will not be produced in normal operation (the flickering pattern indicated inFIG. 7, ringing pattern illustrated inFIG. 8, etc).

The in-room image capturing system100is configured by the camera device2, an operation terminal such as the operation terminal4, etc. configured to input the image capturing instruction to the camera device2; and a home appliance provided with the communication adaptor34configured to receive the image capturing instruction given by the operation terminal and a transmitting unit (such as the in-room LED32and the panel buzzer29) configured to transmit the received image capturing instruction to the camera device2. It is thus, possible to suppress electric power consumption while allowing captured image data providing information of the room interior to be acquired at any given timing.

According to the embodiments described above, it is possible to provide a camera device, an in-room image capturing system, and an in-room information acquiring device capable of acquiring in-room information as one desires while suppressing electric power consumption.

Examples discussed in the above described embodiments may be modified or be combined in different ways for example as follows. Effects similar to those of the first embodiment can be achieved by such configurations as well.

The numerical values such as the flickering period, the ringing period, etc. disclosed in the embodiments are examples and may be modified as follows. When detecting optical energy, any pattern or judging standard may be employed instead of detecting the ON/OFF edges as long as the effect of ambient light can be suppressed. Examples of such patterns and judging standards include, whether the intensity (illuminance) of optical energy has exceeded a reference value, whether the ON/OFF period match, or whether the ON/OFF pulse width match.

In such case, optical energy may be specified to a wavelength band exclusive of the wavelength band of visible light such as an infrared light for example. When the camera device2is provided inside the room of the residence7and lighting equipment (visible light) is used as the transmitting unit, it is possible to transmit the image capturing instruction which is invisible to the human eye by specifying the flickering period to a period which is not discernable to the human eye (equal to or greater than approximately 30 Hz for example).

When detecting sound energy, any pattern or judging standard may be employed as long as the effect of external noise can be suppressed. Examples of such patterns and judging standards include, whether the intensity (the so-called sound pressure or dB value) of sound energy has exceeded a reference value, whether the ON/OFF period match, or whether the ON/OFF pulse width match.

In such case, it is possible to produce sound energy in the user's home that does not produce noise if ultrasonic wave exceeding the wavelength region exceeding the audible range of human (approximately 20 kHz or greater for example). It is possible to produce sound energy by elevating the rotational count of the blower31to a rotational count which is not used in normal operation (such as 2500 rpm) without using the panel buzzer29and the in-room buzzer33for example.

In one embodiment, the refrigerator1was given as an example of a home appliance. However, other types of home appliances may be employed instead. For example, it is possible to similarly capture the image inside the room of the residence7in addition to the image of the chamber interior of the refrigerator1using the camera device2by utilizing the sound produced by air conditioner or television. It is further possible to preset a frequency corresponding to image capturing instruction which is transmitted by sound energy belonging to a frequency band not competing with the frequency band of the home appliance. As for optical energy, an infrared transmitting/receiving portion configured to be capable of performing bi-directional infrared communication with the remote controller may be provided to the air conditioner. The infrared transmitting/receiving portion may be used as the transmitting unit. A washing machine may use a buzzer for notifying completion of operation, etc. as the transmitting unit.

In one embodiment, each of sensors configured to detect optical energy, sound energy, and vibration energy are provided. Alternatively, either one or two of the sensors may be provided.

In one embodiment, optical energy and vibration energy were combined. Alternatively, optical energy and sound energy may be combined or sound energy and vibration energy may be combined. Still alternatively, all of the foregoing energies may be combined. Each of the energies may be combined with one other when transmitting image capturing instruction in real time in addition to the above described case in which the image capturing instruction is given according to preset conditions such as when the door of the refrigerator1is opened/closed.

In one embodiment, image data captured using the camera device2was obtained as information of the room interior. Alternatively, other information may be acquired. That is, an information acquiring device configured to acquire information of a room interior such as image capturing data and sound data, etc. may comprise an information acquiring unit configured to acquire information of the room interior; a receiving unit configured to receive an acquiring instruction given to the information acquiring unit; and a controller configured to standby in a low-power mode consuming relatively less electric power compared to a normal-operation mode and being configured to control the information acquiring unit to acquire information of the room interior by returning to the normal-operation mode when the receiving unit receives the acquiring instruction. The above described configuration also achieves effects similar to those of the foregoing embodiments of suppressing power consumption while acquiring information of the room interior at any giving timing, for example.

In some embodiments, the optical energy is configured to flicker according to a period set to 30 Hz or greater.

In some embodiments, the optical energy is specified to a wavelength band exclusive of a wavelength band of visible light.

In some embodiments, the frequency band of the sound energy is specified to 20 kHz.

In some embodiments, the image capturing instruction is given by emitting the sound energy according to a pattern in which the sound energy is configured to ring intermittently according to a predetermined period.