Patent Description:
There is a system for obtaining various sensor data by combining a slave device, which is a wireless communication device for transmitting data obtained by a sensor, and a master device for collecting data. In such a system, first, the process of registering the slave device with the master device is performed. Thereafter, a user performs various settings for the slave device via the master device. The settings include, for example, the detection accuracy and units of the sensor, a sleep interval, and the name for identifying the slave device. The slave device transmits sensor data to the master device and enters sleep mode according to the settings.

Further, when the master device is an image capturing apparatus, it is desired to identify a slave device included in a captured image. For example, <CIT> (Patent Document <NUM>) discloses a technique for receiving information on a monitoring target from an external server and identifying the monitoring target in order to display additional information superimposed on the monitoring target in an image capturing screen.

However, in Patent Document <NUM>, since the configuration is for receiving the information on the monitoring target from the external server, it is impossible to identify the monitoring target in the image capturing screen by the image capturing apparatus alone. Generally, the slave device information held by the master device does not include information indicating the physical positional relationship between the slave device and the master device. Therefore, when the master device is an image capturing apparatus, even when a slave device exists in the image capturing range of the master device, the master device cannot identify which of the registered slave devices that slave device is. Moreover, in <NPL>, a low-cost prototype that leverages the Augmented Reality technology to deliver an interactive way of operating office network devices around using a mobile device is presented according to its abstract. A wearable computer with superimposed controls and instructions for an external device is disclosed in patent <CIT>.

The present invention in its first aspect provides a control apparatus as specified in claims <NUM> to <NUM>.

The present invention in its second aspect provides a method of controlling a control apparatus as specified in claim <NUM>.

The present invention enables identification of a slave device included in a captured image.

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

As a first embodiment of a control apparatus according to the present invention, description will be given below using an example of an image capturing apparatus that operates as a master device for controlling a slave device.

<FIG> is a diagram illustrating an overall configuration of a system in the first embodiment. The system includes a network camera <NUM> and a client apparatus <NUM> that are connected to be capable of communication by a network <NUM>. The system also includes a wireless communication slave device <NUM> that can be connected with the network camera <NUM> by wireless communication.

The network camera <NUM> is an apparatus that receives control from the client apparatus <NUM> via the network <NUM> and transmits an image obtained by an image capturing unit <NUM> to the client apparatus <NUM>. Further, the network camera <NUM> is configured to be capable of controlling the wireless communication slave device <NUM> via wireless communication.

The image capturing unit <NUM> receives, in an image capturing element, the light that has been formed into an image through a lens, converts the received light into electric charge, and thereby generates an image capturing signal. As the image capturing element, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, for example, can be used. Further, as the image capturing element, a CCD (Charge Coupled Device) image sensor may be used.

An image processing unit <NUM> generates image data by digitizing the image capturing signals converted by the image capturing unit <NUM>. At this time, the image processing unit <NUM> also performs a variety of image processing to correct image quality. The image processing unit <NUM> may further generate compressed and encoded image data by compressing and encoding image data.

A lens control unit <NUM> controls a lens driving unit <NUM> based on instructions from a system control unit <NUM>. The lens driving unit <NUM> is configured by a driving system of a focus lens and a zoom lens and a motor of the driving source of the driving system, and the operation thereof is controlled by the lens control unit <NUM>.

A pan driving unit <NUM> is configured by a mechanical driving system for performing a pan operation, a motor of the driving source thereof, and an angle sensor for detecting an angle of the driving unit. A tilt driving unit <NUM> is configured by a mechanical driving system for performing a tilt operation, a motor of the driving source thereof, and an angle sensor for detecting an angle of the driving unit. The operation of the pan driving unit <NUM> and the tilt driving unit <NUM> is controlled by a pan/tilt control unit <NUM>. The pan/tilt control unit <NUM> controls the driving of the pan driving unit <NUM> and the tilt driving unit <NUM> based on instructions from the system control unit <NUM>.

A communication unit <NUM> is a functional unit that communicates with the client apparatus <NUM>. For example, the communication unit <NUM> transmits, to the client apparatus <NUM>, a video stream based on the image data generated by the image processing unit <NUM>. Here, the image data is, as an example, frame image data comprising a moving image. Further, the communication unit <NUM> receives commands transmitted from the client apparatus <NUM> and transmits the commands to the system control unit <NUM>. The responses to the commands are transmitted to the client apparatus <NUM> in accordance with the control of the system control unit <NUM>. As described above, the system control unit <NUM> also functions as a communication control unit.

The wireless communication control unit <NUM> transmits and receives data, control commands, and the like in accordance with a wireless communication standard. Specifically, radio waves, which are data, control commands, and the like that have been modulated and demodulated, are transmitted and received via the antenna <NUM>. As the wireless communication standard, it is possible to use a wireless LAN (Wi-Fi®), Bluetooth®, ZigBee, Z-Wave, or the like.

The system control unit <NUM> is a functional unit for comprehensively controlling each unit of the network camera <NUM>. For example, the system control unit <NUM> analyzes a command that the communication unit <NUM> received from the client apparatus <NUM> via the network <NUM> and performs processing according to the command. For example, it may give the image processing unit <NUM> an instruction for adjusting image quality to or the lens control unit <NUM> an instruction for zooming or focus control. Further, although details will be described later, the system control unit <NUM> performs exchange of data, control commands, and the like with the wireless communication slave device <NUM> through the wireless communication control unit <NUM> and performs processing (slave device control), such as obtaining information from and setting the wireless communication slave device <NUM>.

The system control unit <NUM> may be provided inside the network camera <NUM> or may be configured independently of the network camera <NUM>. When the system control unit <NUM> is an apparatus external to the network camera <NUM>, configuration may be taken such that the system control unit <NUM> is capable of communicating with the network camera <NUM>.

The client apparatus <NUM> is an apparatus that receives operations from the user and controls the network camera <NUM>. The client apparatus <NUM> can be realized using a computer such as a personal computer.

A display unit <NUM> displays a graphical user interface (GUI) for performing control of the network camera <NUM>. Further, the display unit <NUM> displays images based on the image data received from the network camera <NUM>. The display unit <NUM> can be realized by a display device using a liquid crystal panel, an organic EL panel, or the like.

An input unit <NUM> is any device such as a keyboard or a mouse that accepts operations from the user. The user performs operations on the GUI via the input unit <NUM>. The input unit <NUM> may be realized using other devices such as a touch panel or a joystick.

The communication unit <NUM> communicates with the network camera <NUM> via the network <NUM>. For example, image data can be obtained from the network camera <NUM> by transmitting a command corresponding to an operation by the user to the network camera <NUM>.

A system control unit <NUM> is a functional unit for comprehensively controlling each unit of the client apparatus <NUM>. For example, the system control unit <NUM> generates a command in response to an operation by the user and transmits the command from the communication unit <NUM> to the network camera <NUM>. Further, the system control unit <NUM> also displays, on the display unit <NUM>, the image data from the network camera <NUM> received via the communication unit <NUM>. As described above, the system control unit <NUM> also functions as a communication control unit and a display control unit.

A wireless communication slave device <NUM> is, for example, a slave device having a sensor function and transmits the data obtained by the sensor to the network camera <NUM>, which operates as a master device. The wireless communication slave device <NUM> is driven by, for example, a battery; when the battery is mounted and the device is activated, the wireless communication slave device <NUM> performs the process of registering with the master device; and, when communication from the master device is not performed for a predefined period of communication timeout, the wireless communication slave device <NUM> enters a sleep state in which functions are limited.

The process of registering the wireless communication slave device <NUM> with the master device may be performed at times other than when the wireless communication slave device <NUM> is activated by the battery being mounted. For example, configuration may be taken such that a button is added to the wireless communication slave device <NUM> and the registration process is started at the press of the button. Furthermore, although a slave device has been described here as the wireless communication slave device <NUM> that performs wireless communication, it may be a slave device connected by cable.

<FIG> are diagrams illustrating a mechanical configuration of the network camera <NUM>. The network camera <NUM> is configured by a bottom case <NUM>, a turntable <NUM>, a camera head strut <NUM>, and a camera head <NUM>. <FIG> is a diagram of the network camera <NUM> mounted on a table seen from above, and <FIG> is a diagram of the network camera <NUM> seen from the side.

Referring to <FIG>, the operation of pan/tilt movable portions will be described with an axis in the vertical direction set as the vertical axis and an axis perpendicular to this defined as the horizontal axis. In <FIG>, a clockwise direction around the vertical axis perpendicular to the sheet surface is set as the positive direction of the pan angle. In addition, in <FIG>, a clockwise direction around the axis perpendicular to the sheet surface is set as the positive direction of the tilt angle.

In <FIG>, the pan driving unit <NUM> of <FIG> is configured by the bottom case <NUM> and the turntable <NUM>, and the turntable <NUM> is capable of being rotated around the vertical axis. Electrical circuits configured in a fixed portion of the bottom case <NUM> and a rotating portion of the turntable <NUM> are connected by a slip ring or the like. Therefore, the pan movable portion can be rotated freely (endlessly in an angular range of <NUM>°) with the vertical axis as the rotation axis.

In addition, in <FIG>, the tilt driving unit <NUM> of <FIG> is configured by the camera head strut <NUM> and the camera head <NUM>, and the camera head <NUM> is capable of being rotated around the horizontal axis. Here, the tilt movable portion can be rotated in an angular range of <NUM>° with the horizontal axis as the rotation axis.

As described above, the network camera of the present embodiment can capture images in a wide range by changing the image capturing direction by rotating the camera head in the pan direction and the tilt direction. The network camera <NUM> is not limited to the configuration illustrated in <FIG>. For example, for the pan direction, the drivable range may be limited (e.g., +<NUM>° to - <NUM>° or the like) instead of being capable of being driven <NUM>°. In addition, for the tilt direction, the driving range may be limited (e.g., <NUM>° to <NUM>° or the like) instead of being capable of being driven <NUM>°.

The operation of the system roughly includes an operation in which the network camera registers the information of the wireless communication slave device and an operation in which the network camera controls the wireless communication slave device based on the registered information. Description will be given in order below.

<FIG> is a diagram illustrating an example of registered information of wireless communication slave devices. It illustrates the information registered in the network camera <NUM> in the process of registering the wireless communication slave device <NUM> with the master device (network camera <NUM>) described above.

An information table <NUM> indicates a state in which information of N wireless communication slave devices is registered and held as a table. The information table <NUM>, for example, is managed by the system control unit <NUM> of the network camera <NUM>.

The information table <NUM> includes an ID <NUM>, a device name <NUM>, a device type <NUM>, and pan and tilt (PT) coordinates <NUM> for each wireless communication slave device. The PT coordinates <NUM> indicate the coordinates for defining the direction of the wireless communication slave device based on the coordinate system illustrated in <FIG> with respect to the position at which the network camera <NUM> is installed.

Specifically, when performing the process of registering a wireless communication slave device, which is a control target, with the network camera <NUM>, the network camera <NUM> is caused in advance to face toward the wireless communication slave device to be registered. That is, the wireless communication slave device to be registered is made to be approximately in the center of the image capturing range of the image capturing unit <NUM>. Then, the registration process is started, and the coordinates of the pan driving unit <NUM> and the tilt driving unit <NUM> of the network camera <NUM> are registered as the PT coordinates <NUM>. That is, the information on the relative direction of existence of the slave device with respect to the position of the network camera <NUM> (or the image capturing unit <NUM>) is registered.

<FIG> is a diagram illustrating an example of PT coordinates and a positional relationship with a wireless communication slave device. Here, a state in which a thermometer, which is a wireless communication slave device, is in a direction (at a position) for which the PT coordinates of the network camera <NUM> are (<NUM>, <NUM>) is illustrated.

First, before the process of registering the wireless communication slave device (thermometer) is performed (e.g., before mounting a battery to the thermometer), the network camera <NUM> is made to face toward the wireless communication slave device. Then, by mounting a battery to the thermometer, the process of registering the wireless communication slave device (thermometer) is performed, and the PT coordinates (<NUM>, <NUM>) of the network camera <NUM> at that time are registered. By this, as illustrated in <FIG>, the wireless communication slave device (thermometer) whose ID=<NUM> is registered in the information table <NUM>.

<FIG> is an operation flowchart of the network camera according to the first embodiment. The operation flow illustrated in <FIG> is executed when a pan, tilt, and zoom (PTZ) operation is performed for the network camera <NUM>. It may be executed every time a PTZ operation is stopped in the middle of a series of PTZ operations being performed. Further, it may be executed after a predetermined period has elapsed from when a PTZ operation is stopped (i.e., after a series of PTZ operations has been completed).

In step S801, the system control unit <NUM> confirms the pan/tilt (PT) coordinates of the four vertices of the image capturing range (angle of view for image capturing). This is calculated, for example, by the PT coordinates and the zoom (Z) value of the network camera <NUM> at that time.

<FIG> is a diagram illustrating an example of a captured image <NUM> captured by a network camera. The captured image <NUM> includes a wireless communication slave device <NUM>. However, at the time of step S801, the network camera <NUM> has not yet recognized that the captured image <NUM> includes the wireless communication slave device <NUM>. In step S801, the system control unit <NUM> confirms the PT coordinates (P2, T2), (P1, T2), (P2, T1), and (P1, T1) of the four vertices of the captured image <NUM>.

In step S802, the system control unit <NUM> performs the process of identifying the slave device that is in the image capturing range. In step S803, the system control unit <NUM> determines whether or not the process in step S802 has been performed for all the slave devices registered in the information table <NUM>. If the process in step S802 has been performed for all registered slave devices, the process proceeds to step S804, and if there still are slave devices for which the process in step S802 has not been performed, the process proceeds to step S802. That is, the process in step S802 is repeatedly performed until it is performed for all the slave devices registered in the information table <NUM>.

<FIG> is a detailed flowchart of the process of identifying a slave device (step S802). Description will be given below assuming that the process is performed for a slave device x (x is <NUM> to N).

In step S1001, the system control unit <NUM> obtains the PT coordinates (Px, Tx) of the slave device x from the information table <NUM>. That is, it reads the PT coordinates <NUM> corresponding to the slave device x from the information table <NUM>.

In step S1002, the system control unit <NUM> confirms whether or not Px is included in the pan range (i.e., between P1 and P2) confirmed in step S801. If Px is included between P1 and P2, the process proceeds to step S1003; if it is not included, the process proceeds to step S1005. In general, whether or not Px is included between P1 and P2 is confirmed by comparing Px with the respective values of P1 and P2. However, if the image capturing range is such that it straddles <NUM>°, such as an angle, determination is made taking that into account.

In step S1003, the system control unit <NUM> confirms whether or not Tx is included in the tilt range (i.e., between T1 and T2) confirmed in step S801. If Tx is included between T1 and T2, the process proceeds to step S1004; if it is not included, the process proceeds to step S1005. In general, whether or not Tx is included between T1 and T2 is confirmed by comparing Tx with the respective values of T1 and T2. However, if the image capturing range is such that it straddles <NUM>°, such as an angle, determination is made taking that into account.

In step S1004, the system control unit <NUM> determines that the slave device x is in the image capturing range. Meanwhile, in step S1005, the system control unit <NUM> determines that the slave device x is not in the image capturing range.

As described above, by comparing the PT coordinates of the slave device registered in advance in the information table <NUM> with the PT coordinates of the four vertices of the image capturing range, it is identified whether or not the slave device exists in the current image capturing range.

In step S804, the system control unit <NUM> transmits a recovery request to the slave device that has been determined to be in the image capturing range in step S802. For example, the system control unit <NUM> generates a recovery request and transmits it via the wireless communication control unit <NUM> and the antenna <NUM>. As an additional process in step S804, among the slave devices that have been determined to be outside the image capturing range in step S802, a request for transitioning to sleep may be transmitted to the slave devices that are not in the sleep state.

In step S805, the system control unit <NUM> determines whether or not it is necessary to obtain value information from the slave device to which the recovery request has been transmitted in step S804. For example, if the slave device is a thermometer, since the device is mainly for obtaining temperature information, it is determined that it is necessary to obtain a value. Meanwhile, when the device is mainly for taking action, such as a door lock, it is determined that it is not necessary to obtain a value. When it is necessary to obtain value information, the process proceeds to step S806, and when it is not necessary to obtain value information, the process proceeds to step S807.

In step S806, the system control unit <NUM> transmits a request for obtaining value information to the slave device. For example, the system control unit <NUM> generates a request for obtaining value information and transmits it via the wireless communication control unit <NUM> and the antenna <NUM>.

In step S807, the system control unit <NUM> controls to display slave device information in the camera image. For example, an image in which the information stored in the information table <NUM> is displayed such that the information is superimposed on the position of the slave device in the camera image is generated and outputted to the client apparatus <NUM>. In addition, the information (e.g., the temperature value) obtained by the slave device responding to the request for obtaining value information transmitted in step S806 may be displayed superimposed on the position of the slave device in the camera image.

<FIG> is a diagram illustrating an example of displaying slave device information in a camera image. The camera image is generated by the network camera <NUM>, is outputted to the client apparatus <NUM>, and then is displayed on the display unit <NUM>.

In the camera image illustrated in <FIG>, an information display <NUM> is displayed superimposed on the captured image <NUM> illustrated in <FIG>. Here, since the slave device <NUM> is a thermometer, the information display <NUM> is a temperature value. In the above description, it is assumed that, in step S807, the network camera <NUM> generates a camera image in which the slave device information is displayed superimposed. However, configuration may be such that the slave device information is distributed as metadata of the camera image and an image in which the slave device information is displayed superimposed is generated in the client apparatus <NUM>. Further, as the information display <NUM>, another information (e.g., remaining battery power) of the slave device may be displayed. Further, for a device that mainly takes action, such as a door lock, the state of the door lock or the like may be displayed as the information display <NUM>.

As described above, according to the first embodiment, the network camera <NUM> can identify the slave device included in the captured image by using the pan and tilt (PT) coordinates of the slave device that has been registered in advance. This makes it possible to display the information on the slave device superimposed on the captured image. Furthermore, it is possible to selectively recover (deactivate sleep for) the slave device included in the captured image as well as additionally display information obtained from the slave device as the information of the slave device.

In the above description, the network camera has been given as an example, but the present invention can also be applied to cameras for other purposes. For example, the present invention can also be applied to an image capturing apparatus for capturing images or movies for broadcasting purposes or images for personal purposes.

In a second embodiment, description will be given for an embodiment for identifying a slave device that exists in a captured image using information on the direction of an image capturing unit (lens) of an image capturing apparatus. That is, information on the direction of the image capturing unit is used instead of the pan and tilt (PT) coordinates in the first embodiment described above. Thus, for example, even when the image capturing apparatus does not have a configuration for pan and tilt control or cannot obtain the pan and tilt coordinates, it is possible to identify the slave device in the captured image.

<FIG> is a diagram illustrating an overall configuration of the system in the second embodiment. Similarly to the first embodiment, the system includes the network camera <NUM> and the client apparatus <NUM> that are connected to be capable of communication by the network <NUM>. The system also includes a wireless communication slave device <NUM> that can be connected with the network camera <NUM> by wireless communication.

In the second embodiment, the network camera <NUM> differs from the first embodiment in that it further includes a sensor input unit <NUM>. The sensor input unit <NUM> obtains the position and orientation of the network camera <NUM> from a sensor device, such as an encoder for detecting a change in a mechanical position or an electronic compass for obtaining position and orientation by detecting magnetism. The sensor device may be integrated in the camera or external and capable of connecting to an external interface such as a USB. Description will be omitted for other components since they are the same as the first embodiment.

The operation of the system roughly includes an operation in which the network camera registers the information of the wireless communication slave device and an operation in which the network camera controls the wireless communication slave device based on the registered information. Description will be given in order below. Description will be given for portions that are different from the first embodiment, and description will be omitted for portions that are the same as the first embodiment.

<FIG> is a diagram illustrating an example of registered information of wireless communication slave devices. An information table <NUM> indicates a state in which information of N wireless communication slave devices is registered and held as a table. The information table <NUM>, for example, is managed by the system control unit <NUM> of the network camera <NUM>.

The information table <NUM> includes an ID <NUM>, a device name <NUM>, a device type <NUM>, and direction and inclination values <NUM> for each wireless communication slave device. The direction and inclination values <NUM> indicate values defining the direction of the slave device with respect to the position of the network camera <NUM>. The direction and inclination values <NUM> are values corresponding to the "direction in which the image capturing unit (lens) is facing" calculated based on the position and orientation of the network camera <NUM> obtained from the sensor input unit <NUM>.

Specifically, when performing the process of registering a wireless communication slave device with the network camera <NUM>, the network camera <NUM> is made in advance to face toward the wireless communication slave device. That is, the wireless communication slave device is made to be in the center of the image capturing range of the image capturing unit <NUM>. Then, the registration process is started, and the "direction in which the image capturing unit (lens)" of the network camera <NUM> "is facing" is registered as the direction and inclination values <NUM>. Here, it is assumed that the direction and inclination values <NUM> are the "direction in which the image capturing unit (lens) is facing" calculated based on the position and orientation of the network camera <NUM> obtained from the sensor input unit <NUM>. However, a method of storing values obtained from the sensor input unit <NUM> as is may be used. In that case, in step S1301 to be described later, "the direction in which the image capturing unit (lens) is facing" is calculated.

<FIG> is an operation flowchart of the network camera according to the second embodiment. The operation flow illustrated in <FIG> is executed when the position and orientation or zoom of the network camera <NUM> is changed (a PTZ operation is performed). It may be executed every time a PTZ operation is stopped in the middle of a series of PTZ operations being performed. Further, it may be executed after a predetermined period has elapsed from when a PTZ operation is stopped (i.e., after a series of PTZ operations has been completed). Steps S1301 and S1302 differ from the first embodiment (<FIG>). Description will be omitted for steps S803 to S807 since they are the same as the first embodiment.

In step S1301, the system control unit <NUM> calculates the direction and inclination of the four vertices of the image capturing range (angle of view for image capturing). This is, for example, calculated by calculating the direction and inclination values, which are the "direction in which the image capturing unit (lens) is facing", from the value of the sensor input unit <NUM> at that time, taking the information on the horizontal angle of view and the vertical angle of view, which are calculated from a zoom setting value, into account.

<FIG> is a diagram illustrating an example of a captured image <NUM> captured by a network camera. The captured image <NUM> includes a wireless communication slave device <NUM>. However, at the time of step S1301, the network camera <NUM> has not yet recognized that the captured image <NUM> includes the wireless communication slave device <NUM>. In step S1301, the system control unit <NUM> confirms the direction values and the inclination values, (D2, S2), (D1, S2), (D2, S1), and (D1, S1), of the four vertices of the captured image <NUM>.

For example, D1, D2, S1, and S2 are calculated by the following equation using the direction value Dc and the inclination value Sc of the lens corresponding to approximately the center <NUM> of the image capturing range. <MAT> <MAT> <MAT> <MAT>.

In step S1302, the system control unit <NUM> performs the process of identifying a slave device that is in the image capturing range. In step S803, the system control unit <NUM> determines whether or not the process in step S1302 has been performed for all the slave devices registered in the information table <NUM>. If the process in step S1302 has been performed for all registered slave devices, the process proceeds to step S804, and if there still are slave devices for which the process in step S1302 has not been performed, the process proceeds to step S1302. That is, the process in step S1302 is repeatedly performed until it is performed for all the slave devices registered in the information table <NUM>.

<FIG> is a detailed flowchart of the process of identifying a slave device (step S1302). Description will be given below assuming that the process is performed for a slave device x (x is <NUM> to N).

In step S1401, the system control unit <NUM> obtains the direction and inclination values (Dx, Sx) of the slave device x from the information table <NUM>. That is, it reads the direction and inclination values <NUM> corresponding to the slave device x from the information table <NUM>.

In step S1402, the system control unit <NUM> confirms whether or not Dx is included in the range of direction values (i.e., between D1 and D2) confirmed in step S1301. If Dx is included between D1 and D2, the process proceeds to step S1403; if it is not included, the process proceeds to step S1405.

In step S1403, the system control unit <NUM> confirms whether or not Sx is included in the range of inclination values (i.e., between S1 and S2) confirmed in step S1301. If Sx is included between S1 and S2, the process proceeds to step S1404; if it is not included, the process proceeds to step S1405.

In step S <NUM>, the system control unit <NUM> determines that the slave device x is in the image capturing range. Meanwhile, in step S1405, the system control unit <NUM> determines that the slave device x is not in the image capturing range.

As described above, by comparing the direction and inclination values of the slave device registered in advance in the information table <NUM> with the direction and inclination values of the four vertices of the image capturing range, it is identified whether or not the slave device exists in the current image capturing range.

As described above, according to the second embodiment, the network camera <NUM> can identify the slave device included in the captured image by using the direction and inclination values of the slave device that has been registered in advance. This makes it possible to display the information on the slave device superimposed on the captured image. Furthermore, it is possible to selectively deactivate sleep for the slave device included in the captured image as well as additionally display information obtained from the slave device as the information of the slave device.

Claim 1:
A control apparatus (<NUM>) configured to operate as a master device for controlling a slave device (<NUM>), comprising:
image capturing means (<NUM>);
registration means (<NUM>, <NUM>) configured to register slave device information of a slave device to be controlled by the control apparatus;
identification means (<NUM>) configured to, based on the slave device information registered by the registration means, identify a slave device that exists in a range of image capturing by the image capturing means; and
a slave device control means (<NUM>) configured to perform control of a slave device that has been identified by the identification means,
characterized in that
the registration means (<NUM>, <NUM>) is configured to, after a slave device to be registered is caused to be approximately in the center of the range of image capturing by the image capturing means (<NUM>), execute a registration process and register, as the slave device information, information on a relative direction and inclination (<NUM>, <NUM>) of the slave device with respect to a position of the image capturing means (<NUM>) at the time of execution of the registration process, and
the identification means (<NUM>, <NUM>) is configured to identify the slave device by comparing the registered information on the relative direction and inclination (<NUM>, <NUM>) of the slave device with respect to the position of the image capturing means (<NUM>) with information on a relative direction of the four vertices of the range of image capturing by the image capturing means (<NUM>).