Imaging control terminal, imaging system, imaging method, and program device

An imaging control terminal includes a wireless communication interface configured to wirelessly communicate with an imaging terminal, an imaging module configured to generate imaging data, a display interface configured to display an image corresponding to the imaging data generated by the imaging module, an operation interface configured to receive an operation of an operator designating an imaging area or an imaging target to be imaged by the imaging terminal for the image, an information generation unit configured to generate imaging area information representing the imaging area or imaging target information representing the imaging target, and a communication control unit configured to cause the wireless communication interface to wirelessly transmit the imaging area information or the imaging target information to the imaging terminal.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to technology for remotely controlling an imaging terminal.

Priority is claimed on Japanese Patent Application No. 2013-108222, filed May 22, 2013, the content of which is incorporated herein by reference.

Description of the Related Art

There is an imaging system which includes an imaging terminal (digital camera or the like) having a wireless connection function and an imaging control terminal (portable terminal or the like) and in which the imaging control terminal wirelessly remotely operates the imaging terminal to control an imaging operation of the imaging terminal. For example, an example of a portable terminal which wirelessly remotely operates a digital camera is disclosed in Japanese Unexamined Patent Application, First Publication No. 2012-186698. Specifically, imaging data is transmitted from the digital camera to the portable terminal after the portable terminal has been wirelessly connected to the digital camera and an image captured by the digital camera is displayed on a display unit of the portable terminal receiving the imaging data. In addition, if a user performs a zoom operation on a display screen of the portable terminal when the image captured by the digital camera is displayed on the display unit of the portable terminal, the zoom setting of the digital camera is changed.

SUMMARY

According to an aspect of the present invention, an imaging control terminal includes: a wireless communication interface configured to wirelessly communicate with an imaging terminal; an imaging module configured to generate imaging data; a display interface configured to display an image corresponding to the imaging data generated by the imaging module; an operation interface configured to receive an operation of an operator designating an imaging area or an imaging target to be imaged by the imaging terminal for the image; an information generation unit configured to generate imaging area information representing the imaging area or imaging target information representing the imaging target; and a communication control unit configured to cause the wireless communication interface to wirelessly transmit the imaging area information or the imaging target information to the imaging terminal.

In addition, according to an aspect of the present invention, an imaging terminal includes: a wireless communication interface configured to wirelessly communicate with an imaging control terminal; an imaging module configured to generate imaging data; a communication control unit configured to cause the wireless communication interface to wirelessly receive imaging area information representing an imaging area or imaging target information representing an imaging target wirelessly transmitted from the imaging control terminal; an imaging control unit configured to cause the imaging module to generate the imaging data after the imaging area information or the imaging target information has been wirelessly received; and an image processing unit configured to extract data corresponding to an image including the imaging area or the imaging target from the imaging data generated by the imaging module.

In addition, according to an aspect of the present invention, an imaging system includes: an imaging control terminal and an imaging terminal, wherein the imaging control terminal includes: a first wireless communication interface configured to wirelessly communicate with the imaging terminal, a first imaging module configured to generate imaging data; a display interface configured to display an image corresponding to the imaging data generated by the first imaging module; an operation interface configured to receive an operation of an operator designating an imaging area or an imaging target to be imaged by the imaging terminal for the image; an information generation unit configured to generate imaging area information representing the imaging area or imaging target information representing the imaging target; and a first communication control unit configured to cause the first wireless communication interface to wirelessly transmit the imaging area information or the imaging target information to the imaging terminal, and wherein the imaging terminal includes: a second wireless communication interface configured to wirelessly communicate with the imaging control terminal; a second imaging module configured to generate imaging data; a second communication control unit configured to cause the second wireless communication interface to wirelessly receive the imaging area information or the imaging target information wirelessly transmitted from the imaging control terminal; an imaging control unit configured to cause the second imaging module to generate imaging data after the imaging area information or the imaging target information has been wirelessly received; and an image processing unit configured to extract data corresponding to an image including the imaging area or the imaging target from the imaging data generated by the second imaging module.

In addition, according to an aspect of the present invention, an imaging method includes the steps of: displaying, by a display interface of an imaging control terminal, an image corresponding to imaging data generated by a first imaging module of the imaging control terminal; generating, by an information generation unit of the imaging control terminal, imaging area information representing an imaging area or imaging target information representing an imaging target when an operation interface of the imaging control terminal has received an operation of an operator designating the imaging area or the imaging target to be imaged by an imaging terminal for the image; wirelessly transmitting, by a first wireless communication interface of the imaging control terminal, the imaging area information or the imaging target information to the imaging terminal; wirelessly receiving, by a second wireless communication interface of the imaging terminal, the imaging area information or the imaging target information wirelessly transmitted from the imaging control terminal; generating, by a second imaging module of the imaging terminal, imaging data after the imaging area information or the imaging target information has been wirelessly received; and extracting, by an image processing unit of the imaging terminal, data corresponding to an image including the imaging area or the imaging target from the imaging data generated by the second imaging module.

In addition, according to an aspect of the present invention, a program device saves a program for causing a computer to execute the steps of causing a display interface to display an image corresponding to imaging data generated by an imaging module; generating imaging area information representing an imaging area or imaging target information representing an imaging target when an operation interface has received an operation of an operator designating the imaging area or the imaging target to be imaged by an imaging terminal for the image; and causing a wireless communication interface to wirelessly transmit the imaging area information or the imaging target information to the imaging terminal.

In addition, according to an aspect of the present invention, a program device saves a program for causing a computer to execute the steps of causing a wireless communication interface to wirelessly receive imaging area information representing an imaging area or imaging target information representing an imaging target wirelessly transmitted from an imaging control terminal; causing an imaging module to generate imaging data after the imaging area information or the imaging target information has been wirelessly received, and causing an image processing unit to extract data corresponding to an image including the imaging area or the imaging target from the imaging data generated by the imaging module.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

First, the first embodiment of the present invention will be described. In this embodiment, an example in which the present invention is applied to an imaging system including a digital camera (imaging terminal) configured to wirelessly transmit imaging data after imaging to a portable terminal and a portable terminal (imaging control terminal) configured to receive the imaging data transmitted from the digital camera and control an imaging operation of the digital camera will be described.

FIGS. 1A and 1Bare block diagrams illustrating a configuration of a portable terminal1according to this embodimentFIGS. 2A and 2Bare block diagrams illustrating a configuration of a digital camera2according to this embodiment. First, the configurations of the portable terminal1and the digital camera2and an outline of an operation of the imaging system will be described usingFIGS. 1A and 1BandFIGS. 2A and 2B

The imaging system of this embodiment includes the portable terminal1and the digital camera2, and the portable terminal1and the digital camera2are connected by wireless communication. The digital camera2wirelessly transmits captured image (still image) data generated by imaging to the portable terminal1and the portable terminal1wirelessly controls the imaging operation of the digital camera2.

As illustrated inFIG. 1A, the portable terminal1includes a portable imaging unit3, an image processing unit4, a display unit5, a wireless communication unit6, a portable control unit7, an operation detection unit8, and a data bus9. The portable imaging unit3is an imaging module (imaging device) which performs an imaging operation to generate imaging data. The image processing unit4is a circuit which performs image processing on the imaging data from the portable imaging unit3. The display unit5is a display interface (display device) which displays an image corresponding to the imaging data generated by the portable imaging unit3and an operation item. The wireless communication unit6is a wireless communication interface (wireless communication device) which wirelessly communicates with the digital camera2. The portable control unit7controls the overall portable terminal1. The operation detection unit8is an operation interface (operation device) which receives an operation performed by an operator and detects an instruction based on the operation. In the operation performed by the operator, an operation of designating an imaging area or an imaging target to be imaged by the digital camera2for an image to be displayed by the display unit5is included. The data bus9is a transmission path of various types of data such as imaging data.

In this embodiment, an example in which a flat panel display is used as the display unit5and a touch panel disposed on the flat panel display is used as the operation detection unit8will be described.

FIG. 1Billustrates a functional configuration of the portable control unit7. The portable control unit7implements at least functions of an information generation unit7aand a communication control unit7b. The information generation unit7agenerates imaging area information representing the imaging area based on an instruction detected by the operation detection unit8or imaging target information representing the imaging target based on the instruction detected by the operation detection unit8. The communication control unit7bcauses the wireless communication unit6to wirelessly transmit the imaging area information or the imaging target information to the digital camera2. In addition, the communication control unit7bcauses the wireless communication unit6to wirelessly transmit imaging execution instruction information for issuing an instruction to execute imaging to the digital camera2and wirelessly receive imaging data wirelessly transmitted from the digital camera2.

The portable control unit7stores a program for controlling the operation of the portable control unit7or necessary data. For example, the portable control unit7, which is a computer of the portable terminal1, reads and executes the program for controlling the operation of the portable control unit7and therefore the functions of the information generation unit7aand the communication control unit7bare implemented as software functions. In addition, this program, for example, may be provided by a “computer-readable recording medium” such as a flash memory. In addition, the above-described program may be input to the portable terminal1by transmitting the program from a computer storing the program in a storage device or the like to the portable terminal1via a transmission medium or transmission waves of the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information like a network (communication network) such as the Internet or a communication circuit (communication line) such as a telephone circuit. In addition, the above-described program may be used to implement some of the above-described functions. Further, the program may be a so-called differential file (differential program) capable of implementing the above-described functions in combination with a program already recorded on the computer.

A terminal including the portable imaging unit3, the display unit5, the wireless communication unit6, the operation detection unit8, and the portable control unit7as a minimum configuration corresponds to one aspect of the imaging control terminal of the present invention. For example, the portable imaging unit3corresponds to an imaging module in the imaging control terminal of the present invention, the display unit5corresponds to a display interface in the imaging control terminal of the present invention, the wireless communication unit6corresponds to a wireless communication interface in the imaging control terminal of the present invention, the operation detection unit8corresponds to an operation interface in the imaging control terminal of the present invention, and the portable control unit7corresponds to an information generation unit and a communication control unit in the imaging control terminal of the present invention.

As illustrated inFIG. 2A, the digital camera2includes a camera imaging unit10, an image processing unit11, a wireless communication unit12, a camera control unit13, and a data bus14. The camera imaging unit10is an imaging module (imaging device) which performs an imaging operation to generate imaging data. The image processing unit11is a circuit which performs image processing on the imaging data from the camera imaging unit10, and extracts data corresponding to an image including an imaging area or an imaging target from the imaging data generated by the camera imaging unit10. The wireless communication unit12is a wireless communication interface (wireless communication device) which wirelessly communicates with the portable terminal1. The camera control unit13controls the overall digital camera2. The data bus14is a transmission path of various types of data such as imaging data.

FIG. 2Billustrates a functional configuration of the camera control unit13. The camera control unit13implements at least functions of a communication control unit13aand an imaging control unit13b. The communication control unit13acauses the wireless communication unit12to wirelessly receive the imaging area information or the imaging target information wirelessly transmitted from the portable terminal1. In addition, the communication control unit13acauses the wireless communication unit12to wirelessly receive the imaging execution instruction information wirelessly transmitted from the portable terminal1and wirelessly transmit the imaging data generated by the camera imaging unit10to the portable terminal1. The imaging control unit13bcauses the camera imaging unit10to execute imaging and generate imaging data after the imaging area information or the imaging target information has been wirelessly received.

The camera control unit13stores a program for controlling the operation of the camera control unit13or necessary data. For example, the camera control unit13, which is a computer of the digital camera2, reads and executes the program for controlling the operation of the camera control unit13and therefore the functions of the communication control unit13aand the imaging control unit13bare implemented as software functions. An implementation form of this program is similar to an implementation form of a program which implements the functions of the information generation unit7aand the communication control unit7bof the portable terminal1. The camera control unit13may have a function of the image processing unit11

A terminal including the camera imaging unit10, the image processing unit11, the wireless communication unit12, and the camera control unit13as a minimum configuration corresponds to one aspect of the portable terminal of the present invention. For example, the camera imaging unit10corresponds to the imaging module in the imaging terminal of the present invention, the image processing unit11corresponds to the image processing unit in the imaging terminal of the present invention, the wireless communication unit12corresponds to the wireless communication interface in the imaging terminal of the present invention, and the camera control unit13corresponds to the communication control unit and the imaging control unit in the imaging terminal of the present invention.

The portable terminal1displays an image corresponding to imaging data from the portable imaging unit3on the display unit5. Thereafter, the portable terminal1detects an instruction of the operator for the displayed image using the operation detection unit8and generates imaging area information or imaging target information according to content of the detected instruction. The portable terminal1wirelessly transmits the generated imaging area information or imaging target information to the digital camera2via the wireless communication unit6.

After the transmission of the imaging area information or imaging target information, the portable terminal1transmits imaging execution instruction information to the digital camera2according to an imaging start instruction of the operator. The imaging area information or imaging target information is generated by combining composition data (data representing composition of a captured image) obtained by processing imaging data from the portable imaging unit3in the image processing unit4and content indicated by the operator.

The digital camera2receives the imaging area information or imaging target information from the portable terminal1via the wireless communication unit12, and determines an imaging range of the imaging data to be transmitted to the portable terminal1using the imaging area information or imaging target information and the composition data obtained by processing the imaging data from the camera imaging unit10in the image processing unit11. Upon receiving the imaging execution instruction information from the portable terminal1, the digital camera2transmits the imaging data corresponding to an image of a range designated in the imaging range to the portable terminal1via the wireless communication unit12after an imaging process has been performed.

The generation of the imaging area information or imaging target information by the portable terminal1and the imaging process by the digital camera2using the imaging area information or imaging target information will be described in detail.FIG. 3illustrates an operation situation of the imaging system according to this embodiment. InFIG. 3, in a state in which the portable terminal1and the digital camera2are wirelessly connected, the two devices perform imaging toward a person15and a person16.FIG. 4is an example of an image displayed by the portable terminal1on the display unit5in the state illustrated inFIG. 3.

The imaging data from the portable imaging unit3is given to the display unit5via the data bus9, and the image illustrated inFIG. 4is displayed. Buttons (a range button17, a target button18, and a shutter button19) are displayed on a left end of the image. Theses buttons are buttons corresponding to operation items to be selected by the operator. When the operator touches and selects the button, the selected button is displayed with emphasis.

Hereinafter, an image displayed on the portable terminal1and an image transmitted by the digital camera2to the portable terminal1will be described for each of the case in which the imaging range (imaging area) is designated and the case in which the imaging target is designated.FIG. 4illustrates an example of the image displayed on the display unit5of the portable terminal1when the imaging range is designated. InFIG. 4, the range button17is selected and the designation (range designation) of the imaging range is performed. The portable imaging unit3, the display unit5, the portable control unit7, and the operation detection unit8cooperatively perform an operation related to the designation of the imaging range.

Specifically, the imaging data from the portable imaging unit3is transmitted to the display unit5and the display unit5displays an image. In parallel with the display of the image, the portable control unit7analyzes operation content of the operator detected by the operation detection unit8and the portable control unit7issues an instruction for causing the display unit5to display a button according to the operation content. As a result, the image and the button are displayed on the display unit5

When the operator has selected the range button17, the range button17is displayed with emphasis as illustrated inFIG. 4. Thereafter, the portable control unit7detects a position of the imaging range40designated by the operator via the operation detection unit8. The designation of the imaging range is performed by selecting two points of a display screen to designate a region. In the case ofFIG. 4, the imaging range is designated by designating two points A and B.

In the case ofFIG. 4, an imaging range40is designated to include the persons15and16.

When the designation of the imaging range40ends, imaging area information is generated. The imaging area information is information to be used in a process in which the digital camera2determines a range of an image to be transmitted to the portable terminal1. It is only necessary for the imaging area information to be information for enabling the imaging range indicated by the portable terminal1to be detected from the imaging data output by the camera imaging unit10.

When an imaging range40has been designated, the imaging area information including composition data representing composition of an image captured by the portable terminal1and position data representing a position of the imaging range40designated by the operator is generated so that the digital camera2can recognize the imaging range40.

FIG. 5illustrates an image to be transmitted by the digital camera2to the portable terminal1when the imaging range40has been designated. As illustrated inFIG. 5, the image to be transmitted by the digital camera2to the portable terminal1is an image corresponding to the imaging range40including the persons15and16. When the shutter button19is selected in the portable terminal1, imaging execution instruction information is transmitted from the portable terminal1to the digital camera2. When the digital camera2receives the imaging execution instruction information, the image of the range designated in the imaging range40is transmitted after an imaging process is performed.

FIG. 6illustrates an example of an image displayed on the display unit5of the portable terminal1when the imaging target is designated. In this embodiment, an example in which the person16has been selected after the target button18has been selected will be described.

When the designation of the person16ends, imaging target information is generated. Like the imaging area information, the imaging target information is information to be used in a process in which the digital camera2determines a range of an image to be transmitted to the portable terminal1. It is only necessary for the imaging target information to be information for enabling an imaging target indicated by the portable terminal1to be detected from imaging data output by the camera imaging unit10.

When the person16has been designated, imaging target information including composition data representing composition of an image captured by the portable terminal1and target data representing the person16in the composition data is generated so that the digital camera2can recognize the person16.

When the person16is designated as the imaging target in the image displayed by the portable terminal1, the person16is displayed with emphasis as illustrated inFIG. 6.FIG. 7illustrates an image to be transmitted by the digital camera2to the portable terminal1when the person16has been selected. As illustrated inFIG. 7, an image obtained by extracting only the person16is transmitted from the digital camera2.

Next, a generation method and a usage method of the imaging area information and the imaging target information will be described. When the digital camera2receives the imaging area information or the imaging target information, the image processing unit11compares composition data included in the imaging area information or the imaging target information to composition data generated from the imaging data from the camera imaging unit10. From a comparison result, the image processing unit11obtains a correspondence relationship between each position in an image used by the portable terminal1for generation of the imaging area information or the imaging target information and each position in an image captured by the digital camera2. Thereby, it can be seen which part of a range in which the camera imaging unit10of the digital camera2performs imaging corresponds to a range in which the portable imaging unit3of the portable terminal1performs imaging.

Thereafter, the image processing unit11specifies (determines) a range of an image to be transmitted to the portable terminal1using position data included in the imaging area information or target data included in the imaging target information. Thereafter, the image processing unit11extracts data of a part corresponding to a specified range from the imaging data generated by the camera imaging unit10, and generates transmission data to be transmitted to the portable terminal1. Hereinafter, details of a process of specifying the range of the image to be transmitted to the portable terminal1will be described.

It is only necessary for the above-described composition data to be information for enabling a process in which the digital camera2recognizes composition of an image during imaging and specifying a part of the recognized composition to be set in a region of an image to be transmitted to the portable terminal1. Content of the composition data is considered diversely according to an algorithm for recognizing the composition.

As the algorithm for recognizing the composition, various conventional algorithms have been devised. For example, a method of recognizing composition of image data using a luminance distribution of the image data and a method of recognizing composition by extracting a contour line of an image and detecting a pattern of the contour line have been devised. The present invention is not limited by the algorithm for recognizing the composition. In this embodiment, an algorithm of extracting a contour line of an image and recognizing composition using a pattern of the extracted contour line will be described as an example.

As described above, the composition data is generated by the image processing unit4processing imaging data from the portable imaging unit3in the portable terminal1. The contour line used in recognition of the composition, for example, is obtained by performing differential processing on imaging data. The composition data includes contour line information obtained as binary data. A range of the composition data to be used in this embodiment, for example, is an overall range of an image captured by the portable terminal1. In addition, target data to be used when the imaging target has been selected is template data obtained by extracting only the contour line of the imaging target.

The image processing unit11extracts the contour line by processing the imaging data from the camera imaging unit10and performs a matching (pattern matching) process on the extracted contour line and a contour line represented by composition data of the imaging area information or the imaging target information wirelessly received from the portable terminal1. According to this matching process, an imaging range corresponding to an overall imaging range of the portable imaging unit3is detected in imaging data from the camera imaging unit10. Various processes have been devised as the matching process and their details will not be described here.

Contour line information constituting composition data among the imaging area information and the imaging target information in this embodiment includes information of an overall imaging range of the portable imaging unit3. Thus, it is possible to specify the imaging range corresponding to the overall imaging range of the portable imaging unit3in the imaging data from the camera imaging unit10by performing the matching process using this contour line information and the contour line information obtained by processing the imaging data from the camera imaging unit10.

When position data of the imaging area information is used as described usingFIG. 4, the image processing unit11converts the imaging range represented by the position data (the imaging range designated by the operator) into a range of the imaging data from the camera imaging unit10using the information of the imaging range specified by the above-described method. The image processing unit11determines this range as a range of an image to be transmitted to the portable terminal1.

In addition, when target data of the imaging target information is used as described usingFIG. 6, the image processing unit11performs the matching process on the contour line information within the imaging range specified by the above-described method and the template data which is the target data. Thereby, it is possible to specify the position of the imaging target represented by the target data in the imaging data from the camera imaging unit10. After the position of the imaging target has been specified, the image processing unit11determines a predetermined range including the position of the imaging target as the range of the image to be transmitted to the portable terminal1. The predetermined range is a range in which the imaging target (the person16in the example ofFIG. 7) is designated as the center, and, for example, is a range including the range of the target data and 16 pixels around the target data.

Next, operations of the respective devices in this embodiment will be described usingFIGS. 8 to 10.FIG. 8illustrates the operation of the portable terminal1. The portable control unit7of the portable terminal1performs the operation illustrated inFIG. 8by controlling each related unit.FIGS. 9 and 10illustrate the operations of the digital camera2. The camera control unit13of the digital camera2performs the operations illustrated inFIGS. 9 and 10by controlling each related unit.

First, the operation of the portable terminal1will be described usingFIG. 8. When an application of camera processing is executed in the portable terminal1, the portable control unit7executes the camera processing S1. In the camera processing S1, the portable control unit7initially executes initial setting S2for setting an initial value in each unit of the portable terminal1.

After the initial setting S2, the portable control unit7controls the wireless communication unit6to execute a camera connection S3in which a wireless connection with the digital camera2is performed. After the camera connection S3, the portable control unit7controls the display unit5to execute a portable imaging image display process S4of displaying an image as illustrated inFIG. 4on the display unit5based on the imaging data generated by the portable imaging unit3.

After the portable imaging image display process S4, the portable control unit7executes an information generation process S5of generating the imaging area information or the imaging target information in the above-described method. After the information generation process S5, the portable control unit7controls the wireless communication unit6to execute an information transmission process S6of wirelessly transmitting the imaging area information or the imaging target information to the digital camera2.

After the information transmission process S6, the portable control unit7controls the wireless communication unit6based on the instruction of imaging execution of the operator to execute an imaging execution instruction process S7of transmitting imaging execution instruction information for issuing an instruction to execute imaging to the digital camera2. After the imaging execution instruction process S7, the portable control unit7controls the wireless communication unit6to execute an imaging data reception process S8of wirelessly receiving imaging data wirelessly transmitted from the digital camera2after the digital camera2has executed imaging.

After the imaging data reception process S8, the portable control unit7controls the display unit5to execute a received image display process S9of displaying an image based on imaging data wirelessly received from the digital camera2on the display unit5. After the received image display process S9, the portable control unit7executes a determination process S10of determining whether to end imaging based on a result of detecting the instruction from the operator as to whether to continue or end the imaging in the operation detection unit8.

The portable control unit7executes imaging continuation S11when the imaging continues, and executes a camera disconnection S12when the imaging ends. In either of the imaging continuation S11and the camera disconnection S12, the portable control unit7controls the wireless communication unit6to wirelessly transmit information including instruction content of the operator to the digital camera2.

After the imaging continuation S11, the portable control unit7continues the process by returning to the portable imaging image display process S4. On the other hand, after the camera disconnection S12, the portable control unit7ends the camera processing after disconnecting the wireless communication with the digital camera2(S13).

Next, the operation of the digital camera2will be described usingFIGS. 9 and 10. When the digital camera2is activated, the camera control unit13executes an overall process S21. In the overall process S21, the camera control unit13initially executes initial setting S22in which an initial value is set in each unit of the digital camera2.

After the initial setting S22, the camera control unit13controls the wireless communication unit12to execute a portable connection S23in which a connection with the portable terminal1is performed. The portable connection S23is a process corresponding to the camera connection S3to be performed by the portable terminal1.

After the portable connection S23, the camera control unit13controls the wireless communication unit12to execute an information reception process S24of wirelessly receiving the imaging area information or the imaging target information wirelessly transmitted from the portable terminal1. The information reception process S24is a process corresponding to the information transmission process S6performed by the portable terminal1. After the information reception process S24, the camera control unit13executes an imaging process1(S25) using the received imaging area information or imaging target information

Hereinafter, the imaging process1(S25) to be performed in this embodiment will be described usingFIG. 10,FIG. 10illustrates details of the imaging process1(S25). In the imaging process1(S25) illustrated inFIG. 10, the camera control unit13initially controls the wireless communication unit12to execute execution instruction waiting S41in which it waits for the imaging execution instruction information wirelessly transmitted from the portable terminal1to be received. When the portable terminal1performs the imaging execution instruction process S7, the wireless communication unit12receives the imaging execution instruction information and therefore the camera control unit13ends the execution instruction waiting S41and executes an imaging execution process S42. In the imaging execution process S42, the camera control unit13controls the camera imaging unit10to execute an imaging process.

After the imaging execution process S42, the camera control unit13executes a transmission data generation process S43of generating transmission data to be transmitted from the digital camera2to the portable terminal1according to the imaging area information or the imaging target information. In the transmission data generation process S43, the image processing unit11generates transmission data corresponding to the imaging area information or the imaging target information by receiving an instruction from the camera control unit13. After the transmission data generation process S43, the camera control unit13executes a process by returning to the overall process S21(S44).

When the imaging process1(S25) ends, the camera control unit13controls the wireless communication unit12to execute an imaging data transmission process S26of wirelessly transmitting transmission data generated in the imaging process1(S25) to the portable terminal1. In correspondence with the imaging data transmission process S26, the imaging data reception process S8is executed by the portable terminal1.

After the imaging data transmission process S26, the camera control unit13controls the wireless communication unit12to execute an instruction content reception process S27. The instruction content reception process S27is a process corresponding to the imaging continuation S11and the camera disconnection S12to be performed by the portable terminal1, and is a process of wirelessly receiving information representing the instruction of the imaging continuation or the imaging end from the portable terminal1.

After the instruction content reception process S27, the camera control unit13executes a determination process S28of determining whether to end the imaging according to instruction content represented by information received from the portable terminal1in the instruction content reception process S27. When the imaging continues, the camera control unit13continues the process by returning to the information reception process S24. When the imaging ends, the camera control unit13controls the wireless communication unit12to end an operation of the digital camera2after executing the portable disconnection S29(S30). The portable disconnection S29is a process corresponding to the camera disconnection S12performed by the portable terminal1.

Although the imaging data is transmitted in the processes illustrated inFIGS. 8 and 9, the imaging system may not transmit the imaging data. For example, when the digital camera2has an internal memory or when an external memory is connected to the digital camera2, the digital camera2may record imaging data corresponding to an image illustrated inFIG. 5 or 7in the internal memory or the external memory.

As described above, according to this embodiment, an operation of designating an imaging area or an imaging target is performed for an image captured by the portable terminal1, and imaging area information representing the imaging area or imaging target information representing the imaging target is wirelessly transmitted to the digital camera2. Thereby, because the operator can designate the imaging area or the imaging target before an image captured by the digital camera2is wirelessly received by the portable terminal1, it is possible to reduce a delay of imaging in the digital camera2. In addition, it is possible to reduce power consumption in the digital camera2because it is possible to eliminate a process in which the digital camera2generates imaging data to be used in a display of an image in the portable terminal1and a process in which the digital camera2wirelessly transmits the generated imaging data to the portable terminal1.

Next, the second embodiment of the present invention will be described. This embodiment is an example in which a timing (imaging execution time point) of a shutter trigger of a digital camera2is automatically determined. For example, the digital camera2automatically executes imaging at a desired timing such as when a smiling face of a person has been detected. Specifically, a portable terminal1issues an instruction of imaging execution after transmitting imaging execution condition information for determining the imaging execution time point of the digital camera2to the digital camera2. After receiving the imaging execution instruction, the digital camera2performs imaging at a point in time at which an image designated in an imaging range is consistent with an imaging execution condition represented by the imaging execution condition information.

Configurations of the portable terminal1and the digital camera2are the same as those of the respective devices in the first embodiment. However, in the portable terminal1, an information generation unit7aof a portable control unit7generates imaging execution condition information based on an instruction detected by an operation detection unit8. The imaging execution condition information of this embodiment is information about a state of an image of an imaging area represented by imaging area information or an image of an imaging target represented by imaging target information. In addition, in the digital camera2, an imaging control unit13bof a camera control unit13causes a camera imaging unit10to execute imaging at an imaging timing based on the imaging execution condition information and generate imaging data.

FIG. 11is an example of an image displayed on a display unit5of the portable terminal1when the operator indicates an imaging execution condition. InFIG. 11, a condition setting screen for allowing the operator to indicate the imaging execution condition is displayed.FIG. 11illustrates an image when the imaging execution condition is indicated in a state in which a target button18has been selected and a person16has been selected as an imaging target when the image illustrated inFIG. 6is displayed.

As illustrated inFIG. 11, buttons displayed on the condition setting screen are different from the buttons illustrated inFIGS. 4 and 6. In the example illustrated inFIG. 11, three types of buttons of a straight face button20, a smiling face button21, and a still button22are set as buttons for indicating the imaging execution condition. The straight face button20is a button for indicating that the imaging is performed when the selected person has a straight face as the imaging execution condition. The smiling face button21is a button for indicating that the imaging is performed when the selected person is smiling as the imaging execution condition. The still button22is a button for indicating that the imaging is performed when the selected person becomes still as the imaging execution condition.

As illustrated inFIG. 11, if the smiling face button21is selected, after the selected smiling face button21is displayed with emphasis, the imaging execution condition information representing that the imaging is executed when the selected person smiles is transmitted to the digital camera2. Thereafter, the display screen returns to the state illustrated inFIG. 6. When the shutter button19is selected, the imaging execution instruction information is transmitted to the digital camera2.

FIG. 12illustrates an operation of the portable terminal1. In camera processing S50illustrated inFIG. 12, the imaging execution instruction process S7inFIG. 8is changed to a transmission process S56of imaging execution condition information. In the transmission process S56of the imaging execution condition information, the portable control unit7controls the wireless communication unit6to wirelessly transmit the imaging execution condition information to the digital camera2. Aside from the above-described operations, operations S51to S55and S57to S62are similar to operations S2to S13illustrated inFIG. 8, and thus description thereof is omitted.

The operation of the digital camera2according to this embodiment is implemented by replacing the imaging process1(S25) among the processes illustrated inFIG. 9with an imaging process2(S70) illustrated inFIG. 13.FIG. 13illustrates details of the imaging process2(S70). Upon receiving the imaging execution instruction information, the digital camera2executes the imaging process2(S70) illustrated inFIG. 13.

A process illustrated inFIG. 13is a process to be executed by the camera control unit13of the digital camera2. In addition, image processing of detecting the smiling face or the like which is an imaging execution condition is executed by the image processing unit11. When the image processing unit11notifies the camera control unit13of a detection result of the smiling face or the like, imaging is executed.

The imaging process2(S70) will be described usingFIG. 13. The imaging process2(S70) is different from the imaging process1(S25) in that imaging is executed at a point in time at which the condition designated in the imaging execution condition information has been achieved. Specifically, the camera control unit13executes execution instruction waiting S71in which it waits for an imaging execution instruction. When the imaging execution instruction information has been wirelessly received from the portable terminal1, the camera control unit13executes an execution condition check process S72of checking the presence/absence of the imaging execution condition without immediately executing the imaging.

When there is no imaging execution condition, the camera control unit13controls the camera imaging unit10to execute an imaging execution process S74. When there is an imaging execution condition such as a smiling face, the camera control unit13executes a condition achievement check process S73of determining whether the imaging execution condition has been achieved based on a result of image processing by the image processing unit11. The detection of the imaging execution condition is executed by the image processing unit11, and the camera control unit13is notified of the result. When the imaging execution condition has not been achieved, the camera control unit13continues a condition achievement check process S73. An imaging execution process S74is performed at a point in time at which the imaging execution condition has been achieved.

After the imaging execution process S74, the camera control unit13executes a transmission data generation process S75of generating transmission data to be transmitted from the digital camera2to the portable terminal1according to imaging area information or imaging target information. In the transmission data generation process S75, the image processing unit11receives an instruction from the camera control unit13and generates transmission data corresponding to the imaging area information or imaging target information. After the transmission data generation process S75, the camera control unit13executes the process by returning to the overall process S21(S76).

According to the above-described process, the digital camera2automatically performs imaging at the moment at which the person16begins smiling in the case of the presence description.

Because imaging is executed when the state of the image becomes a state (a state of the smiling face or the like) in which the imaging execution condition is shown, the imaging can be executed at a desired timing according to this embodiment as described above.

Next, the third embodiment of the present invention will be described. In this embodiment, the portable terminal1predicts a point in time at which the state of an imaging target becomes a state of a desired arrangement (positional relationship) and adjusts a transmission timing of imaging execution instruction information to be transmitted by the portable terminal1to the digital camera2in consideration of a time required for wireless communication of imaging execution instruction information based on the predicted timing. Thereby, it is possible to optimally adjust the imaging timing in the digital camera2.

In addition, in this embodiment, the portable terminal1instructs the digital camera2to start focus adjustment before the predicted point in time at which the state of the imaging target becomes the desired arrangement state. Thereby, a start timing of focus processing is optimized

The configuration of the portable terminal1is the same as the configuration of the portable terminal1in the first embodiment except for the functional configuration of the portable control unit7.FIG. 14illustrates the functional configuration of the portable control unit7. The portable control unit7implements at least functions of an information generation unit7a, a communication control unit7b, and a prediction unit7c. The information generation unit7ais the same as that of the first embodiment.

The prediction unit7cpredicts (estimates) an imaging timing at which the state of the image of the imaging area or the imaging target becomes a predetermined state based on imaging data corresponding to an image displayed on the display unit5. Specifically, as will be described later, the prediction unit7cpredicts a time from a start time point of a process related to prediction to an imaging timing at which the imaging area or the imaging target is in a predetermined state based on imaging data corresponding to an image displayed on the display unit5, and predicts a transmission timing of the imaging execution instruction information based on the predicted time and a communication delay time according to wireless communication. In an example of this embodiment, the imaging timing is a timing at which the imaging target moves to a predetermined position of the imaging area.

The communication control unit7bcauses the wireless communication unit6to wirelessly transmit imaging execution instruction information to the digital camera2at a transmission timing predicted by the prediction unit7c. That is, the communication control unit7bcauses the wireless communication unit6to wirelessly transmit imaging execution instruction information to the digital camera2at a point in time which is at least a time necessary to wirelessly communicate with the portable terminal1earlier than the predicted imaging timing. In addition, the communication control unit7bcauses the wireless communication unit6to wirelessly transmit focus adjustment instruction information for issuing a focus adjustment instruction to the digital camera2before wirelessly transmitting the imaging execution instruction information.

The configuration of the digital camera2is the same as that of the digital camera2in the first embodiment.

FIG. 15illustrates an operation situation of the imaging system according to this embodiment. InFIG. 15, in a state in which the portable terminal1and the digital camera2have been wirelessly connected, the two devices perform imaging toward a person23. In addition, inFIG. 15, the digital camera2is configured to perform imaging at the moment at which the person23enters a goal24.

FIG. 16is an example of an image displayed by the portable terminal1on the display unit5in the state illustrated inFIG. 15. Arrangements25,26, and27are displayed on the left end of the image. If the operator touches and selects a desired arrangement, the selected arrangement is displayed with emphasis.

FIG. 16illustrates a state in which the operator designates an imaging range28in the vicinity of the goal24and selects the arrangement26serving as a condition of starting imaging. The arrangement26represents a condition that the person be at the center of a part designated as the imaging range. In this connection, the arrangement25represents a condition that the person be at the left end of the part designated as the imaging range. In addition, the arrangement27represents a condition that the person be at the right end of the part designated as the imaging range

When the arrangement26has been designated in the portable terminal1, it is possible to designate a person serving as the arrangement26and the person23is designated in the example of this embodiment. Likewise, even when the arrangements25and27have been designated, it is possible to designate the person serving as the arrangements25and27.

FIG. 17illustrates a method in which the portable terminal1predicts a point in time at which a state of an imaging target becomes a desired arrangement state. A method of predicting the point in time at which the state of the person23becomes the state of the arrangement26will be described usingFIG. 17.

A point C ofFIG. 17indicates a current place of the person23. A point D indicates a center position of an imaging range28. A point in time at which a display screen of the portable terminal1is in the state ofFIG. 17is defined as a start time point, and a time until the person23moves to the center of the imaging range28and is in a state of the arrangement26is defined as an elapsed time t1. The start time point is a point in time at which the imaging range28is designated, the arrangement26is selected, and the person23is designated. The elapsed time t1is obtained from movement vector information representing a movement speed of the person23at a current time point and information about a distance between points C and D.

Various methods have been devised as a method of obtaining the movement vector information, and these will not be described in detail. For example, it is possible to detect a movement vector by obtaining a position of an imaging target in imaging data from the portable imaging unit3for every frame. In this embodiment, the image processing unit11detects movement vector information by processing imaging data

Next, a method of detecting a communication delay time t2related to wireless communication from the portable terminal1to the digital camera2will be described There are various methods as a method of detecting a time required for wireless communication between devices and any such method may be used. For example, a method in which the portable terminal1measures a time until a response from the digital camera2is received after the portable terminal1performs transmission for measurement to the digital camera2and sets half the time as a communication delay time may be used

The portable terminal1calculates the elapsed time t1and the communication delay time t2according to the above-described method and transmits imaging execution instruction information to the digital camera2at a transmission timing based on the calculated time. Specifically, a timing t at which the imaging execution instruction information is transmitted is obtained by t=t1−t2.

The operation of the portable terminal1according to this embodiment is substantially the same as the operation illustrated inFIG. 8. Hereinafter, only an operation different from the operation illustrated inFIG. 8will be described. The communication control unit7bcontrols the wireless communication unit6at the above-described timing t to execute the imaging execution instruction process S7of transmitting the imaging execution instruction information to the digital camera2. Thereby, the imaging execution instruction information is transmitted to the digital camera2at a desired timing.

In addition, the start instruction of the focus adjustment for the digital camera2is issued at a point in time at which an imaging range or an imaging target has been designated and imaging area information or imaging target information has been transmitted. Specifically, at a point in time at which the information transmission process S6has been executed, the portable control unit7controls the wireless communication unit6to wirelessly transmit focus adjustment instruction information for issuing a focus adjustment instruction to the digital camera2. Thereby, the focus adjustment start instruction is issued at a point in time at which a desired imaging area or imaging target has been specified. Thus, in the digital camera2, the focus adjustment ends before the imaging execution instruction to be issued thereafter. The portable terminal1may simultaneously wirelessly transmit the imaging area information or the imaging target information and the focus adjustment instruction information to the digital camera2.

The operations of the digital camera2according to this embodiment are substantially the same as the operations illustrated inFIGS. 9 and 10. Hereinafter, only operations different from the operations illustrated inFIGS. 9 and 10will be described. In this embodiment, after executing the information reception process S24, the camera control unit13controls the wireless communication unit12to wirelessly receive the focus adjustment instruction information wirelessly transmitted from the portable terminal1. The camera control unit13receiving the focus adjustment instruction information controls the camera imaging unit10to perform focus adjustment.

In addition, the imaging execution process S42is executed immediately when the camera control unit13receives imaging execution instruction information in the imaging process1(S25).FIG. 18illustrates an image captured by the digital camera2when an imaging execution instruction has been issued from the portable terminal1at the above-described timing. As illustrated inFIG. 18, imaging is performed at a timing at which the person23has reached substantially the center of the imaging range28.FIG. 19illustrates an image to be transmitted by the digital camera2to the portable terminal1. As illustrated inFIG. 19, an image obtained by extracting a part of the imaging range28from the image illustrated inFIG. 18is transmitted to the portable terminal1.

As described above, according to this embodiment, the imaging execution instruction information is wirelessly transmitted from the portable terminal1to the digital camera2at a transmission timing based on the predicted imaging timing and the communication delay time according to the wireless communication. Thereby, the digital camera2can execute imaging at an appropriate imaging timing.

In addition, the digital camera2can appropriately execute the focus adjustment by wirelessly transmitting the focus adjustment instruction information before the imaging execution instruction information is wirelessly transmitted from the portable terminal1to the digital camera2.

Next, the fourth embodiment of the present invention will be described. In this embodiment, a method of controlling a zoom state of the digital camera to which an optical zoom function is added will be described

FIGS. 20A and 20Billustrate a configuration of a digital camera29according to this embodiment. As illustrated inFIG. 20A, the digital camera29includes a camera imaging unit10, an image processing unit11, a wireless communication unit12, a camera control unit13, a data bus14, and an optical zoom unit30. In the digital camera29, the optical zoom unit30is connected to the camera imaging unit10. The optical zoom unit30performs optical zoom for adjusting a zoom state of an optical system. Because a configuration other than the optical zoom unit30is the same as the configuration illustrated inFIG. 2, description thereof is omitted.

In this embodiment, the digital camera29waits by setting zoom magnification to predetermined magnification at which a wide range can be imaged before imaging area information or imaging target information is transmitted from the portable terminal1. In addition, the digital camera29performs an enlargement process while searching for the imaging range at a point in time at which the imaging range or the imaging target has been indicated and waits for an instruction of imaging execution while maintaining a bare zoom state in which an image covering the imaging range can be captured.

In addition, when imaging is continuously performed, the digital camera29starts to search for the imaging range while temporarily moving the optical zoom unit30to a wide angle side at a point in time at which the imaging area information or the imaging target information for the next imaging has been received. Thereafter, the digital camera29waits for an instruction of imaging execution while maintaining a bare zoom state in which an image covering the imaging range can be captured.

FIG. 20Billustrates a functional configuration of the camera control unit13. The camera control unit13implements at least functions of a communication control unit13a, an imaging control unit13b, and a zoom control unit13c. The zoom control unit13csets magnification of the optical zoom to first magnification which is less than or equal to predetermined magnification until the wireless communication unit12wirelessly receives the imaging area information or the imaging target information. The predetermined magnification, for example, is magnification of a wide angle end or magnification in the vicinity of the wide angle end and before the wide angle end. In addition, after the wireless communication unit12has wirelessly received the imaging area information or the imaging target information, the zoom control unit13csets the magnification of the optical zoom to second magnification which is greater than the predetermined magnification. More specifically, after the wireless communication unit12has wirelessly received the imaging area information or the imaging target information, the zoom control unit13csets the magnification of the optical zoom to the second magnification which is greater than the predetermined magnification and can cover all of the imaging area represented by the imaging area information or the imaging target represented by the imaging target information.

After the magnification of the optical zoom has been set to the second magnification, the imaging control unit13bcauses the camera imaging unit10to generate imaging data corresponding to an image including the imaging area represented by the imaging area information or the imaging target represented by the imaging target information. The communication control unit13ais the same as that of the first embodiment.

The configuration of the portable terminal1is the same as the configuration of the portable terminal1in the first embodiment.

FIG. 21illustrates an image captured by the digital camera29. Zoom processing to be performed by the digital camera29will be described usingFIG. 21.

InFIG. 21, a frame32illustrates a range of imaging data output from the camera imaging unit10in a state in which the optical zoom unit30is at the wide angle end. In addition, a frame33illustrates a range of imaging data output from the camera imaging unit10after the zoom processing. An imaging range31is an imaging range designated from the portable terminal1.

As illustrated inFIG. 21, when the imaging range31is designated from the portable terminal1, the digital camera29moves the optical zoom unit30from the wide angle end (frame32) to a position of the frame33which barely covers the imaging range31. According to the above-described process, it is possible to perform imaging in an optimum zoom state in which the imaging range31is covered.

FIG. 22illustrates the operation of the digital camera2. In an overall process S80illustrated inFIG. 22, zoom processing1(S82) is added to the overall process S21inFIG. 9and the imaging process1(S25) is changed to an imaging process4(S85). In the zoom processing1(S82) to be performed after the initial setting S81, the camera control unit13sets the zoom magnification to the first magnification. Thereby, the digital camera29waits by setting the zoom magnification to predetermined magnification at which a wide range can be imaged before the imaging area information or the imaging target information is transmitted from the portable terminal1. The imaging process4(S85) will be described usingFIG. 23. Aside from the above-described operations, operations S81, S83and S84, and S86to S90are the same as the operations S2to S13illustrated inFIG. 9, and thus description thereof is omitted.

FIG. 23illustrates details of the imaging process4(S85). In the imaging process4(S85) illustrated inFIG. 23, zoom processing2(S91) is added to the imaging process1(S25) inFIG. 10. In the zoom processing2(S91) to be performed before the execution instruction waiting S92, the camera control unit13sets the zoom magnification to the second magnification which is greater than the first magnification set in the zoom processing1(S82). Thereby, the digital camera29waits for an instruction of imaging execution while maintaining the bare zoom state in a state in which an image to cover the imaging range can be captured. Because operations S92to S95other than the above-described operations are similar to the operations S41to S44illustrated inFIG. 10, description thereof is omitted.

As described above, according to this embodiment, the digital camera2decreases the zoom magnification until the imaging area information or the imaging target information is wirelessly received. In addition, after the imaging area information or the imaging target information has been wirelessly received, the digital camera2increases the zoom magnification so that the imaging range corresponding to the imaging area information or the imaging target information can be imaged. Thereby, the digital camera2can execute imaging in an appropriate zoom state.