Image pickup apparatus associating shooter and shot image, and control method for the same

An image pickup apparatus capable of associating a shooter with a shot image in consideration of shooter's intention. The image pickup apparatus has a first image pickup unit that shoots a subject to obtain a first image and a second image pickup unit that shoots a shooter to obtain a second image. An identification unit identifies a person existing in the first image to obtain first identification information and identifies a person existing in the second image to obtain second identification information. A recording unit records the second identification information as shooter information in metadata of the first image, together with the second image. If, after the person existing in the second image is identified, the same person as the person identified from the second image is identified from the first image, identification information about the same person is recorded as the shooter information in the metadata.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to an image pickup apparatus and a control method therefor, and more particularly to an image pickup apparatus capable of associating an image obtained as a result of image pickup with a shooter who has shot the image, and a control method therefor.

Description of the Related Art

In general, though there may be a case where an image pickup apparatus such as a digital camera is personally owned and used, there may also be a case where an image pickup apparatus is shared and used among multiple persons such as family members. When image pickup is performed by multiple persons in the case where an image pickup apparatus is shared among the multiple persons, it may be difficult to confirm by whom shot images recorded in a memory provided in the image pickup apparatus were shot.

Conventionally, there has been an image pickup apparatus provided with a fingerprint sensor on a shutter button. In this image pickup apparatus, when image pickup is performed, the fingerprint of a finger which has pressed the shutter button is compared. Then, a shooter who has pressed down the shutter button is identified on the basis of the comparison so that a shot image is recorded in a folder for each shooter (see Japanese Laid-Open Patent Publication (Kokai) No. 2005-286583).

By the way, when a shooter shoots himself/herself as a subject by an image pickup apparatus, he/she may hand over the image pickup apparatus to another person to request the person to perform image pickup. In this case, since the different person to whom the image pickup apparatus has been handed over presses the shutter button, an image is judged to be an image by the different person though the composition or the subject is intended by the particular shooter.

That is, though a particular shooter intends image pickup and requests another person to perform the image pickup, a shot image is not recorded in a folder for the particular shooter but is recorded in a different folder. As a result, though the image pickup is performed by the particular shooter's intention, it is not possible to associate the particular shooter with the shot image.

SUMMARY OF THE INVENTION

The present invention provides an image pickup apparatus capable of associating a shooter with a shot image in consideration of the shooter's intention and a control method therefor.

Accordingly, the present invention provides an image pickup apparatus at least provided with a first image pickup unit configured to shoot a subject to obtain a first image and a second image pickup unit configured to shoot a shooter to obtain a second image, the image pickup apparatus comprising an identification unit configured to identify a person existing in the first image to obtain first identification information and identify a person existing in the second image to obtain second identification information, a recording unit configured to record the second identification information as shooter information in metadata of the first image shot by the first image pickup unit, together with the second image, and a control unit configured to, if, after the person existing in the second image is identified, the same person as the person identified from the second image is identified from the first image, perform control so that identification information about the same person is recorded as the shooter information in the metadata of the first image.

According to the present invention, when first identification information corresponding to second identification information exists, it is judged that image pickup at a current point of time has been performed by a shooter who performed image pickup last. Therefore, even when a person who has been operating an image pickup apparatus and shooting an image intentionally has proxy image pickup performed by another person, an image can be regarded as an image shot by the original shooter. As a result, it is possible to associate a shooter with a shot image in consideration of the shooter's intention.

DESCRIPTION OF THE EMBODIMENTS

An example of an image pickup apparatus according to an embodiment of the present invention will be described below with reference to drawings.

FIG. 1is a block diagram schematically showing a configuration of an example of an image pickup apparatus301according to an embodiment of the present invention.

The image pickup apparatus301shown inFIG. 1is, for example, a digital camera (hereinafter simply referred to as a camera) and is provided with a shutter button302, a clock303, a CPU304, a first image pickup section305, a second image pickup section306, a memory307and a communication circuit308. Here, the first image pickup section305is an image pickup section for shooting a subject, and the second image pickup section306is an image pickup section for shooting a shooter (or a shooter candidate) who shoots the subject by the camera (that is, the first image pickup section305).

In the description below, the first image pickup section305will be referred to as a subject camera, and the second image pickup section306will be referred to as a shooter camera.

The CPU304is a central processing unit which is responsible for control of the whole camera and performs various information processing. Processes to be described later are performed under the control of the CPU304.

The shutter button302is a button for specifying a timing for performing image pickup in the camera301to the CPU304. At the time of performing image pickup and a process related to the image pickup, the CPU304acquires current time from the clock303.

The subject camera305described before is for a shooter candidate who operates the camera301to shoot an object (subject) which is an image pickup target. It should be noted that the shooter candidate refers to a person who has probably pressed down the shutter button302.

On the other hand, the shooter camera306is for shooting a shooter candidate who operates the camera301. Here, a person whom the subject camera305captures immediately before the shutter button302is pressed down is regarded as the shooter candidate.

The memory307is a memory where reading out and writing in is possible and is mainly used as a work area of the CPU304and a buffer for data. Furthermore, in the memory307, an image obtained as a result of image pickup by the subject camera305(hereinafter referred to as a subject image) is recorded, and image pickup time and a history of shooter candidates are also recorded.

Further, in the memory307, an image of a person whom the shooter camera306captures immediately before the shutter button302is pressed down is recorded as a shooter candidate image. It should be noted that a judgment program for judging a shooter candidate is recorded in the memory307.

The communication circuit308is connected to the CPU304, and the CPU304can transfer an image shot by the camera301(that is, a subject image and a shooter candidate image) to a server309via the communication circuit308.

FIG. 2is a diagram for illustrating a judgment process for judging a shooter candidate as a shooter performed in the camera301shown inFIG. 1.

The example shown inFIG. 2shows a process for, when, at the time of shooting a subject (that is, at the time of current image pickup), a shooter of a subject image obtained by image pickup immediately before the current image pickup exists as a subject, not a shooter candidate in the current image pickup but the shooter in the immediately previous image pickup is determined as a shooter in the current image pickup.

In an image pickup situation101, a subject image shot at 10:30, and a shooter candidate and shooter of the subject image are shown. In the image pickup situation101, the shooter candidate is “Taro”, and the subject is a “house”. The shooter is “Taro”.

In an image pickup situation102, a subject image shot at 10:45, and a shooter candidate and shooter of the subject image are shown. In the image pickup situation102, the shooter candidate is “Jiro”, and the subject is “Taro and Hanako”. The shooter is “Taro”.

In the image pickup situation102, though the shooter camera306captured “Jiro” who is a shooter candidate, “Taro” is regarded as the shooter who performed image pickup because the subject camera305captured Taro who performed image pickup immediately before (that is, in the image pickup situation101). That is, though the shooter camera306captured “Jiro” as a shooter candidate in the image pickup situation102, “Taro” who is an immediately previous shooter exists in the subject image, and, therefore, “Taro” is regarded as the shooter.

FIG. 3is a flowchart for illustrating the judgment process shown inFIG. 2. It should be noted that the process according to the flowchart shown inFIG. 3is performed under the control of the CPU304.

When image pickup is started, the CPU304waits for the shutter button302to be pressed down (step S702). When the shutter button302is pressed down, the CPU304reads out a shooter image shot immediately before from the memory307on the basis of the image pickup time, and refers to an immediately previous shooter (step S703).

Next, the CPU304detects persons existing in a subject image obtained by image pickup by the subject camera305(that is, a subject image at a current point of time) (step S704). Then, the CPU304judges whether or not the shooter read out at the process of step S703exists among the persons detected in step S704(step S705).

When the shooter exists among the detected persons (step S705: YES), the CPU304determines the shooter who performed image pickup immediately before to be a shooter of the subject image obtained by image pickup performed this time (step S708). Then, the CPU304writes a shooter name into the header of the subject image (step S709). That is, the CPU304adds the shooter name to the subject image.

On the other hand, if the shooter does not exist among the persons detected in step S704(step S705: NO), the CPU304performs a shooter judgment process (step S707).

FIG. 4is a flowchart for illustrating the shooter judgment process shown in step S707inFIG. 3.

When having started the shooter judgment process, the CPU304enumerates all persons that the shooter camera306has captured within a predetermined time (for example, three minutes) before the shutter button302is pressed down, from a shooter candidate list stored in the memory307(step S802).

FIGS. 5A to 5Care diagrams showing an example of a shooter candidate history and the shooter candidate list stored in the memory307shown inFIG. 1.FIG. 5Ais a diagram showing an example of the shooter candidate history, andFIG. 5Bis a diagram showing another example of the shooter candidate history.FIG. 5Cis a diagram showing an example of the shooter candidate list.

In the examples shown inFIGS. 5A to 5C, the shooter candidate history is provided with a shooter candidate field and a recognition time field, and, similarly, the shooter candidate list is provided with a shooter candidate field and a recognition time field.

FIG. 6is a diagram for illustrating update of the shooter candidate list shown inFIG. 5C.

InFIG. 6, since the shooter camera306captured “Taro” in an image pickup situation401, the CPU304writes identification information indicating “Taro” and the time of having identified “Taro” (10:30) into the shooter candidate history stored in the memory307. Thereby, the shooter candidate history is updated from the state shown inFIG. 5Ato the state shown inFIG. 5B.

Next, since the shooter camera306captured “Hanako” in an image pickup situation402two minutes after the image pickup situation401(that is, 10:32), the CPU304writes identification information indicating “Hanako” and the time of having identified “Hanako” (10:32) into the shooter candidate history stored in the memory307. Thereby, the shooter candidate history is updated from the state shown inFIG. 5Bto the state shown inFIG. 5C.

After that, when image pickup is performed three minutes after the image pickup situation401(that is, 10:33) (that is, in an image pickup situation403), the CPU304regards all persons that the shooter camera306has captured within three minutes before the shutter button302is pressed down as shooter candidates. As a result, “Taro” and “Hanako” become shooter candidates in the image pickup situation403, and the shooter candidate history shown inFIG. 5Cbecomes a shooter candidate list. Therefore, in the process of step S802, the CPU304enumerates “Taro” and “Hanako” as shooter candidates.

FIG. 7is a diagram showing an example of a registered shooter database stored in the memory307shown inFIG. 1.

The registered shooter database shown inFIG. 7has an identification information field, a recording destination field, an upload destination field and a shooter name field. An image of a shooter is recorded in the identification information field as identification information. A filename of a file in which the identification information is recorded is recorded in the recording destination field.

The URL of an upload destination is recorded in the upload destination field. A shooter's name is recorded in a shooter name field. It should be noted that the registered shooter database is a database in which, for each user using the camera301, user information for identifying the user is associated with shooter identification information.

Referring toFIG. 4again, after enumerating the shooter candidates, the CPU304searches the registered shooter database for a shooter candidate corresponding to any of the shooter candidates (step S803). Then, the CPU304judges whether or not the shooter candidate corresponding to any of the enumerated shooter candidates exists in the registered shooter database (step S804).

If the shooter candidate corresponding to any of the enumerated shooter candidates does not exist (step S804: NO), the CPU304ends the shooter judgment process and proceeds to the process of step S709shown inFIG. 3. If the shooter candidate corresponding to any of the enumerated shooter candidates exists (step S804: YES), the CPU304acquires the shooter name of the shooter candidate from the registered shooter database. Then, the CPU304ends the shooter judgment process and proceeds to the process of step S709shown inFIG. 3.

For example, in the example shown inFIG. 7, identification information (an image) of “Taro” and “Hanako” is recorded in the registered shooter database as identification information502a. Further, since the CPU304has enumerated the two of “Taro” and “Hanako” from the shooter candidate list, “Family” is recorded as a shooter name as shown in a shooter name502d.

Referring toFIG. 3again, after the shooter judgment process, the CPU304compares identification information about the shooter with the shooter identification information in the registered shooter database in the process of step S709. If the identification information corresponds to any of the shooter identification information, the CPU304writes the shooter name in the registered shooter database into the header of the subject image. For example, in the image pickup situation102shown inFIG. 2, the identification information about the shooter corresponds to identification information501ain the registered shooter database, and, therefore, the CPU304writes a shooter name501d(that is, “Taro”) into the header of the subject image.

On the other hand, if corresponding identification information does not exist in the registered shooter database, the CPU304leaves the header of the subject image without a shooter name to be written there.

After the process of step S709, the CPU304updates information about the immediately previous shooter recorded in the memory307(step S710). For example, in the case of the image pickup situation102shown inFIG. 2, the CPU304does not record a shooter candidate “Jiro” as the immediately previous shooter but records “Taro” judged to be a shooter into the memory307as the immediately previous shooter.

FIGS. 8A and 8Bare diagrams for illustrating an example of an image record list recorded in the memory307shown inFIG. 1.FIG. 8Ais a diagram showing an example of the image record list before update, andFIG. 8Bis a diagram showing the image record list after update.

As shown inFIG. 8A, a shooter, a recording destination (folder) and an image pickup date and time are recorded in the image record list (that is, an image pickup history) each time image pickup is performed. The CPU304can know a shooter who performed image pickup last by referring to this image record list. In the example shown inFIG. 8A, the shooter who performed image pickup last is “Taro”1006a.

Referring toFIG. 3again, the CPU304performs a proxy image pickup judgment process (step S711). The proxy image pickup judgment process is a process for judging whether or not another person has been requested to perform proxy image pickup.

FIG. 9is a diagram for illustrating an example of the proxy image pickup judgment process performed by the CPU304shown in step S711inFIG. 3.

Even if another person is requested to perform proxy image pickup, the CPU304judges that a requester shot an image shot by proxy image pickup if the requester performs image pickup again within a predetermined time. In the example shown inFIG. 9, image pickup is performed three times in image pickup situations201to203. Then, image pickup times in the image pickup situations201,202and203are 10:45, 10:47 and 10:49, respectively.

In the image pickup situation201, “Taro” operates the camera as a shooter candidate and shoots a “house” which is a subject. In the image pickup situation202, “Jiro” operates the camera as a shooter candidate and shoots the “sea” which is a subject. Further, in the image pickup situation203, “Taro” operates the camera as a shooter candidate and shoots “strawberries” which are a subject again.

In the example shown inFIG. 9, the CPU304judges that the shooter is “Taro” in all the image pickup situations201to203. That is, since “Taro” who is a shooter performs image pickup in the image pickup situation203within a predetermined time (for example, five minutes) after “Jiro” who is a shooter candidate performs image pickup in the image pickup situation202, the CPU304judges that the shooter in the image pickup situation202is “Taro”.

Here, the CPU304judges that an image which “Jiro” who is a shooter candidate has shot is an image obtained by “Taro” intentionally requesting “Jiro” to perform image pickup (proxy image pickup request).

FIG. 10is a flowchart for illustrating the proxy image pickup judgment process shown in step S711inFIG. 3.

When having started the proxy image pickup judgment process, the CPU304enumerates all images that have been shot within a predetermined time (for example, the past five minutes) after the time when image pickup was performed last (step S902). At the time of the process of step S902, the CPU304refers to, for example, the image record list shown inFIG. 8A.

In the image record list shown inFIG. 8A, the image1006ais an image obtained by the last image pickup. Since the image pickup time of the image1006ais Mar. 12, 2012, 15:19, subject images shot within five minutes after the image (subject image)1006aare images1001a,1002a,1003a,1004aand1005a.

Next, the CPU304identifies the oldest subject image of the shooter of the last subject image1006afrom among the subject images1001ato1005ashot within five minutes after the subject image1006a(step S903). In the example shown inFIG. 8A, the subject image1001ais the oldest subject image among subject images shot by “Taro” who shot the subject image1006awithin five minutes.

Next, the CPU304judges whether or not the identified subject image is the same image as the subject image that the shooter shot last (step S904). If the oldest image among the subject images shot within the past five minutes is the same image as the subject image shot last (step S904: YES), the CPU304judges that proxy image pickup has not been performed. Then, the CPU304ends the proxy image pickup judgment process and proceeds to the process of step S712inFIG. 3.

On the other hand, if the oldest image among the subject images shot within the past five minutes is not the same image as the subject image shot last (step S904: NO), the CPU304searches for subject images shot by other persons between the oldest subject image and the image shot last (step S905). In the example shown inFIG. 8A, the subject images1003a,1004aand1005aare enumerated as subject images shot by other persons.

Next, the CPU304judges whether the subject images shot by other persons exist or not (step S906). If the subject images shot by other person do not exist (step S906: NO), the CPU304judges that proxy image pickup has not been performed. Then, the CPU304ends the proxy image pickup judgment process and proceeds to the process of step S712inFIG. 3.

On the other hand, if the subject images shot by other persons exist (step S906: YES), the CPU304replaces shooters recorded in the headers of the subject images shot by other persons with the shooter who shot the last subject image and changes the recording destination of the subject images (step S907).

Thereby, the image record list shown inFIG. 8Ais updated to the image record list shown inFIG. 8B. In the image record list shown inFIG. 8B, the shooters and recording destinations of the subject images1003a,1004aand1005aare changed and recorded as subject images1003b,1004band1005b.

Next, the CPU304records the subject images to a recording destination corresponding to the shooter. Recording destinations corresponding to shooters are registered with the registered shooter database described with reference toFIG. 7. Here, the CPU304decides a recording destination by comparing identification information about the shooter with the shooter identification information in the registered shooter database. For example, in the image pickup situation102shown inFIG. 2, the identification information about the shooter corresponds to the identification information501ain the registered shooter database, and, therefore, the CPU304determines a recording destination501bas the recording destination of the subject image.

It should be noted that, if corresponding identification information about the shooter does not exist in the registered shooter database, the CPU304determines “¥DCIM¥DEFOFLDER¥”, which is a predetermined folder, as the recording destination of the subject image.

After that, the CPU304uploads the subject images to the server309(step S715) and ends image pickup.

Here, for each shooter, whether or not to upload subject images is registered with the registered shooter database shown inFIG. 7. Here, the CPU304judges whether or not to upload by comparing the identification information about the shooter with the shooter identification information in the registered shooter database.

The identification information about the shooter in the image pickup situation102shown inFIG. 2corresponds to the identification information501ain the registered shooter database. However, since an upload destination is not specified, the CPU304does not upload the subject images to the server309.

On the other hand, if the identification information about the shooter corresponds to the identification information502ain the registered shooter database, the CPU304starts the process for uploading the subject images to the server309because an upload destination502cis specified here.

FIG. 11is a flowchart for illustrating the upload process shown inFIG. 3.

When having started the upload process, the CPU304confirms a folder in which the subject images to be uploaded are stored (upload folder) (step S1102). This upload folder is recorded as a recording destination in the registered shooter database shown inFIG. 7. Since a recording destination502bis specified for the shooter of the identification information502ainFIG. 7, the CPU304confirms the folder of the recording destination502bas the upload folder.

Next, for the upload folder as a target, the CPU304searches for and enumerates images for which a predetermined time (for example, five minutes) has passed after image pickup (step S1103). Then, the CPU304confirms the upload destination502cin the registered shooter database (step S1104).

After that, the CPU304uploads (that is, transmits) the subject images enumerated in step S1103to the upload destination (transmission destination)502c(step S1105).

When upload of one subject image is completed, the CPU304confirms whether or not unuploaded subject image exists among the enumerated subject images (step S1106). If an unuploaded subject image exists (step S1106: YES), the CPU304returns to the process of step S1104, acquires an upload destination again, and uploads the subject image to the server309.

On the other hand, if an unuploaded subject image does not exist (step S1106: NO), the CPU304ends the upload process.

Thus, in the embodiment of the present invention, even in the case where a shooter who has been operating the camera301and performing image pickup intentionally has proxy image pickup performed by another person, a subject image obtained by the proxy image pickup can be recorded as an image shot by the original shooter.

It should be noted that, in the embodiment described above, the CPU304identifies a person existing in a subject image to obtain first identification information and identify a person existing in a shooter image to obtain second identification information. Then, the CPU304records the second identification information into the memory307as shooter information in metadata of the subject image, together with the image. Furthermore, if a person existing in a shooter image is identified, and the same person as the person identified from the shooter image is identified from a subject image, the CPU304records identification information about the same person as shooter information in the metadata of the subject image.

Further, if, after a person existing in a shooter image is identified, the same person as the person identified from the shooter image is identified from a subject image within a predetermined time, the CPU304records identification information about the same person as shooter information in the metadata of the subject image.

In addition, in the embodiment described above, image pickup processes by the subject camera305and the shooter camera306are executed in response to one image pickup instruction. Further, in the case of, after identifying a person existing in a shooter image, performing image pickup in a state that the same person as the person identified from the shooter image is identified from a subject image, the CPU304records identification information about the same person into the memory307as shooter information in the metadata of the subject image even if another person exists in a shooter image obtained by the shooter camera306.

Other Embodiments

This application claims the benefit of Japanese Patent Application No. 2014-086317, filed Apr. 18, 2014, which is hereby incorporated by reference wherein in its entirety.