Source: https://patents.google.com/patent/JP5965981B2/en
Timestamp: 2020-07-15 03:17:50
Document Index: 190183580

Matched Legal Cases: ['art 51', 'art 51', 'art 51', 'arts 52', 'art 51', 'arts 52', 'art 51', 'art 51', 'arts 52', 'art 2', 'art 8', 'art, 1', 'art, 1', 'art, 1', 'art, 2', 'art, 2', 'art, 2', 'art, 5', 'art, 5', 'art, 6', 'art, 7', 'art, 8', 'art, 9', 'art, 52', 'art, 52']

JP5965981B2 - Image capturing apparatus, image capturing apparatus control method, and program - Google Patents
Image capturing apparatus, image capturing apparatus control method, and program Download PDF
JP5965981B2
JP5965981B2 JP2014262047A JP2014262047A JP5965981B2 JP 5965981 B2 JP5965981 B2 JP 5965981B2 JP 2014262047 A JP2014262047 A JP 2014262047A JP 2014262047 A JP2014262047 A JP 2014262047A JP 5965981 B2 JP5965981 B2 JP 5965981B2
JP2014262047A
JP2015109660A (en
2014-12-25 Application filed by オリンパス株式会社 filed Critical オリンパス株式会社
2014-12-25 Priority to JP2014262047A priority Critical patent/JP5965981B2/en
2015-06-11 Publication of JP2015109660A publication Critical patent/JP2015109660A/en
2016-08-10 Publication of JP5965981B2 publication Critical patent/JP5965981B2/en
The present invention relates to a photographing apparatus, a method for controlling the photographing apparatus, and a program, and more particularly, to a photographing apparatus having a function of photographing a moving image, such as a digital camera, a video camera, and a camera-equipped mobile phone, a method for controlling the photographing apparatus, and a program. .
Conventionally, when photographing by amateurs, still image photographing assuming a printed photograph has been common. However, in recent years, by replacing a film camera with a photographing device such as a digital camera having an image sensor and a memory, it has become possible to easily shoot moving images obtained by continuously photographing still images. Moving image shooting can record the fun of movement, changes in facial expressions and poses, which were difficult with still image shooting, and is used for recording growth of children and landscape changes at travel destinations.
However, unlike a still image that only cuts out a moment, a movie records movement, and it becomes boring if the start and end timings are not properly selected. I feel a lot of stress. For this reason, it can be said that there are many photographers who hesitate to shoot video. For example, when requesting a photographer to take a picture, if it is a still image, it is only necessary to press the shutter button. It was easy, but when it comes to a movie, the person who was asked to shoot, at what timing I don't usually know what to shoot. From the viewpoint of shooting timing, Patent Document 1 proposes an imaging apparatus that can perform shooting when a predetermined number of faces are obtained when taking a group photo or the like.
JP 2007-329602 A
In the above-mentioned Patent Document 1, it is proposed to start shooting when a predetermined condition is met, but it is premised on shooting a still image, and at what timing when shooting a moving image. In addition, there is no indication as to when the shooting ends.
The present invention has been made in view of such circumstances, and provides a photographing apparatus, a photographing apparatus control method, and a program capable of easily photographing a moving image without worrying about the timing of photographing start. With the goal.
In order to achieve the above object, a photographing apparatus according to a first aspect of the present invention includes a photographing lens for forming a subject image, an imaging unit that converts the subject image into an image signal and outputs the image signal, and is output from the imaging unit. In a photographing apparatus having a recording unit that records image data based on an image signal, a posture detecting unit that detects a posture of the photographing device, an image detecting unit that detects a face image included in the image signal, and a release switch And a recording control unit that controls recording of the image data based on the detection result of the posture detection unit and the detection result of the image detection unit, and the recording control unit operates the release switch. Sometimes, shooting control of still images and moving images is performed based on the image from the imaging unit, and the imaging device is stable as a result of detection by the posture detection unit, or by the image detection unit. Result of the detection, when the change in the face position is smaller determines the start of the recording of the image data of the moving image.
In the photographing apparatus according to a second aspect of the present invention, in the first aspect, the recording control unit records a moving image when the moving image data has a predetermined time or more.
According to a third aspect of the present invention, there is provided the photographing apparatus according to the first aspect, wherein when the recording control unit has started recording the image data of the moving image before the operation of the release switch, After recording the image data of the image, the recording of the image data of the moving image is resumed. On the other hand, if the recording of the image data of the moving image has not started before the operation of the release switch, the still image After the recording of the image data, recording of the moving image data starts.
According to a fourth aspect of the present invention, in the first aspect, the recording control unit determines that there is a movement of the photographing device based on the detection result of the posture detection unit, and the detection of the image detection unit. When it is determined that the face position change is small based on the result, recording of the image data of the moving image is started.
According to a fifth aspect of the present invention, in the first aspect, the recording control unit determines that the photographing device has not moved for a predetermined time based on the detection result of the posture detection unit. Then, recording of the image data of the moving image is started.
According to a sixth aspect of the present invention, there is provided a photographing apparatus control method, a photographing lens for forming a subject image, an imaging unit for converting the subject image into an image signal, a release switch, and an output from the imaging unit. And a recording unit that records image data based on the image signal, an attitude detection step for detecting the attitude of the imaging apparatus, and an image for detecting a face image included in the image signal. A detection step; a detection result in the posture detection step; and a recording control step for controlling recording of the image data based on the detection result in the image detection step. The recording control step includes the release switch. During the operation, still image and video shooting control is performed based on the image from the imaging unit. If the imaging apparatus is stable, or the image detection result of the detection in step, when the face position change is small determines the termination of the recording of the image data of the moving image.
According to a seventh aspect of the invention, there is provided a program for imaging a lens for forming a subject image, an imaging unit for converting the subject image into an image signal, a release switch, and an image signal output from the imaging unit. A recording unit that records image data based on the computer program of the imaging apparatus, the attitude detection step for detecting the attitude of the imaging apparatus, and the image detection step for detecting a face image included in the image signal; And a recording control step for controlling the recording of the image data based on the detection result in the posture detection step and the detection result in the image detection step. The recording control step is performed when the release switch is operated. Based on the image from the imaging unit, it performs still image and video shooting control, and the detection in the posture detection step If result, the imaging apparatus is stable, or the image detection result of the detection in step, when the change in the face position is smaller determines the termination of the recording of the image data of the moving image.
According to the present invention, it is possible to provide a photographing apparatus, a photographing apparatus control method, and a program capable of casually photographing a moving image without minding the photographing start timing.
It is a block diagram which shows the electric constitution of the camera concerning 1st Embodiment of this invention. The structure of the attitude | position determination part in the camera concerning 1st Embodiment of this invention is shown, (a) is a perspective view which shows the structure of an acceleration sensor, (b) is the arrangement | positioning in the camera of an acceleration sensor, and its detection direction. It is a disassembled perspective view shown. 4 is a graph showing signal output of an acceleration sensor of an attitude determination unit in the camera according to the first embodiment of the present invention. It is a figure which shows the usage method of the camera concerning 1st Embodiment of this invention, Comprising: It shows a mode that a person nearby is requested to image | photograph. It is a flowchart which shows the operation | movement of the camera control in the camera concerning 1st Embodiment of this invention. 6 is a graph showing detected values in a posture determination unit in the camera according to the first embodiment of the present invention, with and without the camera. In the camera according to the first embodiment of the present invention, the detection of the posture determination unit when handing over the camera is shown, (a) shows the state of passing in a state where the camera front is upright, (b) is the camera front side down Shown to be handed over. It is a figure which shows the usage method of the camera concerning 2nd Embodiment of this invention, Comprising: A mode that it asks the person who is near asks for photography. It is a flowchart which shows the operation | movement of the camera control in the camera concerning 2nd Embodiment of this invention. It is a flowchart which shows operation | movement other than the request mode in the camera concerning 2nd Embodiment of this invention. It is a figure which shows the external appearance of the camera concerning 3rd Embodiment of this invention, Comprising: (a) is the external appearance perspective view seen from the front side, (b) is the external appearance perspective view seen from the back side, c) shows the timing of display performed at random when the child mode is set. It is a figure which shows the usage method of the camera concerning 3rd Embodiment of this invention, Comprising: A camera is handed over to a child and a mode that a child image | photographs himself is shown. It is a flowchart which shows the operation | movement of the camera control in the camera concerning 3rd Embodiment of this invention. It is a figure which shows the relationship between the imaging | photography timing of a moving image, and the imaging | photography content in the camera concerning 3rd Embodiment of this invention. It is a figure which shows a mode that it takes a child's interest and image | photographs in the modification of the camera concerning 3rd Embodiment of this invention. It is a figure which shows the other example of the display for performing the imaging | photography with a child's interest in the modification of the camera concerning 3rd Embodiment of this invention. It is a flowchart which shows the operation | movement of the camera control in the modification of the camera concerning 4th Embodiment of this invention. It is a figure which shows the other example of the display for performing the imaging | photography with a child's interest in the modification of the camera concerning 3rd Embodiment of this invention.
Hereinafter, preferred embodiments using a digital camera to which the present invention is applied will be described with reference to the drawings. A camera according to a preferred embodiment of the present invention has a function of a general digital camera. That is, it has an imaging unit, and the subject image is converted into image data by the imaging unit, and the subject image is displayed in live view on a display unit arranged on the back of the main body based on the converted image data. The photographer determines the composition and the photo opportunity by observing the live view display. During the release operation, image data of still images and moving images is recorded on a recording medium, and information such as the shooting date and time, the shooting mode, and the like is also recorded. The captured image recorded on the recording medium can be reproduced and displayed on the display unit when the reproduction mode is selected.
FIG. 1 is a block diagram showing an electric circuit of a camera 10 according to the first embodiment of the present invention. The camera 10 is a digital camera, and includes a control unit 1, an imaging unit 2, a face detection unit 2a, a facial expression determination unit 2, a zoom lens 2c, a warning unit 3, a posture determination unit 4, a recording unit 6, a clock unit 7, and a display unit. 8 and the operation unit 9 and the like.
The zoom lens 2c is a photographic lens having a variable focal length. The zoom lens 2c includes an exposure control unit such as a shutter and a diaphragm and an electric focusing mechanism for the photographic lens. The focus adjustment mechanism performs automatic focus adjustment based on a control signal from the control unit 1 described later. The image pickup unit 2 includes an image pickup device, a drive and readout circuit for the image pickup device, converts the subject image formed by the zoom lens 2c into an image signal by the image pickup device, and outputs the image signal.
The face detection unit 2a receives the image signal output from the imaging unit 2, and whether or not a person's face is included in the subject image, and if a face is included, its position and size. Are detected, and the detection result is output to the control unit 1 and the facial expression determination unit 2b. In detecting a face, shadows of parts such as eyes, nose, and mouth in the face are extracted and performed by a pattern matching method or the like. The zoom lens 2c can be focused based on the face detected by the face detection unit 2a. The facial expression determination unit 2b receives an image signal from the imaging unit 2, and determines whether the face detected by the face detection unit 2a is a facial expression of the person, for example, a smile. The determination is based on the shape of the facial parts such as eyes and mouth.
The control unit 1 controls the entire sequence of the camera 10 according to a program stored in a storage unit (not shown). Each unit in the control unit 1 is executed by hardware in the control unit and software by a program. The control unit 1 includes a recording control unit 1a, a display warning control unit 1b, and a mode setting unit 1c. Based on the image signal output from the imaging unit 2, the recording control unit 1 a performs control when recording the moving image or the still image image data processed by the image processing unit 5 in the recording unit 6. The display warning control unit 1b performs control when the warning unit 3 performs display so that a person photographed during shooting can recognize that the person is shooting.
The mode setting unit 1c sets modes such as a program shooting mode, a landscape shooting mode, and a request mode. Here, the “request mode” is a mode that will be described later in detail, but is a convenient mode for requesting a person nearby to take a picture with the camera 10, and detects the movement (posture) of the camera 10 and the face of the subject. This is a mode in which shooting of a moving image is started when an appropriate state is reached based on the detection result.
The control unit 1 includes an image processing unit 5 and a trimming unit 5a in addition to the recording control unit 1a described above. The image processing unit 5 includes a moving image processing unit and a still image processing unit, each of which captures an image signal output from the imaging unit 2, and performs various processes such as thinning processing, resizing processing, edge enhancement, color correction, and image compression. The image processing is performed for live view display of moving images, recording of still images and moving images in the recording unit 6, and reproduction display of still images and moving images. In image compression / expansion, a still image compression / expansion circuit, a moving image compression / expansion circuit, and the like are provided for still images and moving images in accordance with respective processes.
The trimming unit 5a performs a trimming process for cutting out a part of the image signal output from the imaging unit 2. When cutting out the image data, an image of a specific part such as the center of the screen is cut out. In addition to this, the periphery of the face of the subject is determined based on the position and size of the face detected by the face detection unit 2a. cut. The trimmed image is displayed on the display unit 8 and recorded in the recording unit 6.
The posture determination unit 4 includes a 6-axis sensor and the like, and detects the posture (tilt) state of the camera 10. In detecting the posture, an acceleration sensor, an inclination sensor, a camera shake detection sensor, or the like is used. The sensor unit of the posture determination unit 4 will be described later with reference to FIG.
The display unit 8 is configured by a display device such as a liquid crystal monitor or an organic EL disposed on the back surface of the camera 10 or the like. The display unit 8 performs live view display of the subject image as a moving image based on the image data from the imaging unit 2, and reproduces and displays the captured image recorded in the recording unit 6. The warning unit 3 includes a display element such as an LED, and displays a display indicating that photographing is in progress.
The operation unit 9 includes operation members such as a release button, a zoom button, a reproduction button, and a menu button provided on the camera 10. The operation unit 9 determines an operation state of the operation member and outputs the operation state to the control unit 1. The control unit 1 controls the camera based on the operation state of the operation member. The above-mentioned request mode is set in the menu mode of the operation unit 9.
The clock unit 7 has a timekeeping function and outputs date / time information. The recording unit 6 is a recording medium that records image data. When the control unit 1 determines that the operation of the shooting instruction has been performed by the operation unit 9, the control unit 1 records image data and shooting date / time information in association with the image data in the recording unit 6. This is to enable image management based on the shooting date and time.
Next, the acceleration sensor 50 disposed in the posture determination unit 4 will be described with reference to FIG. As shown in FIG. 2A, the acceleration sensor 50 includes fixed metal portions 52a and 52b on the chip surface and a cross-linked metal portion 51, and is manufactured by, for example, a MEMS process. The metal part 51 includes four base points 51a, an H-shaped bridging part 51b held by the base point 51a, and a movable part 51c opposed to the fixed metal parts 52a and 52b. The acceleration sensor 50 detects the capacitance of a capacitor formed by the movable part 51c and the fixed metal parts 52a and 52b. When the metal part 51 moves in the direction of the arrow in FIG. 2A, the capacitance of the capacitor changes. Therefore, by obtaining this amount of change, the acceleration α in the direction of the arrow can be detected.
FIG. 3 shows the detection output of the acceleration sensor 50. In the example shown in FIG. 3, the camera 10 is moved at a constant speed, and at the start of movement t1, the detection output of the acceleration sensor 50 is smaller than the steady value. Also, at the end of movement t2, it is larger than the steady value. Depending on the moving direction, the detection output changes in the opposite direction to the example shown in FIG. For this reason, the direction of the acceleration α is also known by detecting the change in the signal. Further, the displacement d between the fixed metal portions 52a, 52b and the movable portion 51c is calculated from the change in the capacitance of the capacitor composed of the fixed metal portions 52a, 52b and the movable portion 51c, and the time change of the displacement d is calculated. From this, the acceleration α is calculated.
Further, depending on the posture (tilt) of the camera 10, the position of the cross-linked metal part 51 with the fixed metal parts 52a and 52b on the chip surface changes depending on how gravity is applied, and the detection output changes. Therefore, whether the camera 10 is in the vertical position or the horizontal position can be determined based on the detection output of the acceleration sensor 50.
As shown in FIG. 2B, the above-described acceleration sensor 50 is arranged in three places in the camera 10. That is, the acceleration sensor 50X that detects the acceleration in the longitudinal direction (X direction) of the camera 10, the acceleration sensor 50Y that detects the acceleration orthogonal to the longitudinal direction of the camera 10 (Y direction), and the optical axis on the left side of the camera 10 An acceleration sensor 50Z that detects the acceleration in the direction (Z direction) is arranged, and detects the acceleration along each direction.
Thus, since the acceleration sensors 50X, 50Y, and 50Z are arranged, the respective acceleration sensors 50X, 50Y, and 50Z change according to the change in the posture of the camera 10, and thus the posture of the camera 10 is detected. In addition, when the camera 10 moves, it can be determined in which direction it has moved based on the acceleration signals at the start of movement t1 and the end of movement t2.
Next, shooting in the “request mode” in the present embodiment will be described with reference to FIG. When the camera requester 21 such as the owner of the camera 10 sets the request mode in advance and requests a person 22 who is nearby (see FIG. 4A), the person 22 who has received this request When the camera 10 is held (see FIG. 4B) and a stable state is obtained, a moving image is automatically taken. In this case, unless it is told that the video is automatically shot, the person 22 who has received the request thinks that it has been requested to shoot a still image, holds the camera 10, operates the release button when an appropriate composition is obtained, Generally, the camera 10 is returned to the photographing client 21 after the still image is completed. The request mode is based on such a movement.
FIG. 4C shows a subject image when the person 22 who has received the request points the camera 10 toward the photographing client 21 who is the subject, and T1 to T4 indicate compositions at time T1 to time T4. Yes. Between time T1 and time T3, since the person 22 who has received the request is in the process of framing with the camera 10, the composition is not stable. From time T3 to time T4, the movement of the camera 10 becomes smaller and the composition becomes stable.
When a still image is shot by operating a release button or the like after the start of moving image shooting, the person 22 who has received a request for shooting moves again to return the camera 10 to the shooting requester 21. As shown in FIG. 4D, the movement of the camera 10 at this time is small because it is in a state of being held from time T11 to time T12, but the movement of the camera 10 is large from time T12 to time T14. It becomes an unstable composition. Therefore, shooting of the moving image ends at the timing when the movement becomes large.
However, when the client 21 who is the subject moves and moves the camera 10, even if the movement of the camera 10 is large, the moving image shooting is continued. That is, as shown in FIG. 4E, when the client 21 moves from the left side to the right side from the time T5 to the time T8, the composition becomes unstable, but the client 21 always displays the subject image. In this case, the movie recording is continued.
Next, the operation when the requested mode described in FIG. 4 is executed will be described with reference to the flowchart shown in FIG. This flow is executed by the control unit 1 based on a program stored in advance. If the camera control flow is entered, it is first determined whether or not the requested mode is set (S1). As described above, when requesting a person nearby to shoot (see FIGS. 4A and 4B), the user sets the request mode. Since the request mode is set as one of the shooting modes on the menu screen, in this step, the set shooting mode is determined.
If the request mode is not set as a result of the determination in step S1, then a mode other than the request mode, for example, a normal shooting mode or a playback mode is executed, and the process returns to step S1 upon completion.
If the requested mode is set as a result of the determination in step S1, then the zoom is set to a wide angle, and the imaging operation, display, and face determination are performed (S2). In this step, the focal length of the zoom lens 2c is driven to the wide angle side, and the imaging operation by the imaging unit 2 is started. By setting the zoom lens 2c to a wide angle, the probability that the photographing client 21 who is the subject exists in the screen increases. And based on the image signal output from the imaging part 2, live view display is started on the display part 8, and a photographer performs framing by seeing this display. Further, the face detection unit 2a starts face determination based on the image signal, and determines whether or not a person's face is present in the captured image, and if there is, the position and size of the person.
Next, it is determined whether or not a release operation has been performed (S11). In this step, it is determined whether or not the release button of the operation unit 9 has been operated. If the result of this determination is that release operation has not been performed, it is next determined whether or not moving image recording is in progress (S21). Since the recording of the moving image is started in step S27, which will be described later, in this step, recording of the moving image has already been started and it is determined whether or not recording is in progress.
If the result of determination in step S21 is that video recording is not in progress, it is next determined whether or not a face has been detected (S22). In step S2, face determination by the face detection unit 2a is started, and in this step S22, it is determined whether or not a face is included in a subject image that changes every moment. If the result of this determination is that a face has not been detected, processing returns to step S11. On the other hand, if a face is detected as a result of the determination, the position of the face is recorded (S23). Here, the position of the face detected by the face detection unit 2 a is stored in the temporary storage area in the control unit 1.
Subsequently, it is determined whether or not the camera has moved (S24). Since the acceleration or the like applied to the camera 10 is detected by the posture determination unit 4, it is determined whether the camera 10 has moved based on the detection result. If the result of this determination is that the camera has not moved, it is next determined whether or not it has moved for 5 seconds (S25). As described with reference to FIG. 4C, when the movement of the camera 10 is stabilized (timing from time T3 to time T4), shooting of a moving image is started. In this step, whether or not the state of the camera 10 is stable is determined. Is judged. Although it is determined whether or not there is no movement for 5 seconds, it is only necessary to be able to determine whether or not the state of the camera 10 is stable. Therefore, the time is not limited to 5 seconds, and may be shorter or longer than this. . If the result of determination in step S25 is that there has been no movement for 5 seconds, processing returns to step S11. This is because the state of the camera 10 is not stable.
If the result of determination in step S24 is camera movement, it is next determined whether or not the change in face position is small (S26). As described above, when the subject is moving, the shooting direction of the camera 10 may move together with the subject (see FIG. 4E). In this case, moving image shooting may be performed. . In step S26, it is determined whether the amount of change in the position of the face detected by the face detection unit 2a is small enough to say that the subject is being tracked.
If the result of determination in step S26 is that the change in the subject's face position is small, or if the result of determination in step S25 is that the camera 10 has not moved for 5 seconds, video recording is started and shooting is in progress. (S27). Here, the image signal output from the imaging unit 2 is subjected to image processing by the moving image processing unit of the image processing unit 5, and the moving image data output here is recorded in the recording unit 6. If this step comes after starting the recording of the moving image, the recording of the moving image is continued. When step S27 is executed or when the result of determination in step S26 is that the face position change is not small, the process returns to step S11.
If the result of determination in step S11 is that a release operation has been performed, that is, if the release button has been pressed, then a representative still image is recorded (S12). Here, the image signal output from the imaging unit 2 is subjected to image processing by the still image processing unit of the image processing unit 5, and the image data of the still image output here is recorded in the recording unit 6.
Subsequently, the face position is updated (S13). In this step, the position of the face detected by the face detection unit 2a is updated. Once the face position has been updated, recording of the moving image is resumed (S14). Generally, before the release operation is performed, since the state of the camera 10 is stabilized toward the subject, recording of a moving image is started at this stable timing. During the recording of the moving image, the determination in step S11 becomes Yes, and when the representative still image is taken in step S12, the recording of the moving image is temporarily stopped. Therefore, when the recording of the representative still image is finished, the recording of the moving image is resumed in step S14. When the recording of the moving image is resumed, the process returns to step S11.
If the result of determination in step S21 is that movie recording is in progress, it is next determined whether or not the change in face position is large (S31). Here, based on the detection result of the face detection unit 2a, it is determined whether the face position has changed significantly. If the result of this determination is that the face position has not changed, processing returns to step S11. On the other hand, if the result of determination in step S31 is that the face position has changed significantly, it is next determined whether or not the camera 10 is fixed (S32). Here, the posture determination unit 4 determines whether or not the camera 10 is firmly held.
If the result of determination in step S32 is that the camera 10 has been fixed, it is next determined whether or not the face has gone out of the screen (S33). Here, the position of the face is detected by the face detection unit 2a, and it is determined whether the position of the face has gone out of the screen.
If the result of determination in step S33 is that the face has not gone out of the screen, processing returns to step S11. In this situation, the face position of the subject is moving with the camera 10 fixed, but the face position is still within the screen. Generally, this is a situation where the subject determines the shooting position before taking a still image, or when the subject starts moving after taking a still image, but the photographer still holds the camera 10. Regardless of the situation, moving image shooting is continued because an image can be enjoyed when recorded as a moving image.
If the result of the determination in step S33 is that the face has gone out of the screen, or if the result of determination in step S32 is that the camera 10 has not been fixed, recording of the moving image is then terminated and a display during shooting is displayed. The process ends (S34). If it is determined in step S32 that the camera 10 is not fixed, the position of the subject's face has changed greatly and the camera 10 is also moving. Since this is a scene in which the person 22 returns the camera 10 to the client 21, the recording of the moving image is terminated. If the face appears outside the screen in step S33, the camera 10 is fixed, but the client 21 who is the subject has gone outside the screen, so the recording of the moving image is terminated.
When the moving image recording is completed, it is next determined whether or not there is a moving image for one second or more (S35). In step S27, it is determined whether or not the time from the start of moving image recording to the end of moving image recording in step S34 is one second or longer. This time is a determination time for preventing a movie from being recorded in a short period of time, so it is not limited to 1 second, and if it can be enjoyed as a movie, it can be shorter or longer as appropriate. Also good.
If the result of determination in step S35 is that the movie time is less than 1 second, the image is deleted (S37). On the other hand, if the result of determination is that the moving image time is 1 second or longer, moving image recording is performed (S36). If the moving image recording from the start of recording in step S27 to the end of recording in step S34 is a temporary recording, the main recording is performed in the recording unit 6, and if the recording during this time is recorded in the recording unit 6, ,leave it as it is. If step S36 or S37 is processed, it will return to the original flow.
Next, in the request mode, a detection method when the camera requester 21 hands the camera 10 to the person 22 who receives the request will be described with reference to FIGS. 6 and 7. FIG. 6 shows temporal changes in detection outputs of the acceleration sensors 50X, 50Y, and 50Z in the posture determination unit 4. The time changes from time T11 when the camera 10 is not held to time T13 when the camera 10 is held via time T12 when the camera 10 is held.
At time T12 when the camera 10 is held from the state where the camera 10 is not held, the detection outputs of the acceleration sensors 50X and 50Z in the X direction and the Z direction hardly change, but the acceleration sensor 50Y in the Y direction (gravity direction). Outputs a signal indicating that it is shaking at a predetermined amplitude and a predetermined frequency. In the case where the camera 10 is held by hand, such a signal output is obtained when the camera 10 is held in the horizontal position due to the influence of camera shake.
As shown in FIG. 6, the handing of the camera 10 can be determined by determining the detection outputs of the acceleration sensors 50X, 50Y, and 50Z. However, the change in the detection signal differs depending on how to hand it over. For example, as shown in FIG. 7A, when the camera 10 is handed over while being slid in the horizontal position, the change of the acceleration sensor 50Y is not so large, and the change of the acceleration sensor 50X is large. Further, as shown in FIG. 7B, if the camera 10 is handed while being directed downward, the change in the acceleration sensor 50Z increases. Therefore, the determination may be made in consideration of various handing situations. In either case, it can be determined that the handing and the operation have been completed depending on whether the camera moves in the X direction and then stabilizes in the vertical direction (Y direction).
In the flowchart shown in FIG. 5, it is not explicitly stated that the detection outputs of the acceleration sensors 50X, 50Y, and 50Z are determined to determine the delivery to the person 22 who has received a request from the photographing client 21. However, if the request mode is set in step S1, the detection output of the acceleration sensors 50X, 50Y and 50Z is determined prior to the camera fixing determination in step S32, the camera is handed over and the operation is completed. May be determined.
As described above, in the first embodiment of the present invention, the camera 10 is in a stable state based on the posture determination by the posture determination unit 4 of the camera 10 and the face position change by the face detection unit 2a. If it is determined that the face position does not change, a video is taken. For this reason, the person 22 who has received the request can hold the camera 10 and can easily shoot a video without worrying about the timing of the start of shooting.
Next, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, when the camera 10 is in a stable state and a face is present on the screen, shooting of a moving image is started. However, in the second embodiment, the subject is also a person's facial expression. It is determined, and the main recording of the moving image is performed based on the determination result.
The shooting in the request mode in the second embodiment will be described with reference to FIG. FIG. 8A shows a scene in which the client 21a requests the person 22 to take a picture together with the accompanying persons 21b and 21c. When the person 22 who has received the request holds the camera 10 (see FIG. 8B), the companions 21b and 21c approach the client 21a and gather (see FIG. 8C). Therefore, when shooting a movie, the person 22 who has received the request holds the camera 10 and starts shooting when the client 21a or the like becomes a smiling face such as a smile (the captured image at this time is shown in FIG. 8). d)), and video capture is performed until the accompanying persons 21b and 21c come together and stop moving (see FIG. 8E for the captured image at this time). In order to produce an effect, a trimming process is performed by cutting out the screen (see FIG. 8F for an image at this time).
Note that this trimming process may be performed on the image when the person 22 who has received the request performs the release operation in addition to when the movement stops (in the flowchart described later, the image after the release operation is performed). Processing). Also in the present embodiment, as in the first embodiment, the client 21 only requests the shooting, and does not particularly notify that the moving image shooting is performed at that time. Since the recording of the moving image is started when the person 22 who has received the request has set up, it is possible to enjoy the movements of the shooting requester 21a, the accompanying persons 21b, 21c, etc. when shooting a still image during playback.
Since the configuration in the present embodiment for executing the request mode in this way is substantially the same as the block diagram of FIG. 1 described in the first embodiment, detailed description thereof is omitted. The camera control operation in this embodiment will be described with reference to the flowchart shown in FIG. This flow is executed by the control unit 1 based on a program stored in advance.
When the camera control flow is entered, first, as in step S1, it is determined whether or not the request mode is set (S41). If the result of this determination is that the mode is not the request mode, other modes are selected. Execute (S42), and when the process ends, the process returns to step S41. The flow other than the request mode in step S42 will be described later with reference to FIG.
If the result of determination in step S41 is the request mode, zooming is electrically driven to a wide angle, and imaging and display are started (S43). In this step, the focal length of the zoom lens 2c is driven to the wide angle side, and the imaging operation by the imaging unit 2 is started. By zooming the zoom lens 2c to the wide angle side, there is a high possibility that the photographer 21a and the like will enter the composition. Then, based on the image signal output from the imaging unit 2, live view display is started on the display unit 8, and the person 22 who has received the request can perform framing by viewing this display.
Subsequently, it is determined whether or not there is equipment movement (S44). Since the acceleration or the like applied to the camera 10 is detected by the posture determination unit 4, in step S44, based on the detection result of the acceleration or the like, under the situation shown in FIG. It is determined whether or not the device (camera 10) has moved by handing or the like. In the determination, as described with reference to FIGS. 6 and 7, the change in acceleration may be considered. If the result of this determination is that the device has moved, since the camera 10 is not in a stable state, the process returns to step S41 without starting moving image shooting.
If the result of determination in step S44 is that the device has not moved, it is next determined whether or not the top and bottom of the camera are correctly fixed (S45). Here, the posture determination unit 4 determines whether or not the camera 10 is in a stable state (see FIG. 8B).
If the result of determination in step S45 is that the top and bottom of the camera are not correctly fixed, it is next determined whether or not there is a moving image C (S46). The moving image C is a moving image that is captured for 0.5 seconds after the representative still image is captured in step S62 described later. If the result of this determination is that movie C has been recorded, processing returns to step S41. On the other hand, if the result of determination is that there is no video C, the target image (video A, video B) is deleted (S47). When the moving image C is recorded, the representative still image is captured. On the other hand, when the moving image C is not recorded, the representative still image is not captured. Here, since the representative still image captures the moment of determination, it is a highly satisfying image of Toshinkai for both the photographer and the subject. It is considered that the video until reaching the image with a high degree of completeness often includes moments that look similar to the representative still image, while the video that does not have a standard such as the timing of the still image taken indiscriminately In many cases, the videos are incomplete, unbearable for viewing, and have no fragmentary meaning. Therefore, when the series of moving images up to the representative still image is not formed, these moving images A and B are deleted. When the target image is deleted, the process returns to step S41.
If the result of determination in step S45 is that the top and bottom of the camera are correctly fixed, then continuous shooting is performed, and the moving image A at this time is temporarily recorded (S48). The reason for temporarily recording is to finally record only the last 0.5 seconds before the start of shooting of the moving image B in the amount described later. Subsequently, a person in the center is detected, and it is determined whether or not the position and expression are determined faces such as a smile (S51). In this step, it is determined whether or not there is a person in the center by the face detection unit 2a. If there is a person, it is determined whether or not the position and the face at that time are expressions of a determined face such as a smile.
If the result of the determination in step S51 is No, it is next determined whether or not there is an image A (movie A) 0.5 seconds before (S52). As a result of this determination, if the moving picture A before 0.5 seconds is not temporarily recorded, the process returns to step S41. Note that 0.5 seconds is an example, and it may be shorter or longer than this.
On the other hand, as a result of the determination in step S52, if the moving image A before 0.5 seconds is temporarily recorded, the target image (moving image A) is deleted (S53). The moving image A is a temporary image shot before moving image B, which will be described later, and is a moving image immediately before the central person becomes a fixed face. Since this movie A is not suitable for long-time playback, it was decided to record only for 0.5 seconds immediately before the start of shooting of movie B, and to delete the previous target image (movie A). When the target image is deleted, the process returns to step S41.
If the result of determination in step S51 is Yes, then video B is shot (S55) and recorded (S56). Here, the image signal output from the imaging unit 2 is subjected to image processing by the moving image processing unit of the image processing unit 5, and the image data of the processed moving image is recorded in the recording unit 6. Since the person in the center has become the determined face, the video starts at this point. This moving image B is continued until a representative still image is captured in step S62 described later.
Subsequently, as in step S51, a person in the center is detected, and it is determined whether or not the position and expression are determined faces such as a smile (S57). If the result of this determination is No, it is next determined whether or not it is a release operation (S58). Here, it is determined whether or not the release button in the operation unit 9 has been operated. If the result of this determination is that release operation has not been performed, processing returns to step S55 and recording of moving image B is continued.
If the release operation is performed as a result of the determination in step S58, or if the determination result in step S57 is Yes, the screen is then blacked out and front display is performed (S61). When the release operation is performed, the photographer is released from the stress of shooting and is likely to move the camera 10. Therefore, in step S61 and subsequent steps, the control shifts to the end of shooting. The front display in step S61 refers to intermittent light emission of an LED, strobe, or the like provided in front of the camera 10. The screen blackout and front display in this step are actually performed in the next step, but this is for the purpose of making the person 22 who has received the shooting request recognize that the shooting of the still image has ended.
Subsequently, the representative still image and the moving image C are recorded (S62). In the present embodiment, the recording timing of the representative still image is not limited to when the release button is operated, but is when the facial expression of the person at the center becomes the determined face. In this step, the image signal output from the imaging unit 2 is processed by the still image processing unit of the image processing unit 5, and the image data of this representative still image is recorded in the recording unit 6. In addition, after the representative still image is captured, the moving image C is recorded for 0.5 seconds. As with the moving image A, the moving image C is processed by the moving image processing unit of the image processing unit 5 and the image data of the moving image is recorded in the recording unit 6. In the present embodiment, the recording time is 0.5 seconds, but is an example, and may be longer or shorter than this. Also, the recording time is about 0.5 seconds, but during playback, slow motion or fast forward can be used, and the playback time is not 0.5 seconds.
Once the representative still image and the moving image C are photographed, the moving image D with the transition effect is photographed (S63). Here, the moving image D to which the transition effect is given is, for example, a moving image that has been subjected to trimming processing as shown in FIG. In addition to this, other processing such as fading out may be performed. The moving image C and the moving image D are images for moving image ending. When the moving image D is shot, the shooting ends.
Next, a flow other than the requested mode in step S42 will be described with reference to FIG. If the flow other than the request mode is entered, it is first determined whether or not the playback mode is set (S71). Since the playback mode is set by operating the playback button of the operation unit 9, it is determined in this step whether or not the playback button has been operated. If the result of this determination is not playback mode, then a mode other than the requested mode / playback mode is executed (S72). When this process ends, the original flow is restored.
If the result of determination in step S71 is playback mode, the final image is read out (S73). Here, the image data that was taken most recently and recorded in the recording unit 6 is read out. Subsequently, it is determined whether or not the read image data is an image photographed in the request mode (S74). If the result of this determination is that the image was shot in the request mode, a representative still image is used (S75). That is, an image shot in the request mode is composed of a moving image A, a moving image B, a representative still image, a moving image C, and a moving image D. When the final image is read, the representative still image is used. This is because the person 22 who has received the shooting request is not aware that the moving image has been shot and is satisfied by displaying a still image.
If it is determined in step S75 that the representative still image is to be used, or if the result of determination in step S74 is that the requested mode has not been reached, next, an enlarged image is displayed (S76). Here, the image data read in step S73 is enlarged and displayed. When shooting in the request mode, the representative image is used in step S75, and the representative image at this time is enlarged and displayed. Next, it is determined whether or not thumbnail display is performed (S77). When the operation member such as a zoom button is operated by the user in the reproduction mode, thumbnail display is performed. In this step, it is determined whether or not this operation member has been operated.
If the result of determination in step S77 is that an operation member for performing thumbnail display has been operated, thumbnail display is performed (S78). Here, the image recorded in the recording unit 6 is read out and displayed as a thumbnail. In this case, since the representative still image is used in step S75 for the image shot in the request mode, the thumbnail image data based on the representative still image is read and displayed.
Once thumbnail display has been carried out, it is next determined whether or not it has been selected (S79). In order to select an image from thumbnail images, the cursor is moved by the cross button and the OK button is operated. In this step, it is determined whether the image has been selected by the OK button. To do.
If the result of determination in step S79 is that it has not been selected, processing returns to step S77. On the other hand, if it is selected as a result of the determination, the selected still image is enlarged or the moving image is displayed (S80). Here, when the selected image is a still image, the image data of the still image is read out from the recording unit 6 and enlarged and displayed. If the selected image is a moving image, the image data of the moving image is read from the recording unit 6 and the moving image is reproduced. When shooting in the request mode, both moving image and still image data are recorded. In this step, the moving image is reproduced. When a still image or a moving image is reproduced, the process returns to step S77.
If the result of determination in step S77 is that the operation member for performing thumbnail display has not been operated, it is next determined whether or not the operation has been completed (S81). When ending the reproduction display, the user operates an operation member such as a reproduction button. In this step, it is determined whether or not an ending operation has been performed. As a result of this determination, if an end operation is performed, the playback mode is ended and the original flow is returned to.
If the result of determination in step S81 is not an end operation, it is determined whether or not to read the next image (S82). Here, it is determined whether or not a one-frame display advance or return operation has been performed by operating the cross button or the like, and the image data of the next image is read from the recording unit 6 in accordance with the determination result.
Once the next image has been read, it is next determined whether or not the read image is a moving image (S83). Here, it is determined whether the read image data is still image data or moving image data. If the result of this determination is a moving image, the moving image is played back (S84). Here, the moving image processing unit of the image processing unit 5 performs image processing for reproduction and displays the image on the display unit 8. If it is determined that the image is a still image, enlarged reproduction is performed (S85). Here, image processing is performed for reproduction by the still image processing unit of the image processing unit 5, and the still image is enlarged and displayed on the display unit 8. When moving image reproduction or enlarged reproduction is performed, the process returns to step S77.
As described above, in the second embodiment of the present invention, as a result of the determination by the posture determination unit 4 of the camera 10, the camera 10 is firmly held, and the central person detects the facial expression according to the detection result. The shooting of B is started. For this reason, the person 22 who has received the request can simply shoot the video without having to worry about the timing of the start of shooting simply by holding the camera 10, and can start shooting at the timing when the facial expression of the person is good. be able to.
In the present embodiment, the moving image A is temporarily recorded before the moving image B is recorded. For this reason, it is possible to enjoy the change to the decided face immediately before it becomes the decided face. Furthermore, in the present embodiment, the moving image C is recorded after the moving image B is recorded. For this reason, it is possible to enjoy facial expression changes when the tension after the release is released. Furthermore, since the moving image D to which the transition effect is added is photographed, the image is not suddenly ended when the moving image is reproduced, and an unnatural image is not generated.
In the present embodiment, a still image is taken even when the central person becomes a fixed face as a result of the determination in step S57. However, this step is omitted, and the still image is captured only during the release operation. You may make it photograph. Further, in the present embodiment, shooting was performed in the order of moving image A → moving image B → still image → moving image C → moving image D, but it is needless to say that moving image A, moving image C, and moving image D may be omitted.
Next, a third embodiment of the present invention will be described with reference to FIGS. In the first and second embodiments, there is a request mode in which the shooting requester 21 hands over the camera 10 to the person 22 and requests shooting. The third embodiment has a child mode in which a child automatically photographs itself by passing a camera to the child.
A camera capable of setting the child mode in the third embodiment will be described with reference to FIG. FIG. 11 is an external perspective view showing the external appearance of the camera 10 in the present embodiment, (a) is an external perspective view seen from the front side, and (b) is an external perspective view seen from the back side.
In front of the camera 10, a photographic lens 2d is arranged instead of the zoom lens 2c. The photographing lens 2d is a zoom lens having a variable focal length. A light emitting diode (LED) 3b constituting the warning unit 3 is arranged on the upper right of the photographing lens, and a strobe 3a constituting the warning unit 3 is further arranged thereon.
As will be described later, the LED 3b emits light in a random display pattern as shown in FIG. 11C in order to draw attention of the child when the child mode is set. In addition to this function, the strobe 3a emits illumination light when the subject has low brightness. In addition to this function, the strobe 3a is configured as shown in FIG. Light is emitted with a similar irradiation pattern.
In addition, a speaker 3c is disposed on the right side of the front of the camera 10, and this speaker 3c also functions as the warning unit 3. A microphone 3d is disposed above the speaker 3c. The microphone 3d collects sound and records it in order to record surrounding sounds during moving image shooting. The speaker 3c reproduces the ambient sound recorded at the time of shooting when reproducing the moving image, and when the child mode is set, the speaker 3c generates a sound pattern similar to that in FIG.
On the upper surface of the camera 10, a release button 9a constituting the operation unit 9 is disposed. Further, as shown in FIG. 11B, the display surface of the display unit 8 is disposed on the back surface of the camera 10. The display unit 8 performs live view display, playback display, and the like, as in the first embodiment. Further, a mode setting button 9b is disposed on the right side of the display unit 8, and a shooting mode such as a child mode can be set. Note that the “child mode” is a mode in which, when handed over to a child or the like, the child's attention is drawn and the photographing is automatically performed when the photographing lens 2d faces the child or the like.
The electrical configuration of the present embodiment is substantially the same as the block diagram of FIG. 1 described in the first embodiment, but the functions of the warning unit 3, the display warning control unit 1b, and the mode setting unit 1c are slightly different. The warning unit 3 in the present embodiment includes the strobe 3a, the LED 3b, and the speaker 3c described above. When the child mode is set, the child or the like is alerted based on the control signal from the display warning control unit 1b. Produces pronunciation, light emission, etc. The mode setting unit 1c can set the child mode. Since the configuration other than this is substantially the same as the block diagram of FIG. 1, detailed description thereof is omitted.
Next, photographing in the child mode according to the present embodiment will be described with reference to FIG. Here, an example is shown in which the mode setting button 9b is operated to set the child mode, and the child 31 is allowed to play with the camera 10 and then the child 31 takes a self-portrait.
First, when the child mode is set, a photograph 35 (see FIG. 12A) showing a child 31 and a mother 32 of about 2 to 3 years old is reproduced and displayed on the display unit 8 of the camera 10. As shown in FIG. 12B, the father 33 hands the camera 10 while showing the photograph 35 to the child 31 in a state where the photograph 35 is displayed on the display unit 8 of the camera 10. When the child 31 picks up the camera 10, the child 31 is interested in the camera 10 and is likely to play with the camera 10. At this time, when the strobe 3a or LED 3b of the camera 10 emits light and a sound is emitted from the speaker 3c, the child 31 is curious and wants to know what the camera 10 is like, and turns the camera 10 to play. .
While the child 31 is playing by turning the camera 10, the photographing lens 2 d may face the child 31. At this time, if the camera 10 starts moving image shooting, a moving image 36 as shown in FIG. 12D can be shot. The image at this time is very memorable to the parent as a record in which the child 31 is interested in the camera 10. In addition, when the photographing lens 2d faces the child 31 while the child 31 is playing, the moving image shooting starts automatically, so that no one can take a moving image without feeling stressed.
Next, the shooting operation in the child mode will be described with reference to the camera control flowchart shown in FIG. This flow is executed by the control unit 1 based on a program stored in advance.
If the camera control flow is entered, it is first determined whether or not the child mode is set (S101). Since the child mode is set by the mode setting button 9b, this step is determined based on the operation state of the mode setting button 9b. If the child mode is not set as a result of the determination, next, a mode other than the child mode is executed (S102). Here, it is determined whether various shooting modes other than the child mode, the playback mode, and the like are set, and processing is performed based on the determination result. When a mode other than the child mode is executed, the process returns to step S101.
If the child mode is set as a result of the determination in step S101, the photographed image is then displayed for 5 seconds (S103). Here, a photograph 35 as shown in FIG. 12A is displayed on the display unit 8. At this timing, the father 33 and the like may hand the camera 10 to the child 31 and the like. Note that 5 seconds is an example, and may be shorter or longer as long as it is suitable for the child 31 to see.
Once the captured image is displayed, the display is turned off, intermittent light emission is performed, and sound generation is started (S104). Here, the photograph 35 on the display unit 8 is erased, intermittent light emission is performed with the strobe 3a and LED 3b in a pattern as shown in FIG. 12C, and sound generation is performed with the speaker 3c in a similar pattern. As a result, the child 31 or the like has an interest in what has happened, and there is a high possibility of watching while turning the camera 10. In the present embodiment, both sound generation and light emission are performed, but either one may be used, and it is of course possible to attract the child 31 or the like by another method.
Subsequently, the zoom is set to a wide angle, and imaging and display are performed (S105). Here, the photographing lens 2d is driven to the wide angle side by electric zoom, and an image signal is obtained from the imaging unit 2, and a live view display is performed on the display unit 8. By setting the focal length to the wide angle side, the child 31 or the like is captured as a subject image. Since the child 31 and the like are in the stage of playing while turning the camera 10, the live view display may be turned off on the display unit 8.
Once the zoom is at a wide angle and imaging is started, it is next determined whether or not the device is moving (S106). Based on the detection result of the acceleration and the like by the posture determination unit 4, as shown in FIG. 12B, it is determined whether or not the device (camera 10) has moved from the father 33 to the child 31 or the like by handing or the like. .
If the result of determination in step S106 is that the device has moved, that is, if the camera 10 has been handed over from the father or the like to the child 31 or the like, then whether or not the camera has changed from downward to upward. Is determined (S107). Here, the posture determination unit 4 determines whether or not the camera 10 is directed upward from below, that is, whether or not the photographing lens 2d is directed toward the child 31 or the like.
If the result of determination in step S107 is that the camera 10 has not changed from downward to upward, or if the result of determination in step S106 is that there has been no movement of the device, then whether or not there is a video C Is determined (S108). Similar to the second embodiment, the moving image C is a moving image shot after representative still image shooting. In this step, it is determined whether or not the moving image C has been shot. If the result of this determination is that there is video C, processing returns to step S101.
On the other hand, if the result of determination in step S108 is that there is no moving image C, then the target image (moving image A, moving image B) is deleted (S109). When the moving image C is recorded, the representative still image is captured. On the other hand, when the moving image C is not recorded, the representative still image is not captured. Since these moving images are preferably a series of captured images up to the representative still image, when there is no moving image C as a result of the determination, the moving images A and B are deleted. When the target image is deleted, the process returns to step S101.
If the result of determination in step S107 is that the camera 10 has changed from downward to upward, next, continuous shooting (moving picture A) is provisionally recorded (S111). Since the camera 10 has changed from downward to upward, there is a high possibility that the child 31 or the like has pointed the photographing lens 2d toward his / her face, so that the temporary recording of the moving image A is started.
When the temporary recording of the moving image A is started, it is next determined whether or not the face is detected and the face is at a predetermined position and has a predetermined size (S112). Here, the face detection unit 2a determines whether or not the face position is approximately at the center of the screen, and the face size is a distance at which the camera 10 is held in the hand of the child 31 or the like. What is necessary is just to calculate the size of a face, the length of a hand, etc. based on the size of a general child.
If the result of the determination in step S112 is No, it is determined whether or not there is an image (moving image A) 0.5 seconds before, as in step S52 (S113). As a result of the determination, if the moving image A before 0.5 seconds is not temporarily recorded, the process returns to step S101. Note that 0.5 seconds is an example, and it may be shorter or longer than this.
On the other hand, if the result of determination in step S113 is that the moving image A before 0.5 seconds is temporarily recorded, the target image (moving image A) is deleted (S114). The moving image A is a temporary image taken before the moving image B, and is a moving image immediately before the child 31 or the like points the camera 10 toward his / her face. Since this movie A is not suitable for long-time playback, it was decided to record only for 0.5 seconds immediately before the start of shooting of movie B, and to delete the previous target image (movie A). When the target image is deleted, the process returns to step S101.
As a result of the face detection, if the face is at a predetermined position and has a predetermined size, the moving image B is next shot (S121) and recorded (S122). Here, the image signal output from the imaging unit 2 is subjected to image processing by the moving image processing unit of the image processing unit 5, and the image data of the processed moving image is recorded in the recording unit 6. If the result of determination in step S112 is Yes, since the taking lens 2d of the camera 10 is pointed at the child 31 or the like, the moving image is started at this point. This moving image B is continued until a representative still image is captured in step S126 described later.
When recording of the moving image B is started, next, a person in the screen is detected, its position is detected, and it is determined whether the facial expression is a determined face such as a smile (S123). Here, the position of the face of the child 31 or the like is detected by the face detection unit 2a, and the facial expression determination unit 2b determines whether or not the facial expression of the child 31 or the like is a determined face such as a smile. In the second embodiment, the client 21 to be photographed is assumed to be an adult. However, in the third embodiment, the child 31 and the like are assumed to be children. Make sure that the face is suitable for children, such as a cute expression.
If the result of determination in step S123 is No, it is next determined whether or not 5 seconds have elapsed since the start of shooting of moving image B (S124). If 5 seconds have not elapsed as a result of this determination, the process returns to step S121. Therefore, even if it is not a fixed face such as a cute smile, the video B is recorded as it is for 5 seconds. Note that 5 seconds is an example, and the viewer is bored if the face is not a fixed face for a long time, so long as it does not cause boredom.
If the result of the determination in step S123 is Yes, or if the result of determination in step S124 is 5 seconds, a representative still image is captured and an image capturing end process is performed. First, as in step S61, the screen is blacked out and front display is performed (S125). In blackout, the entire screen of the display unit 8 is darkened, and in the front display, the strobe 3a and the LED 3b are intermittently emitted. Thereby, it can be seen that the shooting of the still image is completed.
Subsequently, as in step S62, the representative still image and the moving image C are recorded (S126). In this step, the image signal output from the imaging unit 2 is processed by the still image processing unit of the image processing unit 5, and the image data of this representative still image is recorded in the recording unit 6. In addition, after the representative still image is captured, the moving image C is recorded for 0.5 seconds. As with the moving image A, the moving image C is processed by the moving image processing unit of the image processing unit 5 and the image data of the moving image is recorded in the recording unit 6. The recording time of the moving image C is 0.5 seconds in the present embodiment, but is exemplary, and may be longer or shorter than this. Also, the recording time is about 0.5 seconds, but during playback, slow motion or fast forward can be used, and the playback time is not 0.5 seconds.
Once the representative still image and the moving image C are photographed, the moving image D to which the transition effect is added is photographed similarly to step S63 (S127). Here, the moving image D to which the transition effect is given is, for example, a moving image that has been subjected to trimming processing as shown in FIG. 8F, a moving image that has been subjected to processing such as fade-out, or the like. The moving image C and the moving image D are images for moving image ending. When the moving image D is shot, the shooting ends.
As described above, in the present embodiment, when the child mode is set in the camera 10, when the photographing lens 2d of the camera 10 faces the child 31 or the like, first, as shown in FIG. .Shoot for 5 seconds, and if face determination is OK, shoot movie B for 5 seconds from that time (until that time if the face is determined), then take a representative still image. Then, the moving picture C is taken for 0.5 seconds, and the moving picture D that is finally subjected to image processing is taken. The main video shooting of the child 31 or the like is the video B, but the video A and video C are taken before and after that, and the end of the video is given out by the video D that has undergone image processing at the end. Yes.
Next, in the present embodiment, a display modification example will be described with reference to FIGS. 15 to 18 so that the child 31 and the like move the camera 10 so that the photographing lens 2d faces the child 31 and the like. In the present modification, the child 31 or the like easily moves the camera 10 by changing the image displayed on the display unit 8.
FIG. 15 is a diagram for explaining a display method in this modification, and FIG. 15A shows a state in which a photograph 35 is displayed on the display unit 8 of the camera 10. From this state, as shown in FIG. 15B, the photograph is shifted so that the photograph 35 appears to slide upward. In the camera 10, first, as shown in FIG. 15C, the display unit 8 faces upward, in other words, the photographing lens 2d faces downward. In this state, as shown in FIG. 15B, when the photograph 35 is shifted upward, the child 31 wonders what is on the upper side, turns the camera 10, and as shown in FIG. 15D. In addition, the photographic lens 2d faces upward. In this state, it is only necessary to start shooting a moving image as described above.
FIG. 16A is a modification of the photograph 35 in the display unit 8 illustrated in FIG. In this modification, the photograph 37 is image-processed so as to look like a cylinder. That is, although the screen of the display unit 8 is a flat surface, a photo 37 is obtained by performing image processing so that the photo 35 appears to be attached to the cylindrical side surface. Then, when the camera 10 is handed over to the child 31 or the like, the photograph 37 is displayed on the display unit 8 and, as shown in FIG. 16B, the photograph appears as if the cylinder is rotating. 37 is rotated. As a result, the child 31 or the like is interested in moving the camera 10 and turning around the camera lens 2d toward his / her direction.
Next, the operation of this modification will be described with reference to the flowchart of camera control shown in FIG. This flowchart has portions corresponding to steps S101 to S107 in the camera control flowchart in the third embodiment shown in FIG. 13, and the other portions are the same as the flowchart shown in FIG. doing.
When the camera control flow is entered, first, as in step S101, it is determined whether or not the child mode is set (S201). If the result of this determination is not child mode, the flow proceeds to a flow other than child mode in step S102. On the other hand, if the child mode is set, the image is displayed in a columnar shape (S202). Here, as shown in FIG. 16 and FIG. 18A, a photograph 37 that has been subjected to image processing so as to look like a cylinder is displayed.
Subsequently, the cylinder is rotated by changing the camera posture (S203). Here, a change in the posture of the camera 10 is detected by the posture determination unit 4, and an image that looks like a cylinder is rotated according to the detection result. That is, when it is detected that the camera 10 rotates around the direction orthogonal to the longitudinal direction of the camera 10, the photograph 37 is also rotated in this direction as shown in FIG. Further, the rotation speed of the photograph 37 is also increased according to the rotation speed of the camera 10.
Subsequently, it is determined whether or not the camera 10 is reversed (S204). Here, the posture determination unit 4 determines whether or not the direction is reversed so that the display unit 8 of the camera 10 faces the opposite side from the child 31 or the like side. If the result of this determination is that there is no inversion, the process proceeds to step S108 (see FIG. 13). On the other hand, if the result of the determination is reversed, the rotation is further accelerated (S205). This is because the rotation speed becomes faster and the child 31 and the like are more and more wondering so that the camera 10 is moved and rotated.
Next, it is determined whether or not it is self-portrait (S206). Here, image analysis is performed by the face detection unit 2a and the image processing unit 5, and it is determined whether or not the photographing lens 2d of the camera 10 faces the child 31 or the like and a self-shooting situation has been reached. If the result of this determination is that it was not self-portrait, processing proceeds to step S108. On the other hand, if the result of determination is self-portrait, then deformation is added to the image (S207). In this state, the child 31 and the like rotate around the camera 10, but the image processing unit 5 adds deformation to the image so as to further increase curiosity. Note that, as shown in FIG. 18B, other images may be synthesized, for example, by inserting an image taken by himself / herself.
Once deformation has been performed on the image, next, as in step S105, the zoom is set to a wide angle, and imaging and display are performed (S208). This widens the angle of view, so that the child 31 and the like can easily enter the composition. Subsequently, similarly to step S107, it is determined whether or not the taking lens 2d of the camera 10 has changed from downward to upward (S209). Here, the determination is made based on the detection result of the posture determination unit 4. If the result of this determination is that there has been no upward change, processing proceeds to step S108. On the other hand, if it changes as a result of the determination, the process proceeds to step S111 described above.
As described above, in the present modification, the display on the display unit 8 is changed as if the screen is moving according to the movement of the camera 10, so that the child 31 or the like moves the camera 10 and rotates the photographic lens. The possibility of turning 2d toward you increases. In addition, since the image processing is performed so that the display on the display unit 8 looks like a cylinder, the image is more realistic, and the child 31 and the like are more likely to move the camera 10 and point it in their own direction. .
As described above, in each embodiment of the present invention, the posture of the camera is detected by the posture determination unit 4 and a face image is detected, and the start and end of moving image recording are determined based on the detection results. ing. For this reason, it is possible to perform shooting without worrying about the timing of the start and end of moving image recording. In addition, the photographer does not feel the stress of movie shooting, and can enjoy shooting as if shooting a still image, and can enjoy the shot image without the intention of shooting. . Further, when the request mode is set, moving the camera can be started when the camera is held only by holding the camera toward the subject and the face is positioned in the screen. When the child mode is set, shooting of a moving image can be started when the camera is pointed at a child or the like and the face is positioned in the screen.
In each embodiment of the present invention, a still image is taken and recorded at a predetermined timing together with the recording of a moving image. However, the still image may be omitted. If the request mode is set and the still image shooting is omitted, a dummy shutter sound is generated or the screen is blacked out to prevent the requesting person from thinking that the shooting cannot be completed. May be performed.
In each embodiment of the present invention, a zoom lens is provided as a photographing lens, and when the request mode or the child mode is set, zooming to the wide-angle side is performed, but photographing at a focal length desired by the user is performed. In some cases, it may be desirable to shoot with the set focal length.
In each embodiment of the present invention, a digital camera has been described as an apparatus for photographing. However, the camera may be a digital single lens reflex camera or a compact digital camera, such as a video camera or a movie camera. It may be a camera for moving images, or may be a camera built in a mobile phone, a personal digital assistant (PDA), a game device, or the like. In any case, the present invention can be applied to any photographing device capable of photographing a moving image.
DESCRIPTION OF SYMBOLS 1 ... Control part, 1a ... Recording control part, 1b ... Display warning control part, 1c ... Mode setting part, 2 ... Imaging part, 2a ... Face detection part, 2b ... Expression determination unit, 2c ... zoom lens, 2d ... photographic lens, 3 ... warning unit, 3a ... strobe, 3b ... LED, 3c ... speaker, 3d ... microphone, DESCRIPTION OF SYMBOLS 4 ... Posture determination part, 5 ... Image processing part, 5a ... Trimming part, 6 ... Recording part, 7 ... Clock part, 8 ... Display part, 9 ... Operation part , 9a ... Release button, 9b ... Mode setting button, 10 ... Camera, 21 ... Requester of photography, 22 ... Requested person, 31 ... Child, 32 ... -Mother, 33 ... Father, 35 ... Photo, 36 ... Movie, 37 ... Photo, 50 ... Accelerometer, 50X-50Z ... Speed sensor, 51 ... metal portion, 51a ... base, 51b ... cross section, 51c ... movable part, 52a ... fixing metal part, 52 b ... fixing metal part
An imaging unit that converts the subject image into an image signal and outputs the image signal;
A recording unit that records image data based on an image signal output from the imaging unit;
In a photographing apparatus having
An attitude detection unit for detecting the attitude of the imaging device;
An image detection unit for detecting a face image included in the image signal;
A recording control unit that controls recording of the image data based on a detection result of the posture detection unit and a detection result of the image detection unit;
When the release switch is operated, the recording control unit performs still image and movie shooting control based on the image from the imaging unit, and the imaging device is stable as a result of detection by the posture detection unit. Alternatively, if the change in the face position is small as a result of detection by the image detection unit, the start of recording of the moving image data is determined.
The photographing apparatus according to claim 1, wherein the recording control unit records a moving image when image data of the moving image exists for a predetermined time or more.
If the recording control unit has started recording the moving image data before operating the release switch, the recording control unit resumes recording the moving image data after recording the still image data. On the other hand, if the recording of the moving image data has not started before the operation of the release switch, the recording of the moving image data starts after the recording of the still image data. The imaging apparatus according to claim 1, wherein:
The recording control unit, when it is determined that there is a movement of the imaging device based on the detection result of the posture detection unit, and the face position change is determined to be small based on the detection result of the image detection unit, 2. The photographing apparatus according to claim 1, wherein recording of moving image data is started.
The recording control unit starts recording the image data of the moving image when it is determined that the photographing apparatus has not moved for a predetermined time based on the detection result of the attitude detection unit. The imaging device according to claim 1.
A method of controlling an imaging apparatus having
An attitude detection step for detecting the attitude of the imaging device;
An image detection step of detecting a face image included in the image signal;
A recording control step for controlling recording of the image data based on the detection result in the posture detection step and the detection result in the image detection step;
In the recording control step, when the release switch is operated, still image and moving image shooting control is performed based on the image from the imaging unit, and the imaging device is stable as a result of the detection in the posture detection step. Alternatively, when the change in the face position is small as a result of detection in the image detection step, the start of recording of the moving image data is determined.
A computer program for an imaging apparatus having
In the recording control step, when the release switch is operated, still image and moving image shooting control is performed based on the image from the imaging unit, and the imaging device is stable as a result of the detection in the posture detection step. Or if the result of detection in the image detection step is a small change in face position, determine the start of recording of the video image data,
JP2014262047A 2014-12-25 2014-12-25 Image capturing apparatus, image capturing apparatus control method, and program Active JP5965981B2 (en)
JP2014262047A JP5965981B2 (en) 2014-12-25 2014-12-25 Image capturing apparatus, image capturing apparatus control method, and program
JP2013250513 Division 2009-09-16
JP2015109660A JP2015109660A (en) 2015-06-11
JP5965981B2 true JP5965981B2 (en) 2016-08-10
ID=53439684
JP2014262047A Active JP5965981B2 (en) 2014-12-25 2014-12-25 Image capturing apparatus, image capturing apparatus control method, and program
JP (1) JP5965981B2 (en)
JP6664066B2 (en) * 2016-12-27 2020-03-13 パナソニックＩｐマネジメント株式会社 Imaging device and control method thereof
JP4438099B2 (en) * 2007-11-22 2010-03-24 カシオ計算機株式会社 Imaging apparatus and program thereof
2014-12-25 JP JP2014262047A patent/JP5965981B2/en active Active
JP2015109660A (en) 2015-06-11
KR890003235B1 (en) 1989-08-27 Photographing device
CN103957357B (en) 2017-10-03 Camera
JP5495602B2 (en) 2014-05-21 Imaging apparatus and imaging method
TWI387322B (en) 2013-02-21 Image capturing apparatus, record medium and method for controlling image capturing apparatus
CN101742101B (en) 2012-12-12 Imaging apparatus and display control method in imaging apparatus
KR20070065299A (en) 2007-06-22 Image pickup device and image pickup method