Shooting apparatus and mode setting method for controlling a shooting mode of a shooting apparatus

A shooting apparatus includes: an image-pickup section outputting a picked-up image obtained by picking up an image of a subject; and a control section performing acceptance of a still image shooting operation and acceptance of a part specification operation of specifying a partial area of the picked-up image during video image pickup by the image-pickup section.

CROSS REFERENCE TO RELATED APPLICATION

This application claims benefit of Japanese Application No. 2011-189705 filed in Japan on Aug. 31, 2011, the contents of which are incorporated by this reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a shooting apparatus having a photo in movie mode and a multi-frame mode.

2. Description of the Related Art

Recently, a portable apparatus provided with a shooting function (a shooting apparatus) such as a digital camera is provided with various shooting functions, with free use of image processing. For example, Japanese Patent Application Laid-Open Publication No. 2010-268019 discloses a shooting apparatus having a function of combining and recording an image shot on the wide angle side in order to grasp the whole atmosphere and an image shot on the telephoto side in order to grasp an impressive moment and displaying the two images on one screen.

There are a lot of shooting apparatuses having not only a still image shooting function but also a video shooting functions. For example, a shooting apparatus provided with a so-called photo in movie function of shooting a still image during video shooting is widely known. Furthermore, there is also a shooting apparatus provided with a so-called reminiscence photo function of recording a still image and video before and after the still image by pressing a shutter button. Furthermore, there is also a shooting apparatus provided with a so-called multi-frame function of recording two kinds of videos, a video in a screen obtained by resizing the whole screen and a video in a partial screen, as videos.

SUMMARY OF THE INVENTION

A shooting apparatus according to an aspect of the present invention is provided with: an image-pickup section outputting a picked-up image obtained by picking up an image of a subject; and a control section performing acceptance of a still image shooting operation and acceptance of a part specification operation of specifying a partial area of the picked-up image during video image pickup by the image-pickup section.

A shooting apparatus according to another aspect of the present invention is provided with: an image-pickup section outputting a picked-up image obtained by picking up an image of a subject; a control section accepting a part specification operation of specifying a partial area of the picked-up image; and a recording section being controlled by the control section to record still images based on a whole image based on the picked-up image, a partial image based on the partial area of the picked-up image, a composite image with the whole image as the main image and a composite image with the partial image as the main image when a still image shooting operation is performed after the part specification operation.

A mode setting method according to an aspect of the present invention is a mode setting method for controlling a shooting mode of a shooting apparatus provided with an image-pickup section and a control section controlling the image pick-up section, the method including the steps of: the image-pickup section outputting a picked-up image obtained by picking up an image of a subject; the control section accepting a still image shooting operation during video image pickup by the image-pickup section; and the control section accepting a part specification operation of specifying a partial area of the picked-up image during video image pickup by the image pick-up section.

A mode setting method according to another aspect of the present invention is a mode setting method for controlling a shooting mode of a shooting apparatus provided with an image-pickup section, a control section controlling the image pick-up section and accepting a part specification operation of specifying a partial area of a picked-up image and a recording section, the method including the steps of: the recording section being controlled by the control section to record still images based on a whole image based on the picked-up image, a partial image based on the partial area of the picked-up image, a composite image with the whole image as the main image and a composite image with the partial image as the main image when a still image shooting operation is performed after the part specification operation.

The above and other objects, features and advantages of the invention will become more clearly understood from the following description referring to the accompanying drawings.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1is a block diagram showing a circuit configuration of a shooting apparatus according to a first embodiment of the present invention.

InFIG. 1, a shooting apparatus10has an image pickup section2configured by an image pickup device such as a CCD or CMOS sensor. The image pickup section2is configured so that aperture, focus, zoom and the like can be controlled by a signal processing/control section1, and is capable of performing image pickup corresponding to various compositions and subjects.

The image pickup section2is drive-controlled by the signal processing/control section1to shoot a subject and output a picked-up image. The signal processing/control section1outputs an image-pickup device drive signal to the image pickup section2and reads a picked-up image from the image pickup section2. The acquisition of the picked-up image is performed by a reading section1a. The rending section1agives the picked-up image read from the image pickup section2, to a temporary-recording-for-distribution section3.

The temporary-recording-for-distribution section3has a capacity for storing picked-up images from the image pickup section2for a predetermined time period. The temporary-recording-for-distribution section3stores and retains picked-up images (videos and still images) read from the image pickup section2.

The signal processing/control section1has image processing sections1band1cof two systems, which read and image-process a picked-up image recorded in the temporary-recording-for-distribution section3. The image processing sections1band1cperform predetermined signal processes, for example, color signal generation processing, matrix conversion processing and other various signal processes for an inputted image. Furthermore, the image processing sections1band1care configured to be also capable of performing various image processes such as resizing processing for resizing an inputted image and processing for generating an image of a partial area of an inputted image (hereinafter referred to as a partial image). Hereinafter, an image of the whole area of an inputted image will be referred to as a whole image irrespective of whether resizing processing has been performed therefor or not.

When an operation of specifying a partial area (hereinafter referred to as a specified partial area) of an inputted image (hereinafter referred to as a part specification operation) is performed by a user to generate a partial image, a characteristic judging section1dis given image information about the specified partial area from the image processing section1b. The characteristic judging section1djudges a feature value of a target subject such as a person's face and outputs a judgment result to a pursuit section1eas information about the target subject detected in the specified partial area. The pursuit section1epursues an area which includes a part where the feature value of the target subject matches in sequentially inputted input images and outputs a pursuit result to the image processing section1c. In this way, the image processing section1cis adapted to, when a target subject is specified by a part specification operation, be always able to pursue an image part which includes this target subject and generate the image part as a partial image.

Video images and still images from the image processing sections1band1care given to an image selecting section1f. The image selecting section1fselects an inputted video image and a still image, gives them to a display control section1gand also gives them to an S compression section1hand M compression sections1iand1j.

The display control section1gperforms display processing for giving the inputted video image and still image to a display section5to display them. The display section5is configured by an LCD or the like, and it displays the video image or still image given from the display control section1g.

On the other hand, the S compression section1hcompresses the inputted still image and gives it to a recording control section1k. The M compression sections1iand1jcompress the inputted video image and give it to the recording control section1k. The recording control section1kgives the compressed video image and still image to a recording section4to record them. The recording section4is controlled by the recording control section1kto record the compressed video image and still image which have been inputted. For example, a card interface can be adopted as the recording section4. The recording section4is capable of recording image information, voice information and the like to a recording medium such as a memory card.

The shooting apparatus10is also provided with an operation section6. The operation section6has various switches and buttons for setting of a shooting mode and the like. The operation section6generates an operation signal based on a user operation and provides the operation signal to the signal processing/control section1. For example,FIG. 1shows a video shooting operation section6aand a still image shooting operation section6bas an example of the operation section6. The video shooting operation section6ais for instructing video shooting. By the video shooting operation section6abeing operated, an operation signal for starting video shooting is provided for the signal processing/control section1. The still image shooting operation section6bis for instructing still image shooting. By the still image shooting operation section6bbeing operated, an operation signal for starting still image shooting is provided for the signal processing/control section1. The signal processing/control section1controls each section on the basis of the operation signal.

Furthermore, a touch panel can be also adopted as the operation section6. For example, by providing a touch panel as the operation section6, on a display screen of the display section5, an operation signal corresponding to a position on the display screen at which the user points with a finger can be generated. Thereby, the user can easily perform an operation of specifying a predetermined area in an image displayed on the display screen of the display section5as a specified partial area.

By controlling each section, the signal processing/control section1sets a shooting mode based on a user operation and realizes a shooting function corresponding to each shooting mode. In this case, the signal processing/control section1is adapted to be able to change the shooting mode only by operating the video shooting operation section6aand the still image shooting operation section6b.

Next, operations of the embodiment configured as described above will be described with reference toFIG. 2toFIGS. 7A and 7B.

First, description will be made on a photo in movie mode, a reminiscence photo mode and a multi-frame mode, which are shooting modes provided for the shooting apparatus of the present embodiment with reference toFIG. 2toFIGS. 5A and 5B.FIGS. 2 to 4are explanatory diagrams showing operations of the photo in movie mode, the reminiscence photo mode and the multi-frame mode, respectively.FIGS. 5A and 5Bare explanatory diagrams showing an example of an input image and a partial image. InFIGS. 2 to 4, respective frames of a video output11aof the reading section1a, which reads images from the image pickup section2, are indicated by successive rectangular frames.

In the photo in movie mode shown inFIG. 2, it is shown that a video11cobtained by resizing each of frames of the video output11ais provided for the M compression sections1iand1j. The M compression sections1iand1jperform compression processing of the inputted video11cto obtain a compressed video image. This compressed video image is recorded as a video in the photo in movie mode.

In the photo in movie mode, when the still image shooting operation section6bis operated by the user during video shooting, a still image11bof a frame corresponding to the still image shooting operation among the frames of the video output11ais given to the S compression section1h. The S compression section1hperforms compression processing of the inputted still image11bto obtain a compressed still image. This compressed still image is recorded as a still image in the photo in movie mode.

In the reminiscence photo mode shown inFIG. 3, each frame of the video output11ais temporarily recorded. In the reminiscence photo mode, when the still image shooting operation section6bis operated by the user during video shooting, the still image11bof a frame corresponding to the still image shooting operation among the frames of the video output11ais given to the S compression section1h. The S compression section1hperforms compression processing of the inputted still image11bto obtain a compressed still image. This compressed still image is recorded as a still image in the reminiscence photo mode.

On the other hand, frames before and after the still image11hare resized and then provided for the M compression sections1iand1jas a reminiscence video11drelated to the still image11b. The M compression sections1iand1jperform compression processing of the inputted reminiscence video11dto obtain a compressed video image. This compressed video image is recorded as a reminiscence video in the reminiscence photo mode.

In the multi-frame mode shown inFIG. 4, it is shown that a whole video11eobtained by resizing each of the frames of the video output11ais provided for the M compression sections1iand1j. The M compression sections1iand1jperform compression processing of the inputted whole video11eto obtain a compressed video image. This compressed video image is recorded as a whole video in the multi-frame mode.

FIG. 5Ashows an inputted image. In the example ofFIG. 5A, three persons A to C are shown in the inputted image. It is assumed that, in the multi-frame mode, the user performs a part specification operation of specifying a specified partial area which includes the face of the person A as shown by a broken-line area inFIG. 5A. Then, an image (partial image) of the specified partial area shown inFIG. 5Bis extracted from the inputted image. Furthermore, the partial image in the inputted image is pursued by the characteristic judging section1dand the pursuit section1e, and the partial image of the person A is extracted from each frame after that. Then, a partial video11fconstituted by the partial images of the respective frames of the video output11ais provided for the M compression sections1iand1j. The M compression sections1iand1jperform compression processing of the inputted partial video11fto obtain a compressed video image. This compressed video image is recorded as a partial video in the multi-frame mode.

Next, camera shooting control will be described with reference to a flowchart inFIG. 6.

When the shooting apparatus10is powered on by operating the operation section6, the signal processing/control section1starts display and temporary recording of a through image at step S1, That is, the signal processing/control section1drives the image pickup section2to shoot a subject. The reading section1areads out picked-up images from the image pickup section2and causes the temporary-recording-for-distribution section3to sequentially record the picked-up images. The temporary-recording-for-distribution section3sequentially records the images picked up for a predetermined time period.

The signal processing/control section1sequentially reads out the picked-up images recorded in the temporary-recording-for-distribution section3and gives the images to the image processing section1bor1c. The image processing section1bor1cperforms predetermined image signal processing on the picked-up images and then gives the images to the display control section1gvia the image selecting section1f. The display control section1ggives the inputted images to the display section5to cause the images to be displayed. In this way, a through image is displayed on the display screen of the display section5.

Next, the signal processing/control section1judges whether the still image shooting operation section6bhas been operated or not, at step S2. Furthermore, the signal processing/control section1judges whether the video shooting operation section6ahas been operated or not, at step S5.

In the present embodiment, the signal processing/control section1is adapted to set the reminiscence photo mode if it is judged at step S2that the still image shooting operation section6bhas been operated, and set the photo in movie mode if it is judged at step S5that the video shooting operation section6ahas been operated.

If it is judged at step S2that the still image shooting operation section6bhas been operated, the signal processing/control section1performs still image shooting in the reminiscence photo mode at step S3and performs reminiscence video recording in the reminiscence photo mode at step S4. That is, at a timing of operating the still image shooting operation section6b, the signal processing/control section1reads out a picked-up image (still image) acquired from the reading section1a, from the temporary-recording-for-distribution section3and gives the picked-up image to the image processing section1bor1c. The image processing section1bor1cperforms image processing of the inputted still image and provides it for the S compression section1hvia the image selecting section1f. The S compression section1hcompresses the inputted still image, and the recording control section1kgives the compressed still image to the recording section4to record it (step S3).

The signal processing/control section1reads out video images before or after the still image read out from the temporary-recording-for-distribution section3and gives the video images to the image processing section1bor1c. The image processing section1bor1cresizes the inputted video images to provide a reminiscence video to the M compression section1ior1jvia the image selecting section1f. The M compression section1ior1jcompresses the inputted reminiscence video, and the recording control section1kgives the compressed reminiscence video to the recording section4to record the video (step S4).

If it is judged at step S5that the video shooting operation section6ahas been operated, the signal processing/control section1performs video shooting in the photo in movie mode at step S6. The signal processing/control section1reads out video images sequentially recorded to the temporary-recording-for-distribution section3and gives the video images to the image processing section1bor1c. The image processing section1bor1cresizes the inputted video images and provides the images to the M compression section1ior1jvia the image selecting section1f. The M compression section1ior1jcompresses the inputted video in the photo in movie mode, and the recording control section1kgives the compressed video images to the recording section4to record the video images (step S6).

When the still image shooting operation section6bis operated in this photo in movie mode, the signal processing/control section1moves the process from step S7to step S8via step S16and performs still image shooting. That is, at a timing of operating the still image shooting operation section6b, the signal processing/control section1reads out a picked-up image (still image) acquired from the reading section1a, from the temporary-recording-for-distribution section3and gives the picked-up image to the image processing section1bor1c. The image processing section1bor1cperforms image processing of the inputted still image and provides it for the S compression section1hvia the image selecting section1f. The S compression section1hcompresses the inputted still image, and the recording control section1kgives the compressed still image to the recording section4to record it (step S8). In this way, still image recording in the photo in movie mode is performed.

If the operation of the still image shooting operation section6bat step S7is not detected in the photo in movie mode, the signal processing/control section1judges at step S9whether an end operation has been performed or not. If the end operation has not been performed, the signal processing/control section1moves the process to step S10to judge whether a part specification operation has been performed or not.

In the present embodiment, if a part specification operation occurs in the photo in movie mode, the mode transitions to the multi-frame mode. If the operation does not occur, the photo in movie mode continues. That is, if not detecting occurrence of a part specification operation at step S10at the time of the photo in movie mode, the signal processing/control section1judges at step S11that transition to the multi-frame mode has not occurred, returns the process to step S6to continue the photo in movie mode. If detecting occurrence of a part specification operation, the signal processing/control section1moves the process to step S12and sets the multi-frame mode.

In the multi-frame mode also, a whole image obtained by resizing an inputted image is recorded as a video, similarly to the time of the photo in movie mode. Therefore, even after transition to the multi-frame mode, the signal processing/control section1reads a video image from the temporary-recording-for-distribution section3, causes the image processing section1bto resize the video image to obtain a whole image, and gives the whole image to the M compression section1ior1jvia the image selecting section1fto compress the whole image. The recording control section1kcauses the recording section4to record the compressed whole image.

At the time of the multi-frame mode, the signal processing/control section1gives an image read from the temporary-recording-for-distribution section3to the image processing section1cto cut a partial image corresponding to a part specification operation. In this case, the image processing section1ccuts a specified partial area which includes a part image pursued by the pursuit section1e. In this way, a video image configured by the partial image is outputted from the image processing section1c, provided for the M compression section1ior1jvia the image selecting section1fto be compressed, and then the recording control section1kcauses the recording section4to record the compressed video image (step S13).

Furthermore, in the present embodiment, a whole image and a partial image are picture-in-picture displayed at the time of the multi-frame mode to improve convenience.FIGS. 7A and 7Bare explanatory diagrams for illustrating screen displays in the multi-frame mode, and an example in the case where the same inputted image asFIGS. 5A and 5Bhas been inputted is shown.

Now, it is assumed that the inputted image shown inFIG. 5Ais inputted to the image processing sections1band1c. In the example ofFIG. 5A, three persons A to C are shown in the inputted image. It is assumed that the user performs a part specification operation of specifying a specified partial area which includes the face of the person A as shown by the broken-line area inFIG. 5A. Then, an image (partial image) of the specified partial area indicated by the broken-line part inFIG. 5Ais extracted from the inputted image. Furthermore, the partial image in the inputted image is pursued by the characteristic judging section1dand the pursuit section1e, and an area which includes the partial image of the person A is specified as a specified partial area to the image processing section1c.

The image processing section1cpursues and cuts the partial image in accordance with an instruction of the pursuit section1e. The image processing section1cdirectly outputs the partial image shown inFIG. 5Bto the M compression section1ior1jvia the image selecting section1f, and, after combining the partial image with a whole image, outputs the composite image to the display control section1gvia the image selecting section1f.

That is, as shown inFIG. 7A, the image processing section1ccombines the whole image with the partial image so that a main image based on the whole image is arranged in a main display area5b, which is almost the whole area of a display screen5aof the display section5, and the partial image is arranged in a partial area (hereinafter referred to as a sub-display area)5cof the display screen5aas a sub-image. That is, in this case, the image processing section1ccauses the partial image to be a sub-image (step S12).

At the time of the multi-frame mode, the signal processing/control section1judges at step S14whether the user has touched the sub-display area5cor not. If the user has touched the sub-display area5c, the signal processing/control section1causes the current sub-image to be a main image and causes the current main image to be a sub-image at step S15.

FIG. 7Bshows this state. When the sub-display area5cis touched in the state ofFIG. 7A, the partial image, which is a sub-image displayed in the sub-display area5c, is displayed in the main display area5bas a main image, and the whole image, which is a main image displayed in the main display area5b, is displayed in the sub-display area5cas a sub-image. When the sub-display area5cis touched in the state ofFIG. 7B, the whole image, which is a sub-image displayed in the sub-display area5c, is displayed in the main display area5bas a main image, and the partial image, which is a main image displayed in the main display area5b, is displayed in the sub-display area5cas a sub-image. That is, the state returns to the display inFIG. 7A.

When detecting that the user has operated the still image shooting operation section6b, at step S7at the time of the multi-frame mode, the signal processing/control section1transitions to the photo in movie mode. Since this is a case of transition from the multi-frame mode to the photo in movie mode, the process transitions from step S16to S17, and still image shooting is performed.

In the present embodiment, immediately before the still image shooting at step S17, the whole image and the partial image are combined and displayed on the display screen5aof the display section5as shown inFIGS. 7A and 7B. Therefore, in still image shooting in the photo in movie mode at step S17, still images of all of the whole image, the partial image, and the composite images of the whole image and the partial image are recorded. That is, the whole images from the image processing section1band1care provided for the S compression section1hvia the image selecting section1fto be compressed, and then the recording control section1kcauses the recording section4to record the compressed whole image. The image processing section1ccuts a partial image, and the partial image is provided for the S compression section1hvia the image selecting section1fto be compressed, and then the recording control section1kcauses the recording section4to record the compressed partial image. The image processing section1cgenerates the composite images of the whole image and the partial image. That is, two composite images, a composite image in which the partial image is caused to be a sub-image and a composite image in which the whole image is caused to be a sub-image, are provided for the S compression section1hvia the image selecting section if to be compressed, and then the recording control section1kcauses the recording section4to record the compressed composite images. In this way, when the multi-frame mode transitions to the photo in movie mode by operating of the still image shooting operation section6b, four still images of the whole image, the partial image, and the two composite images configured by the whole image and the partial image are recorded.

As described above, in the present embodiment, by providing image processing sections of multiple systems and image compressing sections of multiple systems for temporarily recording a picked-up image and performing image processing of the inputted image which has been temporarily recorded and detecting an operation of a video shooting operation section and an operation of a still image shooting operation section, switching among the reminiscence photo mode, the photo in movie mode and the multi-frame mode is performed. Thereby, it is possible to shorten time required for transition to these shooting modes and shooting, and it becomes possible to perform certain shooting at the right moment to take a picture.

In the multi-frame mode, it is possible to display a composite image of a whole image and a partial image, which is advantageous in convenience. Furthermore, it is also advantageous that, when the multi-frame mode transitions to the photo in movie mode, still images of a whole image, a partial image, and composite images of the whole image and the partial image can be obtained by operating the still image shooting operation section.

FIG. 8is a block diagram showing a second embodiment of the present invention. InFIG. 8, the same components as inFIG. 1are given the same reference numerals, and description thereof will be omitted.

In the first embodiment, description has been made on the example in which, when the multi-frame mode transitions to the photo in movie mode, four still images of a whole image, a partial image, and two composite images configured by the whole image and the partial image are recorded. However, since a video image obtained by resizing an inputted image is also recorded at the time of the photo in movie mode, it is not necessarily possible to record all the four still images, depending on the recording capacity of the temporary-recording-for-distribution section, and the number of systems or processing capacity of the image processing sections and the image compressing sections. It is possible to record all the four still images if the still images to be recorded are retained in the temporary-recording-for-distribution section for a long time at the time of the photo in movie mode, and the still images to be recorded are read from the temporary-recording-for-distribution section after video recording ends. However, since the still images cannot be recorded immediately after operating the still image shooting operation section, it cannot be necessarily said that the first embodiment is excellent in convenience.

A shooting apparatus20inFIG. 8is different from the first embodiment in that a signal processing/control section21is adopted instead of the signal processing/control section1. An image processing section21b, an image processing section21c, an image selecting section21f, an S compression section21hand M compression sections21iand21jof the signal processing/control section21have functions similar to those of the image processing section1b, the image processing section1c, the image selecting section1f, the S compression section1hand the M compression sections1iand1j, respectively. However, they have only a capacity of processing a video image in almost real time. Therefore, each of the image processing sections21band21ccannot perform processing of two video images at the same time nor perform processing of a video image and a still image at the same time. Similarly, each of the S compression section21hand the M compression sections21iand21jcannot perform processing of two video images at the same time nor perform processing of a video image and a still image at the same time.

Therefore, in the case of using processing circuits of two systems as in the present embodiment, it is conceivable that it is possible to perform recording processing of only two video images at the same time, and that it is possible to perform recording processing of only one video image and one still image at the same time.

In the present embodiment also, the signal processing/control section21is capable of switching among the reminiscence photo mode, the photo in movie mode and the multi-frame mode in accordance with the flowchart inFIG. 6. However, even when the multi-frame mode transitions to the photo in movie mode by operating the still image shooting operation section6b, it is only possible to record one video image and one still image.

Therefore, in the present embodiment, the signal processing/control section21is adapted to select and record one video image and one still image according to a state of a partial image in a specified partial area being pursued. That is, the signal processing/control section21judges whether pursuit is successful or not. For example, if most of a partial image is included in a specified partial area being pursued, the signal processing/control section21judges that the pursuit is successful. In this case, the signal processing/control section21, for example, records a still image obtained from the partial image. If the state that most of the partial image is included in the specified partial area being pursued is not obtained, the signal processing/control section21judges that the pursuit is not successful and, for example, records a whole image as a still image.

Next, operations of the embodiment configured as described above will be described with reference toFIGS. 9A and 9BtoFIGS. 16A and 16B.FIGS. 9A and 9BtoFIGS. 11A and 11C, andFIGS. 16A and 16Bare explanatory diagrams for illustrating the operations of the present embodiment, andFIGS. 12 to 15are flowcharts for illustrating the operations of the present embodiment.

In the present embodiment, only operations performed when the multi-frame mode transitions to the photo in movie mode are different from those of the first embodiment. When the multi-frame mode transitions to the photo in movie mode, two video images, or one video image and one still image are outputted from the image processing sections21hand21c. The image processing section21cgives a video image to the M compression section21j. The image processing section21boutputs a video image or a still image. If the image processing section21boutputs a video image, the image selecting section21fgives the video image to the M compression section21i. If the image processing section21boutputs a still image, the image selecting section21fgives the still image to the S compression section21h.

FIGS. 9A and 9Bshow examples of a video image and a still image which can be recorded when the multi-frame mode transitions to the photo in movie mode.FIG. 9Ashows a state of, when the multi-frame mode transitions to the photo in movie mode by operating the still image shooting operation section6bin a state that a video image31abased on a whole image obtained by resizing an inputted image and a video image of a partial image31bof a specified partial area are recorded in the multi-frame mode, recording a still image31cobtained from the partial image31b. In this case, recording of the video image of the partial image31bis temporarily stopped, and the still image31cbased on the partial image31bis obtained.

On the other hand,FIG. 9Bshows a state of, when the multi-frame mode transitions to the photo in movie mode by operating the still image shooting operation section6bin a state that a video image32bbased on a whole image obtained by resizing an inputted image and a video image of a partial image32aof a specified partial area are recorded in the multi-frame mode, recording a still image32cobtained from the whole image. In this case, recording of the video image based on the whole image obtained by resizing the inputted image is temporarily stopped, and the still image32cbased on the whole image is obtained.

The processes inFIGS. 9A and 9Bare such that, when the still image shooting operation section6bis operated in the multi-frame mode, recording of one of two video images recorded in the multi-frame mode is temporarily stopped while recording of the other video image is continued to obtain a still image at the time point of operating the still image shooting operation section6b. From this point of view, the process can be said to be still image recording in the multi-frame mode rather than transition to the photo in movie mode. However, the examples inFIGS. 9A and 9Bare treated as transition from the multi-frame mode to the photo in movie mode for convenience of description.

It is also possible to continue only one of two video recordings at the time of the multi-frame mode, stop the other video recording, and perform still image recording of a source image of the one video recording. That is, in this case, it is possible to perform video recording of a resized whole image as well as performing still image recording of the whole image. It is also possible to perform video recording of a partial image of a specified partial area of an inputted image as well as recording the partial image as a still image.

FIGS. 10A to 10Cshow an example of a series of inputted images which are being shot when the multi-frame mode transitions to the photo in movie mode and show that a subject changes from a state ofFIG. 10Ato a state ofFIG. 10B, and then to a state ofFIG. 10C.FIGS. 10A to 10Cshow that three persons A to C have been shot as a subject, and that an area which includes the face of the person A among the persons is specified as a specified partial area.FIGS. 11A to 11Cshow partial images.FIGS. 11A to 11Cshow partial images in the specified partial area shown by broken lines in the inputted images inFIGS. 10A to 10C, respectively.

In the multi-frame mode, a video image based on a whole image obtained by resizing an inputted image and a video image of a partial image of a specified partial area in the inputted image are recorded. Now, it is assumed that a specified partial area36aindicated by broken lines is set in an inputted image35ashown inFIG. 10A. A pursuit section1eperforms pursuit even if the inputted image35achanges into inputted images35band35cand detects specified partial areas36band36c. In the multi-frame mode, video images based on whole images obtained by resizing the inputted images35ato35cand partial images37ato37c(FIGS. 11A to 11C) corresponding to the specified partial areas36ato36care recorded.

It is assumed that, for such inputted images, the multi-frame mode transitions to the photo in movie mode by the user operating the still image shooting operation section6bat a timing of the inputted image35b. In this case, if, for example, the recording method inFIG. 9Ais adopted, a partial image37bis recorded as a still image. If the recording method inFIG. 9Bis adopted, a whole image based on the inputted image35bis recorded as a still image.

Since the whole movement can be seen in the video images of the partial images35ato35cinFIGS. 10A to 10C, it is thought that it is better not to suspend shooting. As for the still image of the partial image37ainFIG. 11A, since the partial image of the specified partial area specified by the user occupies most of the screen, the subject matter is clear, and the still image is impressive. Therefore, in the example inFIGS. 10A to 10CandFIGS. 11A to 11C, it is better to continue video recording based on the whole images obtained resizing the inputted images, while stopping video recording of the partial images, and perform still image recording of the partial images.

However, though the area which includes the face of the person A is specified as a specified partial area inFIG. 10A, most of the partial image of the person A is not seen, being hidden by the person C, in the partial image37binFIG. 11B. Therefore, the partial image37bis thought to be a still image that does not satisfy the user. In the present embodiment, a video image and still image to be recorded are controlled in accordance with a result of pursuing a partial image.

FIG. 12shows the control by the signal processing/control section21.FIG. 12shows a process in the case of performing still image shooting during video shooting, especially at the time of the multi-frame mode, and shows a process performed at step S17inFIG. 6. When the multi-frame mode transitions to the photo in movie mode by operating the still image shooting operation section6b, the signal processing/control section21performs recording in accordance with the flow inFIG. 12. That is, at step S21, it is judged whether or not the multi-frame mode has transitioned to the photo in movie mode by operating the still image shooting operation section6b. If the multi-frame mode has not transitioned, the process is moved to steps S7and S8, still image shooting in the photo in movie mode is performed.

If the multi-frame mode has transitioned, the signal processing/control section21judges whether or not it is possible to pursue a partial video image, at step S22. In the present embodiment, in the case where most of a partial image is lost in a specified partial area, or the like, it is judged that pursuit is impossible even if pursuit processing by the pursuit section le is completely being performed.

If pursuit is possible, the signal processing/control section21performs video recording of a whole image obtained by resizing an inputted image, at step S23, and performs still image recording of the partial image at step S24. That is, the recording method inFIG. 9Ais adopted.

If pursuit is impossible, the signal processing/control section21performs video recording of the whole image obtained by resizing the inputted image, at step S25, and performs still image recording of the whole image at step S26. That is, in this case, video recording processing of the whole image obtained by resizing the inputted image is continued, video image recording of the partial image is stopped, and the whole image is recorded as a still image.

That is, since a video image from which the whole movement is seen is more enjoyable because a situation is known better therefrom, the signal processing/control section21continues the process for video recording of the whole image obtained by resizing the inputted image when the still image shooting operation section6bis operated in the multi-frame mode. On the other hand, the signal processing/control section21gives up causing the partial image to be a video image in a narrow angle of view, and the signal processing/control section21performs still image recording of the partial image if pursuit is possible and performs still image recording of the whole image if pursuit is impossible.

FIGS. 13 and 14show other controls by the signal processing/control section21. The control inFIG. 12is such that, if it is judged that pursuit of a partial image is impossible, a whole image is recorded as a still image. However, in the case where it is possible to display a main image and a sub-image on the display screen5aat the same time and specify any of a whole image and a partial image as the main image by a user's selection operation, as inFIGS. 7A and 7B, it is thought the user desires to record the main screen as a still image. Examples inFIGS. 13 and 14correspond to this case. InFIGS. 13 and 14, the same steps as inFIGS. 6 and 12, respectively, are given the same reference numerals, and description thereof will be omitted.

In a shooting apparatus which is not provided with a function of combining and displaying a main image and a sub-image in the multi-frame mode as shown inFIGS. 7A and 7B, control adopting the flowchart inFIG. 12is performed.

At step S41inFIG. 13, the pursuit section le of the signal processing/control section21starts pursuit of a partial image. The signal processing/control section21performs frame recording of a partial image to the temporary-recording-for-distribution section3. At step S43, the signal processing/control section21judges whether pursuit of the partial image is possible or not. If pursuit is possible, the signal processing/control section21clears the partial image frame-recorded, at step S44.

Therefore, when pursuit of the partial image becomes impossible, a frame image of the partial image in a pursuable state before pursuit becomes impossible is recorded in the temporary-recording-for-distribution section3.

FIG. 14shows a process in the case of performing still image shooting during video shooting, especially at the time of the multi-frame mode and shows a process performed at step S17inFIG. 6. InFIG. 14, the signal processing/control section21judges at step S31whether a whole image is a sub-image or not. That is, if the display inFIG. 7Bis shown by a user operation in the multi-frame mode, there is a possibility that the user thinks that a still image of a partial image is recorded by operating the still image shooting operation section6b. Therefore, when the whole image is a sub-image, the signal processing/control section21performs video recording of the partial image at step S32and performs still image recording of the partial image at step S33, if pursuit of the partial image is possible. If pursuit of the partial image is impossible, the signal processing/control section21performs video recording of the partial image at step S34and performs still image recording of the partial image at a pursuable timing at step S35. For example, in the example inFIGS. 10A to 10CandFIGS. 11A to 11C, a partial image shown inFIG. 11Ais recorded as a still image. Thereby, it is possible to record a video image and still image the user desires.

FIG. 15andFIGS. 16A and 16Bshow other controls by the signal processing/control section21. The controls inFIGS. 13 and 14are such that video recording and still image recording of an image specified as a main image are performed. However, it is also conceivable that the user wants to perform still image recording of a composite image of a main image and a sub-image displayed on the display screen5aas inFIGS. 7A and 7B. Examples inFIG. 15andFIGS. 16Aand16B correspond to this case. InFIG. 15, the same steps as inFIG. 14are given the same reference numerals, and description thereof will be omitted.

FIG. 15shows a process in the case of performing still image shooting during video shooting, especially at the time of the multi-frame mode and shows a process performed at step S17inFIG. 6. In the flow inFIG. 15also, the signal processing/control section21judges at step S31whether a whole image is a sub-image or not.

FIG. 16Ashows an example in which a whole image and a partial image has been combined so that a main image based on a whole image is arranged in a main display area42b, which is almost the whole area on a display screen41aof the display section5, and a partial image is arranged in a sub-display screen42con the display screen41aas a sub-image. Broken lines in the display screen41aindicate a specified partial area. On the other hand,FIG. 16Bshows an example in which a main image based on the partial image is arranged in the main display area42b, and a sub-image based on the whole image is arranged in the sub-display screen42c.

If the whole image is a sub-image as inFIG. 16B, the signal processing/control section21judges at step S22whether pursuit of the partial image is possible or not. If pursuit of the partial image is possible, the signal processing/control section21performs video recording of the partial image at step S32, and performs still image recording of a composite image with the partial image as a main image and the whole image as a sub-image at step S41.

FIG. 16Bshows a state in which pursuit of the partial image is impossible. In this case, the signal processing/control section21performs video recording of the partial image at step34, and performs still image recording of a composite image with the whole image as a main image and the partial image as a sub-image, that is, a composite image corresponding toFIG. 16Aat step S42.

If the whole image is not a sub-image, the signal processing/control section21performs video recording of the whole image obtained by resizing the inputted image at step S25, and performs still image recording of a composite image with the whole image as a main image and the partial image as a sub-image at step S42.

As described above, in the present embodiment, if it is only possible to record two video images, or one video image and one still image at the same time, a video image and still image to be recorded are determined in accordance with a result of pursuing a partial image. For example, a video image based on a whole image obtained by resizing an inputted image is recorded as a video image so that the whole movement can be seen. As a still image, a partial image in a specified partial area is recorded if pursuit of the partial image is possible, and the whole image is recorded if the pursuit is impossible. Thereby, an advantage similar to that of the first embodiment can be obtained, and shooting satisfying what the user desires is possible even in the case of a small-scale circuit.

In each of the above embodiments, multiple still images can be recorded at the same time. For example, in the first embodiment, when the multi-frame mode transitions to the photo in movie mode, up to four still images of a whole image, a partial image, and two composite images configured by the whole image and the partial image can be recorded. In this case, a recording section16can record the still images in association with one another.

FIG. 17is an explanatory diagram showing the outline of a configuration of a recording file of multiple still images recorded in association with one another by the recording section16(hereinafter referred to as a multi-image file). InFIG. 17, description will be made on the assumption that a whole image is a main picture, a partial image is a sub-picture1, a composite image with the whole image as a main image and the partial image as a sub-image is a sub-picture2, and a composite image with the whole image as a sub-image and the partial image as a main image is a sub-picture3. In each of the above embodiments, any of the still images recorded at the same time may be a main picture, and any of the still images may be a sub-picture in any position in order.

As shown inFIG. 17, in a multi-image file, one JPEG image data, which is a main picture, is stored at the top, and three JPEG image data, which are sub-pictures, are successively stored. A JPEG header is added to each of the JPEG image data. A pair of a JPEG header and JPEG image data is configured between an image start marker SOI and an image end marker EOI.

In the multi-image file with such a configuration, information about each of the sub-pictures stored in the file is stored in the JPEG header of the main picture stored at the top of the file. As the information about the sub-pictures, the total number of the sub-pictures, an identification number of each sub-picture (for example, what position in order in the multi-image file the sub-picture is located), a pointer to each sub-picture, a type of each sub-picture (for example, in which of the shooting modes the sub-picture has been obtained) are given as some examples.

In the present embodiment, it is assumed that the multi-image file is divided into multiple JPEG files. Therefore, the divided JPEG files can be processed by a conventional apparatus, software or the like that is not compatible with a multi-image file.

In the multi-image file shown inFIG. 17, main picture related information is included in the main picture JPEG header, and sub-picture related information is included in the sub-picture JPEG headers. The related information is information required to, after dividing the multi-image file into multiple JPEG files, reconstruct the multi-image file, for example, by performing editing processing and the like and combining the JPEG files.

As examples of information recorded in the main picture JPEG header as the main picture related information, there are an identifier for identifying that the image is an image constituting a file in the multi-image file format, an image identification number “0” indicating that the relevant image data is main picture data (Because identification numbers of the sub-pictures are 1, . . . , 4 here, the identification number “0” indicating the position of the main picture in order in the multi-image file is used as main picture identification information here. However, since any information that can identify that the image is the main picture is sufficient as the main picture identification information, other information, for example, “m”, the first letter of “main picture” may be recorded. Any other information may also be recorded, and main picture file information for identifying a divided sub-picture or a divided main picture (for example, a unique ID, the file name of the main picture file itself, or the like) (this main picture file information is same group identification information for identifying that main picture data and one or more sub-picture data belong to a same multi-image file) may be recorded.

On the other hand, as for the sub-picture related information in a sub-picture k JPEG header of a sub-picture k (k=1,. . . , 4), sub-picture k information recorded in the main picture JPEG header is referred to, and this sub-picture k information is basically copied and recorded. The reason why recording by copying is basically required is that, at the time of reconstructing the multi-image file from the group of divided images later, at least only the main picture JPEG header can be restored even if the JPEG file in which the main picture data is recorded does not exist. As for such information that copying is meaningless, it is not necessary to copy the information. For example, a pointer to a sub-picture is required in the multi-image file. However, since the pointer is recorded in another part in the JPEG header of a divided JPEG file, it is not necessary to copy the pointer. As examples of the sub-picture k information to be copied and recorded, the total number of sub-pictures, an identification number of each sub-picture (for example, what position in order in the multi-image file the sub-picture is located), a type of each sub-picture (for example, in which of the shooting modes the sub-picture has been obtained) are given.