Patent Description:
An anamorphic lens is used during image capturing to acquire a horizontally compressed image. An image captured using an anamorphic lens is then post-processed to horizontally extend the image, whereby an image of a subject having an appearance closer to the original appearance can be acquired. According to a technique discussed in <CIT>, a part of a compressed image is clipped and the clipped image is scaled at different magnifications in the vertical and the horizontal directions. However, problems may arise when using this technique when changing a recording frame rate.

In a case where a part of an image captured using an anamorphic lens is scaled as discussed in <CIT>, time for inputting a captured image may differ from time for writing the image for display. In <CIT> an image processing apparatus performs control to generate a first video signal containing a video image in which a first range in an acquired image is resized to have a predetermined aspect ratio if the image processing apparatus is in a first mode of acquiring an image of a recording target region, and generate a second video signal containing a video image in which a second range different from the first range in the acquired image is resized in such a manner that an aspect ratio of the recording target region contained in the second range after the resizing matches the predetermined aspect ratio if the image processing apparatus is in a second mode of acquiring an image containing a peripheral region.

In view of the above-described issues, the present invention is directed to provide a display control apparatus capable of displaying a captured image even in a case where a recording frame rate increases during moving image capturing using an anamorphic lens.

The present invention in its first aspect provides a display control apparatus as specified in claims <NUM> to <NUM>.

The present invention in its second aspect provides a method for controlling a display control apparatus as specified in claims <NUM>-<NUM>.

The present invention in its third aspect provides a computer program as specified in claim <NUM>.

An illustrative embodiment of the present invention will be described below with reference to the accompanying drawings.

<FIG> illustrates an example of an outer appearance of a video camera <NUM> as an example of a display control apparatus of the present invention.

The video camera <NUM> includes a lens unit <NUM> on the front, a user operation unit <NUM> (hereinafter referred to as an operation unit <NUM>) on the side, and a panel <NUM> on the top. The panel <NUM> is detachable from the main body of the video camera <NUM>. An external output unit <NUM> has a terminal, not detachable from the video camera <NUM>, for connecting to a display unit. The external output unit <NUM> is, for example, a High-Definition Multimedia Interface (HDMI®) or a Serial Digital Interface (SDI). The operation unit <NUM> is an operation member having a seesaw-shaped grip zoom 109a (zoom key) and various switches and buttons for receiving various operations from the user. The operation unit <NUM> is provided with a power switch for turning power ON and OFF, a menu button for displaying a menu screen, and a mode change switch for changing an operation mode. The mode change switch changes the operation mode of the video camera <NUM> between a still image recording mode, a moving image capture mode, and a reproduction mode.

<FIG> is a block diagram illustrating the video camera <NUM> according to the present exemplary embodiment. The lens unit <NUM> includes a fixed lens group for condensing light, a variable power lens group, a diaphragm, and a correction lens group having a function of correcting the image forming position that has moved by the movement of the variable power lens group and a function of performing focus adjustment. The lens unit <NUM> forms a subject image on the imaging plane of an image sensor <NUM> (sensor) (described below). The lens unit <NUM> is a component included in an interchangeable lens attachable to a lens attachment unit. An attached interchangeable lens does not necessarily include the above-described lens groups. An anamorphic lens (having a X2 compression ratio) can be attached to the lens attachment unit. The anamorphic lens optically reduces (squeezes) a subject image formed on the image sensor <NUM> by half in the horizontal direction. An anamorphic lens (having a <NUM>-time compression ratio) can be attached to the lens attachment unit. The anamorphic lens optically reduces (squeezes) a subject image by <NUM>/<NUM> in the horizontal direction. More specifically, the subject image is optically formed in a horizontally compressed state with respect to the vertical direction.

When a subject having a circular form is captured using an anamorphic lens, the captured subject image is optically compressed (squeezed) in the horizontal direction. Therefore, the subject image is formed on the image sensor <NUM> in a vertically oblong elliptic form and captured. While the subject is displayed in a vertically oblong elliptic form when the subject image is displayed without any processing, the subject image is restored to a circular form by desqueeze processing which is performed before display. The present exemplary embodiment will be described below centering on desqueeze display in a case where an anamorphic lens having a X2 compression ratio is attached on the video camera <NUM>. In a case where an anamorphic lens having other magnification is attached, the clipping range and the desqueeze magnification may be changed. Since distortion of the anamorphic lens is largely different between the center and both ends of the image, distortion may occur in the image in a case where image data acquired using an anamorphic lens is simply horizontally extended. Therefore, clipping the central area having less distortion or displaying black belts in the right- and left-hand sides' areas (belt-like display) is performed to display an image that is easy to be viewed for the user.

The image sensor <NUM> converts light into charges to generate an imaging signal. The generated imaging signal is output to an image processing unit <NUM>. The image sensor <NUM> is an imaging element, such as a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor. An image sensor in which each of all pixels on the imaging plane includes a pair of light-sensitive elements, what is called the dual pixel type, is also applicable. In an image sensor of this type, each pixel is capable of photoelectrically converting a pair of optical images formed by a micro lens using the pair of light-sensitive elements.

The image processing unit <NUM> converts an imaging signal input from the image sensor <NUM> into RAW data (RAW image). Then, the image processing unit <NUM> performs RAW development processing, such as interpolation processing and image quality adjustment processing, on the RAW data to generate YUV format image data corresponding to the RAW data and stores the image data in a random access memory (RAM) <NUM>.

A display resizing circuit <NUM> performs resizing processing and desqueeze processing (described below) on the YUV format image data stored in the RAM <NUM> to generate display image data and stores the display image data in the RAM <NUM>.

A recording resizing circuit <NUM> performs resizing processing on the YUV format image data stored in the RAM <NUM> to generate recording image data and stores the recording image data in the RAM <NUM>.

A bus <NUM> is a data bus for enabling the blocks of the video camera <NUM> to exchange data with each other. The blocks of the video camera <NUM> exchange data with each other via the bus <NUM>.

An on-screen display (OSD) generation circuit <NUM> stores OSD data, such as various setting menus, titles, and time, in the RAM <NUM>. The stored OSD data is combined with the display image data stored in the RAM <NUM>. The combined data is displayed on the panel <NUM> as a display unit and output to the outside via the external output unit <NUM>.

The panel <NUM> is a display panel, such as a liquid crystal panel and an organic electroluminescence (EL) panel. The panel <NUM> displays display image data and OSD data.

A system control unit <NUM> controls the entire video camera <NUM>.

The operation unit <NUM> is used by the user to input an operation. The operation unit <NUM> is provided with a switch for selecting a mode from among a camera mode mainly performing image capturing, a reproduction mode for mainly reproducing an image, and a power off mode for turning power OFF. The grip zoom 109a is a zoom key for changing the display magnification of a captured image.

A read only memory (ROM) <NUM> is a nonvolatile recording medium storing a program that is executed by the system control unit <NUM>. The ROM <NUM> includes, for example, a Flash ROM. Alternatively, program data stored in a recording medium <NUM> may be loaded into the RAM <NUM> for use as a ROM. The area in the ROM <NUM> is partly used for backup to maintain system statuses.

The RAM <NUM> is a volatile memory that is used by the system control unit <NUM> as a work area. The RAM <NUM> is also used by the image processing unit <NUM>, and a compression and decompression circuit <NUM> as a work area.

A medium control unit <NUM> records moving image data, which is generated by the compression and decompression circuit <NUM> and output to the RAM <NUM>, in the recording medium <NUM> according to a computer-compatible format, such as the File Allocation Table (FAT) file system. The recording medium <NUM> is detachable from the video camera <NUM>, and is attachable to a personal computer (PC) in addition to the video camera <NUM>.

The compression and decompression circuit <NUM> performs Moving Picture Experts Group (MPEG) compression (encoding) on the image data stored in the RAM <NUM> to generate moving image data and outputs the moving image data to the RAM <NUM>.

The external output unit <NUM> is an external output unit, such as an HDMI and SDI. The external output unit <NUM> outputs the display image data, output to the RAM <NUM> by the image processing unit <NUM>, to an external display unit 115a, for example. The external output unit <NUM> can output display image data using 4K60P and 2K60P signals, for example.

First desqueeze processing according to the present exemplary embodiment will be described below with reference to <FIG> and <FIG>.

<FIG> illustrates an image data flow diagram from image capturing by the video camera <NUM> to image display or recording. The description will be given on the premise that the lens unit <NUM> is an anamorphic lens having a compression ratio of <NUM>:<NUM> (vertical to horizontal directions).

An image of a subject <NUM> is captured by the video camera <NUM>. The captured image of the subject <NUM> is formed on the image sensor <NUM> as an image <NUM> which is compressed at an aspect ratio of <NUM>:<NUM> by the lens unit <NUM>. An imaging signal photoelectrically converted from the formed image is input to the image processing unit <NUM> and stored as image data <NUM> in the YUV format in the RAM <NUM>. On the image data <NUM> in the YUV format stored in the RAM <NUM>, first desqueeze processing (described below) is performed by the display resizing circuit <NUM> and the resultant data is stored as display image data <NUM> in the RAM <NUM>. The stored display image data <NUM> is output to the outside using, for example, an HDMI terminal, via the external output unit <NUM> and then displayed as an image <NUM>.

The image data <NUM> in the YUV format is input to the compression and decompression circuit <NUM> as recording image data <NUM> that has been resized to a recording size by the recording resizing circuit <NUM>. The recording image data <NUM> is compressed by the compression and decompression circuit <NUM> and recorded in the recording medium <NUM> via the medium control unit <NUM> as moving image data <NUM>.

<FIG> illustrates the first desqueeze processing performed by the display resizing circuit <NUM>.

The left-hand side of <FIG> illustrates an example of the image data <NUM> in the YUV format (acquired by the display resizing circuit <NUM>) to be input to the display resizing circuit <NUM>.

The description will be given on the premise that the image data <NUM> in the YUV format has a width W and a height H. The display resizing circuit <NUM> clips a clipping range <NUM>, which is a range from <NUM>/<NUM> to <NUM>/<NUM> of the width of the image data <NUM> from the left-hand side and a height H, and performs the scaling processing at different magnifications in the vertical and the horizontal directions. By the scaling processing in which a horizontal magnification (magnification ratio in width) is twice the vertical magnification (magnification ratio in height), the resultant display image is horizontally extended twice in comparison with a display image of a case where the original image <NUM> is displayed without the scaling processing. The subject image horizontally compressed by the lens unit <NUM> in comparison with the actual appearance of the subject is horizontally extended twice, and consequently, the subject image is restored to the original appearance of the subject. Desqueeze processing using the horizontal magnification ratio twice the vertical magnification ratio in this way is referred to as first desqueeze processing (first resizing). The image data generated in the first desqueeze processing is like the display image data <NUM> illustrated in on the right-hand side of <FIG>. By the first desqueeze processing, the display image data <NUM> is generated using a half of the width of the image data <NUM> in the YUV format input to the display resizing circuit <NUM>. This is because, according to the present exemplary embodiment, the horizontal compression magnification by the lens unit <NUM> is X2. However, the size of the clipping range <NUM> is not limited thereto for other magnifications. The image data <NUM> in the YUV format is horizontally scanned and input to the display resizing circuit <NUM> on a line basis. When one line of width W is input to the display resizing circuit <NUM> in the input time period T, the clipping range <NUM> is input in an input time period <NUM>/<NUM> * T. Therefore, the time for writing one line of the display image data <NUM> needs to be <NUM>/<NUM> * T or less.

When time for generating display image data is longer than input time, the following issues may arise: a time period from the imaging timing to the display timing is prolonged, a captured image for each frame is not to be displayed, and incomplete display image data is output. Therefore, it is necessary to generate one line of the display image data <NUM> in the time period <NUM>/<NUM> * T. Since performance of the display resizing circuit <NUM> is limited, when a time usable for generating display image data (i.e., the time period <NUM>/<NUM> * T) is shortened, generation of the display image data <NUM> may be not completed in time.

The time period T depends on the frame rate of the video camera <NUM>. More specifically, time usable for resizing processing decreases with increase in frame rate, and consequently, display processing may not be completed in time.

Second desqueeze processing will be described below with reference to <FIG>. The image data flow diagram from image capturing by the video camera <NUM> to input to the display resizing circuit <NUM> is similar to that illustrated <FIG>, and redundant description thereof will be omitted.

On the image data <NUM> in the YUV format stored in the RAM <NUM>, the display resizing circuit <NUM> performs second desqueeze processing or second resizing (described below) and the resultant image data is stored as display image data <NUM> in the RAM <NUM>. The stored display image data <NUM> has black belts arranged at the upper and lower portions and output to the outside via the external output unit <NUM> such as an HDMI, whereby the image <NUM> is displayed.

Similar to the flow diagram illustrated in <FIG>, the image data <NUM> in the YUV format is input to the compression and decompression circuit <NUM> as recording image data <NUM> resized to a recording size by the recording resizing circuit <NUM>. Then, the recording image data <NUM> is compressed by the compression and decompression circuit <NUM> and recorded as moving image data <NUM> in the recording medium <NUM> via the medium control unit <NUM>.

The second desqueeze processing will be described below with reference to <FIG> is a diagram illustrating the second desqueeze processing that is performed by the display resizing circuit <NUM>.

The left-hand side of <FIG> illustrates an example of the image data <NUM> in the YUV format that is input to the display resizing circuit <NUM>. Similar to <FIG>, the description will be given on the premise that the image data <NUM> in the YUV format has a width W and a height H. The display resizing circuit <NUM> performs the desqueeze processing on a range of the width W and the height H of the image data <NUM> in the YUV format. In this processing, scaling is performed at different magnifications in the vertical and the horizontal directions. Unlike the first desqueeze processing illustrated in <FIG> and <FIG>, the vertical magnification ratio is a half of the horizontal magnification ratio in the second desqueeze processing. By the scaling at a vertical magnification (magnification ratio in height) that is a half of the horizontal magnification (magnification ratio in width), the resultant display image is vertically compressed in comparison with a display image of a case where the original image <NUM> displayed without the scaling processing. Accordingly, the subject image which is horizontally compressed by the lens unit <NUM> in comparison with the actual appearance of the subject is vertically compressed by half. As a result, the subject image is restored to the original appearance of the subject. The above-described method for causing the horizontally compressed subject image to be the original appearance of the subject by vertically compressing the input image without horizontally clipping the input image (without horizontally clipping the image data in the YUV format) is referred to as the second desqueeze processing. The generated image data by this processing is the display image data <NUM> illustrated on the right-hand side of <FIG>. Since the image data <NUM> in the YUV format and the display image data <NUM> are not horizontally clipped, the input time period T during which one line is input to the display resizing circuit <NUM> becomes available for time for writing one line of the display image data <NUM>. In an example case where a line for <NUM> pixels is input in the time period T, and in a case where the first desqueeze processing is performed, display data for <NUM> pixels needs to be written in the time period <NUM>/<NUM> * T since a half of the image data is clipped. On the other hand, by the second desqueeze processing, in a case where one line for <NUM> pixels is input in the input time period T, the time period T becomes available for writing the display data.

However, the size of the display image after the second desqueeze processing is smaller than that after the first desqueeze processing. Therefore, in terms of the user requiring large image display, the first desqueeze processing has image visibility higher than that of the second desqueeze processing.

The display image data <NUM> is not displayed as it is. The display image data <NUM> is supplied with black belts at the upper and lower portions (side black processing) as illustrated in <FIG>, i.e., the image <NUM> is displayed.

Display processing according to the present exemplary embodiment will be described below with reference to <FIG>. Each piece of processing in the flowchart illustrated in <FIG> is implemented when the system control unit <NUM> configuring the video camera <NUM> executes a program stored in the RAM <NUM>. In step S601, the system control unit <NUM> controls the image sensor <NUM> to capture the image by photoelectrically converting the image of the subject <NUM> formed on the image sensor <NUM> via the lens unit <NUM> to generate an imaging signal, and inputting the imaging signal to the image processing unit <NUM>. In this processing, the image <NUM> as the subject image acquired via the lens unit <NUM> is horizontally compressed in comparison with the actual appearance of the subject.

In step S602, the system control unit <NUM> controls the image processing unit <NUM> so as to perform image processing, this includes converting the imaging signal into RAW data (RAW image). Then, the image processing unit <NUM> performs RAW development processing, such as interpolation processing and image quality adjustment processing, on the RAW data to generate the image data <NUM> in the YUV format corresponding to the RAW data, and stores the image data <NUM> in the RAM <NUM>. <FIG> illustrates the subject <NUM> of which image is captured by the video camera <NUM> and the image data <NUM> in the YUV format. By the lens unit <NUM>, an image of the subject <NUM> is captured as horizontally compressed image data.

In step S603, the system control unit <NUM> determines whether a desqueeze display of the video camera <NUM> is ON or OFF. If the desqueeze display is ON, desqueeze processing (first desqueeze processing or second desqueeze processing) is performed. On the other hand, if the desqueeze display is OFF, the desqueeze processing is not performed. The user can set the desqueeze display to be ON or OFF by operating the operation unit <NUM> based on menu information displayed on the panel <NUM>. In a case where the system control unit <NUM> determines that the desqueeze display is ON (YES in step S603), the processing proceeds to step S604. On the other hand, in a case where the system control unit <NUM> determines that the desqueeze display is OFF (NO in step S603), the processing proceeds to step S612.

In step S604, the system control unit <NUM> determines whether the video camera <NUM> is in an imaging setting variable frame rate mode. The variable frame rate mode is a shooting mode in which the user can change the imaging frame rate of the video camera <NUM> by using the operation unit <NUM>. For example, in a case where the user sets <NUM> fps, the video camera <NUM> captures a moving image at <NUM> fps. In a case where the user sets <NUM> fps, the video camera <NUM> captures a moving image at <NUM> fps. The variable frame rate mode also enables the user to change the reproduction speed at reproducing an image. In this way, the variable frame rate mode enables the user to record a moving image in a slow mode and intermittently record time-sequential changes (fast recording), such as nature observation (both recording modes are collectively referred to as Slow & Fast Motion). In a case where the system control unit <NUM> determines that the video camera <NUM> is in the variable frame rate mode (YES in step S604), the processing proceeds to step S605. On the other hand, in a case where the system control unit <NUM> determines that the video camera <NUM> is not in the variable frame rate mode (NO in step S604), the processing proceeds to step S608. In the variable frame rate mode, increase in the frame rate setting may cause failure of completion of the above-described first desqueeze processing in time at frame rates above a certain frame rate.

In step S605, the system control unit <NUM> determines whether the desqueeze display is ON or OFF in the variable frame rate mode settings in the video camera <NUM>. The user can set the desqueeze display to be ON or OFF in the variable frame rate mode settings by operating the operation unit <NUM> based on the menu information displayed on the panel <NUM>. In a case where the system control unit <NUM> determines that the desqueeze display is ON in the variable frame rate mode settings (YES in step S605), the processing proceeds to step S606. On the other hand, in a case where the system control unit <NUM> determines that the desqueeze display is OFF (NO in step S605), the processing proceeds to step S607. While the system control unit <NUM> determines whether the recording setting is the variable frame rate mode in step S605, the processing is not limited thereto. The system control unit <NUM> may make the YES determination in step S605 in a case where a predetermined condition is satisfied (e.g., the recording frame rate of a moving image or the resolution of a moving image is more than or equal to a predetermined value).

In steps S606 and S613, the system control unit <NUM> performs processing for the display illustrated in <FIG>.

In step S606, the system control unit <NUM> performs the second desqueeze processing to generate the display image data <NUM>. This may include generating vertically reduced image data.

In step S613, the system control unit <NUM> controls the display resizing circuit <NUM> to perform the side black processing on the display image data <NUM> generated in step S606 to generate the image <NUM>, and displays the image <NUM>. The side black processing is performed to adjust the angle of view to the display image data <NUM> processed by the first desqueeze processing. In a case where the user sets to display an image with the aspect ratio of the cinema scope, clipping is performed to obtain the aspect ratio of the cinema scope in the first desqueeze processing, and the image is displayed. More specifically, as a result of resizing, clipping is performed to obtain the aspect ratio of the cinema scope. On the other hand, in the second desqueeze processing, the display image data <NUM> includes regions out of the range displayed in the first desqueeze processing. The aspect ratio of the display image data <NUM> is also different from that of the display image data <NUM> obtained by the first desqueeze processing. Therefore, in step S613, the system control unit <NUM> performs display processing for arranging side black belts to the right- and left-hand sides of the display image data <NUM>, so that the display unit 115a can display an image with the aspect ratio set by the user, i.e., the aspect ratio of the cinema scope. In step S613, the system control unit <NUM> turns ON a reduction desqueeze flag indicating that vertical reduction processing and the side black processing have been performed. In a case where the frame rate is low in the variable frame rate mode, the display processing may be completed in time even when the first desqueeze processing is performed. Therefore, the system control unit <NUM> may perform the second desqueeze processing in a case where the frame rate is greater than a threshold value, and perform the first desqueeze in a case where the frame rate is less than the threshold value. However, in a case where the display for the first desqueeze processing and the display for the second desqueeze processing are changed because of a change in the frame rate mode performed by the user in the same shooting mode, the image visibility will change in the same shooting mode. Therefore, in the variable frame rate mode, the system control unit <NUM> performs the second desqueeze processing when desqueeze display is set, regardless of the setting of the frame rate setting. This enables stable image display without frequent changes in size of the image displayed for checking by the user. While the present exemplary embodiment has been described above centering on the use of the aspect ratio of the cinema scope, the aspect ratio is not limited thereto, and may be other values such as <NUM>:<NUM> and <NUM>:<NUM>.

In step S607, the system control unit <NUM> controls the display resizing circuit <NUM> to generate display image data based on the image data <NUM> in the YUV format for full angle of view. As illustrated in <FIG>, this resizing processing generates display image data <NUM> without converting the aspect ratio.

The processing in steps S608 to S610, which is display processing for a high image resolution, not in the variable frame rate mode, will be described below.

In step S608, the system control unit <NUM> determines whether the external output unit <NUM> outputs image data having the <NUM> image resolution and the <NUM> p (fps) display frame rate. In a case where the external output unit <NUM> outputs image data having the <NUM> frame rate and the <NUM>-p display frame rate (YES in step S608), the processing proceeds to step S609. On the other hand, in a case where the external output unit <NUM> does not output image data having the <NUM> frame rate and the <NUM>-p display frame rate (NO in step S608), the processing proceeds to step S611. The output setting for the external output unit <NUM> may be set by the user or forcibly set based on the display performance of the display unit 115a. The image resolution and the display frame rate as the references for the determination in step S608 are based on the performance of the video camera <NUM>, and are not limited to <NUM> and <NUM> p, respectively, according to the present exemplary embodiment. For example, the image resolution may be <NUM> or <NUM>, and the display frame rate may be <NUM> p. Down-conversion (described below) is not limited to the <NUM> image resolution and the <NUM>-p display frame rate.

In step S609, the system control unit <NUM> controls the external output unit <NUM> to change the output format to the <NUM> image resolution and the <NUM>-fps display frame rate (i.e., "2K60p").

In step S610, the system control unit <NUM> controls the display resizing circuit <NUM> to perform vertical reduction on the image data <NUM> in the YUV format, and clips the central part of the image data <NUM> to generate display image data. The generation of display image data in step S610 will be described below with reference to <FIG>.

<FIG> illustrates the image data <NUM> in the YUV format which is input to the display resizing circuit <NUM>. The system control unit <NUM> vertically compresses the image data <NUM> in the YUV format by half using the display resizing circuit <NUM>. <FIG> illustrates display image data <NUM> as a result of vertically compressing which has been performed on the image data <NUM> in the YUV format. When the size of the image data <NUM> in the YUV format is <NUM> in width and <NUM> in height, the size of the display image data <NUM> is <NUM> in width and <NUM> in height, as illustrated in <FIG>. As illustrated in <FIG>, the system control unit <NUM> further clips the central part of the display image data <NUM> to generate display image data <NUM>. The size of the display image data <NUM> is <NUM> in width and <NUM> in height. More specifically, the system control unit <NUM> down-converts the image data having the <NUM> image resolution illustrated in <FIG> into image data having the <NUM> image resolution.

In step S611, the system control unit <NUM> performs the first desqueeze processing. This may be performed by generating image data by clipping and magnification. More specifically, in a case where the user sets the setting for the desqueeze display, the system control unit <NUM> performs the second desqueeze processing in the variable frame rate mode and performs the first desqueeze processing in other than the variable frame rate mode. <FIG> illustrates the display image data <NUM> to be generated in step S611.

In step S612, similar to step S607, the system control unit <NUM> controls the display resizing circuit <NUM> to generate display image data based on the image data <NUM> in the YUV format for full angle of view.

In step S614, the system control unit <NUM> determines whether a frame display of the video camera <NUM> is ON or OFF. Frame display (surround display) will be described below with reference to <FIG>. The frame display refers to a setting for legibly displaying pieces of imaging information, such as the recording time, remaining amount of power, and International Organization for Standardization (ISO) speed, along the four sides of the display unit 115a (or the panel <NUM>) around the captured image. <FIG> illustrate examples of frame display. Referring to <FIG>, an image <NUM> indicates the image of a case where a frame display is OFF, and an image <NUM> indicates the image of a case where the frame display is ON. Referring to the image <NUM> having a display image size smaller than the image <NUM>, information is displayed in belt-like areas around the image (along the four sides of the display unit 115a). This prevents the image and information from being displayed in a superimposed way. While, in the image <NUM>, black belt-like areas are provided and white characters are displayed on the black background, the display format of the frame is not limited thereto. Black characters may be displayed on the white or gray background.

To display the image <NUM> on the display unit 115a, the system control unit <NUM> combines the OSD data stored in the RAM <NUM> with the display image data and outputs the combined image to the external output unit <NUM>. To display the image <NUM>, the system control unit <NUM> combines the OSD data stored in the RAM <NUM> with the display image data reduced for frame display and arranges the OSD data around the display image data. The user can change the frame display to be ON or OFF by a menu operation. In a case where the frame display is ON (YES in step S614), the processing proceeds to step S615. On the other hand, in a case where the frame display is OFF (NO in step S614), the processing proceeds to step S617. In step S615, the system control unit <NUM> determines whether steps S606 and S613 have been applied, i.e., whether the desqueeze flag is ON. In a case where the system control unit <NUM> determines that the processing in steps S606 and S613 is completed (YES in step S615), the processing skips step S616 and proceeds to step S617. On the other hand, in a case where the system control unit <NUM> determines that the processing in steps S606 and S613 is not completed (NO in step S615), the processing proceeds to step S616.

In step S616, the system control unit <NUM> controls the external output unit <NUM> to reduce the display image data stored in the RAM <NUM> to arrange the belt-like areas. More specifically, in step S616, the system control unit <NUM> performs processing for reducing the display image data to display the image <NUM>. Since step S616 is performed regardless of whether the desqueeze display is ON or OFF, reduced images include the display image data <NUM> and <NUM> on which the desqueeze processing has been performed.

In a case where the system control unit <NUM> determines that the desqueeze flag is ON (YES in S615), the system control unit <NUM> displays an image <NUM> illustrated in <FIG> without reducing the display image data <NUM> even with the frame display is ON (the frame display setting is ON). More specifically, in a case where the desqueeze flag is ON, the image <NUM> is displayed regardless of whether the frame display is ON or OFF.

By not reducing the image even with the frame display is ON, the display image data is not reduced more than necessary, and therefore image visibility can be ensured.

In a case where either one of the recording resolution and the imaging frame rate satisfies a predetermined condition, the system control unit <NUM> may make the YES determination in step S615 and may not reduce the image. In a case of large recording resolution, when display image data is generated based on the image data <NUM> in the YUV format, writing of display data may not be completed because of a large amount of data on each line. Therefore, even in a case where a frame rate is not great, the system control unit <NUM> performs the scaling processing (down-conversion) on the image data <NUM> in the YUV format to downsize in both the vertical and the horizontal directions, and then displays the image data <NUM>. More specifically, down-conversion may be necessary even with the <NUM> image resolution and the <NUM>-p frame rate, instead of the <NUM> image resolution and the <NUM>-p frame rate. With a recording resolution of <NUM> or higher, the down-conversion is required to constantly display a live view image on time. In this case, even in a case where the frame display is OFF, the system control unit <NUM> does not reduce the image for frame display since black belt areas are arranged around the displayed image.

Likewise, when the frame rate is greater than or equal to a predetermined frame rate, writing of one-line data may not be completed within predetermined time even in a case where display image data is generated in short time and recording resolution is low. Therefore, in this case, the system control unit <NUM> performs scaling (down-conversion) on the image data <NUM> in the YUV format to downsize in both the vertical and the horizontal directions, and displays the image data <NUM>. When the image is displayed after the down-conversion, areas for displaying information are arranged around the image. Therefore, black belt areas for displaying information are arranged regardless of whether the frame display is ON of OFF. Consequently, even in a case where the frame display is OFF, the system control unit <NUM> does not reduce the image since areas for displaying information around the displayed image (so that the information is not superimposed on the image) have already arranged. While the above-described areas for displaying information are black belts, the areas are not limited thereto, and may be belts of while or other colors.

In step S617, the system control unit <NUM> controls the external output unit <NUM> to superimpose OSD data (information) on the display image data stored in the RAM <NUM> and output the resultant image data to the outside, to perform the image display on the display unit 115a.

Display examples in a case where a magnification function (Magn) is used will be described below with reference to <FIG>. Images <NUM> and <NUM> illustrated in <FIG> indicate display examples in a case where the desqueeze display is ON and the magnification function for focus confirmation is performed.

When the magnification function according to the present exemplary embodiment is enabled, the image <NUM> is displayed on the entire screen as illustrated in <FIG> even in the variable frame rate mode. Therefore, in a case where the frame display is ON, the system control unit <NUM> displays the reduced image <NUM>.

While, in the present exemplary embodiment, the system control unit <NUM> performs the side black processing in step S613, the side black processing does not necessarily need to be performed. In this case, an image <NUM> illustrated in <FIG> is displayed. In this display, no image is displayed in the areas of the upper and lower sides of the display unit 115a, and part of information are superimposed on the right- and the left-hand sides. Therefore, in a case where the frame display is ON, the system control unit <NUM> displays an image <NUM> in a state in which it is reduced in comparison with the image <NUM>. In a case where information is displayed only on the upper and lower sides, the system control unit <NUM> does not need to reduce the image. Similar to the descriptions of the images <NUM> and <NUM>, in a case where the display image data and the OSD data are overlapped, the system control unit <NUM> further reduces the display image data in a case where the frame display is ON in comparison with the case of the frame display is OFF.

According to the above-described exemplary embodiment, even in a case where the user captures a moving image with a variable frame rate by using an anamorphic lens, the system control unit <NUM> can display a desqueezed image during recording of the moving image. In a case where the frame display is ON in the variable frame rate mode, the system control unit <NUM> can perform frame display without degrading the image visibility since the image is not reduced. On the other hand, in normal image capturing (not in the variable frame rate mode), the system control unit <NUM> reduces the image to provide areas for displaying information. In normal image capturing, since the image is displayed according to the screen size, the image visibility is not significantly degraded even in a case where the image is reduced to a certain extent. Therefore, both the image visibility and the information display visibility are achieved.

The above-described various control described to be performed by the system control unit <NUM> may be performed by one hardware component, and the entire apparatus may be controlled by a plurality of hardware components which share processing.

The exemplary embodiments have been described above centering on a case where the present invention is applied to the video camera <NUM>. However, the present invention is not limited to the exemplary embodiments but applicable to display control apparatuses capable of performing display control. More specifically, the present invention is applicable to portable telephone terminals, portable image viewers, printer apparatuses having a finder, digital photo frames, music players, game machines, and electronic book readers.

The functions may include subroutines, modules, sub-programs, or units.

Claim 1:
A display control apparatus (<NUM>) comprising:
an acquisition means (<NUM>, <NUM>) for acquiring first image data that represents a subject image formed at different magnifications in a horizontal direction and a vertical direction by using an anamorphic lens;
a display control means (<NUM>) for performing first resizing and second resizing, wherein the first resizing comprises applying a first process to obtain second data by clipping a part of the first image data and further comprises generating a display image having a predetermined aspect ratio from the second data, and wherein the second resizing comprises resizing the first image data without clipping the part of the first image data;
characterized in that the display control apparatus further comprising:
a control means (<NUM>) for controlling the display control means (<NUM>) to perform the second resizing in a case where a moving image recording setting satisfies a condition that a shooting mode in which a variable frame rate for moving image recording is set, and to perform the first resizing in a case where the moving image recording setting does not satisfy the condition.