Patent Publication Number: US-2012026299-A1

Title: Video image processing apparatus and video image processing method

Description:
CROSS REFERENCE TO RELATED APPLICATION(S) 
     The application is based upon and claims the benefit of priority from Japanese Patent Application No. 2010-168554 filed on Jul. 27, 2010, the entire contents of which are incorporated herein by reference. 
     BACKGROUND 
     1. Field 
     Embodiments of the present invention relate to video image processing apparatuses and video image processing methods. 
     2. Description of the Related Art 
     There is a technique for a display device for alternately displaying a right eye image and a left eye image, thereby presenting a three-dimensional video image to a user. In the display device according to this technique, a three-dimensional video image may be inputted by using an input format in which both of a right eye image and a left eye image are included in a single frame, for example. Examples of this input format include: a Side-by-Side format in which right eye and left eye images are arranged side by side; and a Top-and-Bottom format in which images are arranged one above the other. Further, the display device separates a right eye image and a left eye image from an inputted frame, converts these right eye and left eye images into images of resolutions each corresponding to a screen resolution of the display device, and then outputs the resulting images to a screen. 
     Furthermore, there is a technique for displaying, upon input of a two-dimensional video image to a display device, the two-dimensional video image on a display by performing overscanning using a high-resolution processing engine. In this case, the display device cuts out an image of a given size from a frame of the inputted video image, and then enlarges the size of the cutout image to a display size, thus displaying the enlarged image on the display. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
       A general configuration that implements the various features of embodiments will be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate embodiments and not to limit the scope of the embodiments. 
         FIG. 1A  is a diagram illustrating an example of a use mode of a television apparatus according to a first embodiment; 
         FIG. 1B  is a diagram illustrating exemplary video image processing performed by the television apparatus according to the first embodiment; 
         FIG. 2  is a diagram illustrating an example of a system configuration of the television apparatus according to the first embodiment; 
         FIG. 3  is a diagram illustrating an example of a functional block of the television apparatus according to the first embodiment; 
         FIGS. 4A to 4D  are diagrams illustrating examples of processes performed on video image data of a Side-by-Side format in the television apparatus according to the first embodiment; 
         FIGS. 5A to 5D  are diagrams illustrating examples of processes performed on video image data of a Top-and-Bottom format in the television apparatus according to the first embodiment; 
         FIGS. 6A to 6C  are diagrams illustrating examples of processes performed on two-dimensional video image data in the television apparatus according to the first embodiment; 
         FIG. 7  is a flow chart illustrating an example of a flow of processing performed on video image data in the television apparatus according to the first embodiment; 
         FIG. 8  is a diagram illustrating an example of a functional block of a television apparatus according to a second embodiment; 
         FIGS. 9A to 9C  are diagrams illustrating examples of processes performed on video image data of a Side-by-Side format in the television apparatus according to the second embodiment; 
         FIGS. 10A to 10C  are diagrams illustrating examples of processes performed on video image data of a Top-and-Bottom format in the television apparatus according to the second embodiment; and 
         FIG. 11  is a flow chart illustrating an example of a flow of processing performed on video image data in the television apparatus according to the second embodiment. 
     
    
    
     DETAILED DESCRIPTION 
     Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. 
       FIG. 1A  is a diagram illustrating an example of a use mode of a video image processing apparatus according to the present embodiment. The video image processing apparatus according to the present embodiment is implemented as a television apparatus  100 , for example. 
     The television apparatus  100  includes modules such as a display unit  121  and a control signal transmitter  123 , and thus has the function of presenting a two-dimensional video image and a three-dimensional video image to a user. 
     In this embodiment, the television apparatus  100  alternately displays a right eye image and a left eye image on the display unit  121 , and transmits a signal for opening and closing a right eye shutter  210  and a left eye shutter  220  of shutter eyeglasses  200  to the shutter eyeglasses  200  from the control signal transmitter  123 , thereby allowing the user who wears the shutter eyeglasses  200  to see a three-dimensional video image. 
       FIG. 1B  is a diagram illustrating exemplary video image processing performed by the television apparatus  100  according to the present embodiment. 
     A three-dimensional video image frame U 3  including a left eye image U 1  and a right eye image U 2 , for example, is inputted to the television apparatus  100 . Then, the television apparatus  100  converts the images U 1  and U 2  into images U 11  and U 21  of resolutions each corresponding to a resolution of the display unit  121 , and displays the images U 11  and  021  on the display unit  121 . 
     Actually, in a typical television apparatus for displaying a two-dimensional video image, with the aim of hiding a distortion and/or a noise at an end of a television broadcasting video image, an end portion of the received television broadcasting video image may be prevented from being displayed, and a video image from which this end portion is excluded may be displayed. Hence, in consideration of upper, lower, right and left end portions that might not be displayed on the television apparatus, a television broadcast station broadcasts two-dimensional video image data in which an image is positioned so as not to be located at upper, lower, right and left ends of a frame. Of all regions of a frame, a region where an image should be contained is referred to as a “safety zone”, and a recommended criterion for a safety zone range is determined by organizations such as SMPTE and ARIB. 
     Further, also when three-dimensional video image data is broadcast, it is conceivable that a region U 4  may be provided around the left eye image U 1  and the right eye image U 2  as illustrated in  FIG. 1B , thus making settings so as to prevent the left eye image and right eye image from being located at upper, lower, right and left ends of the frame U 3 . In that case, the television apparatus  100  is preferably capable of displaying each of the left eye image and right eye image exclusive of the region U 4 . 
     Furthermore, even when no region U 4  is provided and a left eye image is located all over the left half of the frame U 3  while a right eye image is located all over the right half of the frame U 3 , a user may select a screen display mode, for example, thereby making settings to allow zoom display of a left eye image and a right eye image, included in a frame, on a display in such a manner that a center portion of each of the images is enlarged. 
     Moreover, in each of these cases, the television apparatus  100  is preferably capable of displaying, on a display screen, a left eye image and a right eye image with a parallax substantially equal to a parallax between a left eye image and a right eye image which are included in a frame. 
     On the other hand, the television apparatus  100  according to the present embodiment is capable of suitably displaying a left eye image and a right eye image included in a three-dimensional video image data frame provided with a peripheral region, but details on this feature will be described later with reference to  FIGS. 2 to 11 . 
     Next, referring to  FIG. 2 , an example of a system configuration of the television apparatus  100  will be described. 
     The television apparatus  100  includes modules such as: a receiver  101 ; an ODD  102 ; a storage unit  103 ; a video image input unit  104 ; a reproduction controller  105 ; an operation receiving unit  106 ; a video image processor  110 ; a display processor  120 ; the display unit  121 ; a shutter eyeglasses controller  122 ; and the control signal transmitter  123 . 
     The receiver  101  functions, for example, as a tuner for receiving video image data superimposed on airwaves and/or as a communication unit for receiving video image data of IP TV contents via a network, thus receiving 3D broadcasting provided via services such as CATV and BS digital broadcasting. Further, the received video image data is outputted to the video image input unit  104 . 
     The ODD  102  has the function of reading video image data recorded on an optical disk, and outputs the read video image data to the video image input unit  104 . The storage unit  103  is a storage device such as a HDD or a memory, and has the functions of storing the video image data received by the receiver  101  and outputting the stored video image data to the video image input unit  104  in response to an instruction provided from the reproduction controller  105 . 
     The video image input unit  104  is a module to which video image data is inputted from the modules such as the receiver  101 , the ODD  102  and the storage unit  103 . Alternatively, video image data may be inputted to the video image input unit  104  from an external device of the television apparatus  100 . In that case, video image data is inputted to the video image input unit  104  through an interface such as an HDMI, for example. 
     The reproduction controller  105  performs processing concerning video image reproduction on the television apparatus  100 . In accordance with, for example, a user&#39;s operational input received by the operation receiving unit  106 , the reproduction controller  105  decides which of the modules, including the receiver  101 , the ODD  102  and the storage unit  103 , should feed video image data to the reproduction controller  105 . Then, the reproduction controller  105  is fed video image data from the decided module via the video image input unit  104 , and outputs the video image data to the video image processor  110 . 
     Furthermore, the reproduction controller  105  determines a format of the inputted video image data. Specifically, the reproduction controller  105  determines whether the inputted video image data is two-dimensional video image data or three-dimensional video image data, and when the inputted video image data is three-dimensional video image data, the reproduction controller  105  determines which of formats, e.g., a Side-by-Side format, a Top-and-Bottom format and a Frame Packing format, is used. In this case, at the time of input of video image data, the module, which has outputted this video image data, provides notification about the format of this video image data to the reproduction controller  105 , and the reproduction controller  105  determines the format based on this notification. Alternatively, the reproduction controller  105  analyzes video image data and/or receives a user&#39;s operation, thus determining the format of the inputted video image data. 
     Moreover, the reproduction controller  105  decides a range of an image to be cut out from a frame, i.e., a position and a size (resolution) of an image to be cut out from a frame, and provides, to the video image processor  110 , an instruction for cutting out the image in accordance with the decided range. In this embodiment, the reproduction controller  105  may decide cutout position and size by default, for example, or may decide cutout position and size in accordance with notification provided from the operation receiving unit  106 . Note that details of the cutout range will be described later with reference to  FIGS. 4A to 5D . 
     The operation receiving unit  106  receives an operational input made by a user. In this embodiment, the operation receiving unit  106  receives: an operational input for deciding from which of the modules, including the receiver  101 , the ODD  102  and the storage unit  103 , a video image should be fed for reproduction; and/or an operational input for deciding a range of an image displayed on the display unit  121 , among those included in a frame of video image data to be reproduced. Note that examples of an operational input for deciding a range of an image to be displayed include: an operation input for deciding whether or not a video image should be overscanned and displayed; and an operational input for deciding how much a video image should be overscanned when it is overscanned. 
     Further, upon reception of an operational input for deciding from which module a video image should be fed for reproduction, the operation receiving unit  106  provides notification corresponding to this operational input to the reproduction controller  105 . Besides, upon reception of an operational input for deciding a range of an image to be displayed among those included in a frame of video image data to be reproduced, the operation receiving unit  106  outputs notification corresponding to this operation to the video image processor  110 . 
     The video image processor  110  performs various video image processes on video image data inputted from the reproduction controller  105 . In this embodiment, the video image processor  110  has, for example, the functions of: separating a left eye image and a right eye image included in a frame of three-dimensional video image data; cutting out each of the separated right eye image and left eye image at a given range responsive to an instruction provided from the reproduction controller  105 ; and enlarging the cutout images in such a manner that the cutout images each conform to a screen size (resolution) of the display unit  121 . Note that detailed functions of the video image processor  110  will be described later with reference to  FIG. 3 . 
     The display processor  120  has the function of converting video image data, inputted from the video image processor  110 , into a signal for display. Further, the display processor  120  outputs this signal to the display unit  121 , and the display unit  121  displays a video image based on this signal. Furthermore, when a three-dimensional video image is outputted to the display unit  121 , the display processor  120  outputs, to the shutter eyeglasses controller  122 , a shutter opening/closing instruction for the shutter eyeglasses  200 . 
     Note that when an image that is being currently outputted is a left eye image, the display processor  120  outputs an instruction for opening a left eye shutter and closing a right eye shutter to the shutter eyeglasses controller  122 ; on the other hand, when an image that is being outputted is a right eye image, the display processor  120  outputs an instruction for opening the right eye shutter and closing the left eye shutter to the shutter eyeglasses controller  122 . 
     The shutter eyeglasses controller  122  converts the shutter opening/closing instruction, inputted from the display processor  120 , into a signal for the shutter eyeglasses, and outputs the resulting signal to the control signal transmitter  123 . Moreover, via infrared communication, wireless communication or the like, for example, the control signal transmitter  123  outputs, to the shutter eyeglasses  200 , the signal inputted from the shutter eyeglasses controller  122 . 
     Next, referring to  FIG. 3 , examples of functions of the video image processor  110  will be described.  FIG. 3  is a diagram illustrating an example of a functional block of the video image processor  110 . In this embodiment, the video image processor  110  includes: an L/R image separation unit  111 ; a cutout unit  112 ; and a resolution upgrading unit  113 . 
     The L/R image separation unit  111  receives, from the reproduction controller  105 , notification about video image data format or the like. When inputted video image data is three-dimensional video image data, the L/R image separation unit  111  divides an image, included in a frame of the three-dimensional video image data, into two images, i.e., right and left images, thereby separating an image including a right eye image and an image including a left eye image, among those included in this frame. 
     Then, the L/R image separation unit  111  outputs each of the divided images to the cutout unit  112 . In this embodiment, after having divided the image included in the frame, the L/R image separation unit  111  alternately outputs, to the cutout unit  112 , image data including a right eye image and image data including a left eye image, for example. 
     Furthermore, the L/R image separation unit  111  also has the function of converting a frame rate of the inputted three-dimensional video image data. In other words, when a frame including a left eye image and a right eye image is inputted at 60 Hz, for example, images divided from this frame are Outputted to the cutout unit  112  at 120 Hz. 
     Note that when the inputted video image data is two-dimensional video image data, the L/R image separation unit  111  outputs an image of this video image data to the cutout unit  112  without separating the image. 
     The cutout unit  112  cuts out, from the inputted image, an image at a given range. Note that in this embodiment, the cutout unit  112  is given an instruction for a cutout range from the reproduction controller  105 , and cuts out an image at a range responsive to this instruction. Then, the cutout unit  112  outputs the cutout image to the resolution upgrading unit  113 . 
     The resolution upgrading unit  113  upgrades a resolution of the image inputted from the cutout unit  112 . Specifically, the resolution upgrading unit  113  enlarges a size (resolution) of the inputted image to a size conforming to the screen size (resolution) of the display unit  121 . Moreover, the resolution upgrading unit  113  not only performs image enlargement but also performs an image quality improving process for improving an image quality. Besides, the resolution upgrading unit  113  outputs, to the display processor  120 , image data whose resolution has been upgraded. 
     Next, referring to  FIGS. 4A to 5D , examples of processes performed when three-dimensional video image data is inputted to the video image processor  110  will be described. 
     First, referring to  FIGS. 4A to 4D , examples of processes performed when three-dimensional video image data of a Side-by-Side format is inputted to the video image processor  110  will be described. 
     In this embodiment, a frame A 1  illustrated in  FIG. 4A  is an example of a frame of a Side-by-Side format, which has been inputted to the L/R image separation unit  111 . The frame A 1  includes a left eye image A 3  and a right eye image A 4 . Furthermore, an image A 5  different from the images A 3  and A 4  is located around the left eye image A 3  and the right eye image A 4 . In this embodiment, as the left eye image A 3  and the right eye image A 4 , images for moving images of television broadcasting or the like are located. 
     Moreover, the left eye image A 3  and the right eye image A 4  are each located at a given distance from an end of the frame A 1 . Besides, the images A 3  and A 4  are also each located at a given distance from a center line B 1  passing through the center of the frame A 1 . 
     In this embodiment, an upper end of the left eye image A 3  and that of the frame A 1  are located away from each other at a distance T 1 . Further, a left end of the left eye image A 3  and that of the frame A 1  are located away from each other at a distance T 2 , a lower end of the left eye image A 3  and that of the frame A 1  are located away from each other at a distance T 3 , and a right end of the left eye image A 3  and the center line B 1  are located away from each other at a distance T 4 . Furthermore, a length of each of the distances T 1  and T 3  corresponds to a length of a given part of a distance T 5  between the upper and lower ends of the frame A 1 , for example, and similarly, a length of each of the distances T 2  and T 4  corresponds to a given part of a length of a distance T 6  between the left end of the frame A 1  and the center line B 1 . Alternatively, the lengths of the distances T 1  to T 4  may each be a length of a given number of pixels, for example. 
     Note that although the location of the left eye image A 3  has been described above, the right eye image A 4  is located similarly to the left eye image A 3 . Specifically, the right eye image A 9  is located at a distance from the end of the frame A 1  for a given number of pixels, or located at a distance corresponding to a given part of the length of the frame A 1  from the end of the frame A 1 . 
     In this embodiment, upon input of the frame A 1  of video image data, the L/R image separation unit  111  divides this frame A 1  along the center line B 1 , thus separating an image including a left eye image and an image including a right eye image from each other. 
     Images A 21  and A 22  illustrated in  FIG. 4B  each serve as an example of an image separated by the L/R image separation unit  111 . In this embodiment, the image A 21  includes the left eye image A 3 , and the image A 22  includes the right eye image A 4 . Moreover, an image A 51  is located around the left eye image A 3 , and an image A 52  is located around the right eye image A 4 . Besides, the images A 21  and A 22  are inputted to the cutout unit  112 . 
     The cutout unit  112  cuts out each of the left eye image and right eye image from the images A 21  and A 22  at a range based on an instruction provided from the reproduction controller  105 . Note that in this embodiment, the range refers to a position and a size (resolution), for example. Specifically, when the cutout unit  112  receives, from the reproduction controller  105 , for example, an instruction for allowing an image cutout size to conform to a size of each of the left eye image A 3  and the right eye image A 4  serving as the original images included in the frame inputted to the cutout unit  112 , the cutout unit  112  cuts out each of the left eye image and right eye image with a size C 2  substantially equal to a size (resolution) of each of the left eye image A 3  and the right eye image A 4 . 
     Moreover, in this embodiment, when the cutout unit  112  cuts out each of the left eye image and right eye image with the size C 2 , the cutout unit  112  cuts out the left eye image and right eye image at positions that allow a parallax between the left eye image A 3  and the right eye image A 4  included in the inputted frame to be maintained. Specifically, suppose that a distance between an upper end of the size C 2  and that of the image A 21  is defined as U 1 , a distance between a left end of the size C 2  and that of the image A 21  is defined as U 2 , a distance between a lower end of the size C 2  and that of the image A 21  is defined as U 3 , a distance between a right end of the size C 2  and that of the image A 21  is defined as U 4 , a distance between the upper end of the size C 2  and that of the image A 22  is defined as U 5 , a distance between the left end of the size C 2  and that of the image A 22  is defined as U 6 , a distance between the lower end of the size C 2  and that of the image A 22  is defined as U 7 , and a distance between the right end of the size C 2  and that of the image A 22  is defined as U 8 . Then, the cutout unit  112  cuts out the images so that lengths of the distances U 1  and U 5  are equal to each other, lengths of the distances U 2  and  06  are equal to each other, lengths of the distances U 3  and U 7  are equal to each other, and lengths of the distances U 4  and  08  are equal to each other. 
     Further, when the cutout unit  112  receives an instruction for allowing an image cutout size to be larger than the size of each of the left eye image A 3  and the right eye image A 4 , the cutout unit  112  cuts out each of the left eye image and right eye image with a size C 1 . Furthermore, when the cutout unit  112  receives an instruction for allowing an image cutout size to be smaller than the size of each of the left eye image A 3  and the right eye image A 4 , i.e., when the cutout unit  112  receives an instruction for partially enlarging the inputted images and allowing zoom display thereof on a display screen, the cutout unit  112  cuts out each of the left eye image and right eye image with a size C 3 . Note that similarly to the size C 2 , the sizes C 1  and C 3  are positions and sizes which allow a parallax between the cutout images to be maintained at a parallax between the original images. 
     Note that  FIG. 4C  is a diagram illustrating a left eye image A 31  and a right eye image A 41  which have been cut out from the images A 21  and A 22 , respectively, along lines of the size C 2 . 
     Furthermore, after having cut out the left eye image A 31  and the right eye image A 41  from the images A 21  and A 22 , respectively, the cutout unit  112  outputs the cutout images to the resolution upgrading unit  113 . Then, the resolution upgrading unit  113  upgrades resolutions of these images so that sizes (resolutions) of the inputted left eye image A 31  and the right eye image A 41  conform to the screen size (screen resolution) of the display unit  121 , thus generating a left eye image A 32  and a right eye image A 42  illustrated in  FIG. 4D . 
     In the examples of the processes illustrated in  FIGS. 4A to 4D , the television apparatus  100  is capable of displaying, on a display device, the left eye image A 32  exclusive of at least part of the image A 5  located around the inputted left eye image A 3 , and the right eye image A 42  exclusive of at least part of the image A 5  located around the inputted right eye image A 4 , with the sizes of the left eye image A 32  and the right eye image A 42  conforming to the size (resolution) of the display screen of the display device. 
     Further, at a position corresponding to a position where one of the right eye image and left eye image is cut out, the cutout unit  112  cuts out the other one of the right eye image and left eye image, thus making it possible to prevent a parallax between the cutout right eye image and left eye image from being deviated from a parallax between the images that are not yet cut out. 
     Note that referring to  FIGS. 4A to 4D , the description has been made assuming that the examples of the processes are performed when the left eye image A 3  and the right eye image A 4  are each placed in a region located away from an end portion of the frame A 1 , but the examples of the processes are also applicable to a case where a left eye image is located all over the left half of a frame and a right eye image is located all over the right half of the frame. Specifically, an image that excludes an end portion of a left eye image included in a frame, and an image that excludes an end portion of a right eye image may be cut out so that cutout positions and sizes thereof conform to each other, and the cutout images may each be displayed on the display unit  121  with a resolution corresponding to the resolution of the display screen. 
     Subsequently, referring to  FIGS. 5A to 5D , examples of processes performed when three-dimensional video image data of a Top-and-Bottom format is inputted to the video image processor  110  will be described. 
     A frame D 1  illustrated in  FIG. 5A  is an example of a frame of a Top-and-Bottom format, which has been inputted to the L/R image separation unit  111 . In this embodiment, the frame D 1  includes a left eye image D 3  and a right eye image D 4 . Furthermore, an image D 5  exists around the left eye image D 3  and the right eye image D 4 . Note that similarly to the case of a Side-by-Side format described above with reference to  FIGS. 4A to 4D , the left eye image D 3  and the right eye image D 4  are each located at a given distance from an end of the frame D 1  and a center line E 1  passing through the center of the frame D 1 . 
     In this embodiment, the distances of the left eye image D 3  and the right eye image D 4  from the end of the frame D 1  and the center line E 1  each correspond to a given part of a longitudinal/lateral length of the frame D 1 , for example. Alternatively, the distances of the images D 3  and D 4  from the end of the frame D 1  and the center line E 1  may each correspond to a given number of pixels, for example. 
       FIG. 5B  is a diagram illustrating images D 21  and d 22  divided by the L/R image separation unit  111 . Note that the image D 21  includes the left eye image D 3 , and the image D 22  includes the right eye image D 4 . Moreover, an image D 51  is located around the left eye image D 3 , and an image D 52  is located around the right eye image D 4 . Besides, the images D 21  and D 22  are inputted to the cutout unit  112 . 
     In this embodiment, the cutout unit  112  cuts out each of the left eye image and right eye image from the images D 21  and D 22  at a position and a size (resolution) which are based on an instruction provided from the reproduction controller  105 . Specifically, when the cutout unit  112  receives, from the reproduction controller  105 , an instruction for allowing an image cutout size to be larger than a size of each of the left eye image D 3  and the right eye image D 4 , the cutout unit  112  cuts out each of the left eye image and right eye image with a size F 3 . When the cutout unit  112  receives, from the reproduction controller  105 , an instruction for allowing an image cutout size to conform to the size of each of the left eye image D 3  and the right eye image D 4 , the cutout unit  112  cuts out each of the left eye image and right eye image with a size F 2 . And when the cutout unit  112  receives, from the reproduction controller  105 , an instruction for allowing an image cutout size to be smaller than the size of each of the left eye image D 3  and the right eye image D 4 , i.e., when the cutout unit  112  receives an instruction for partially enlarging the inputted images and allowing zoom display thereof on the display screen, the cutout unit  112  cuts out each of the left eye image and right eye image with a size F 1 . 
     Note that as also described with reference to  FIGS. 4A to 4D , the cutout unit  112  cuts out the left eye image and right eye image at positions and sizes which allow a parallax between the cutout images to be maintained at a parallax between the original images inputted to the cutout unit  112 . Specifically, when the images are each cut out with the size F 2 , for example, suppose that a distance between an upper end of the size F 2  and that of the image D 21  is defined as V 1 , a distance between a left end of the size F 2  and that of the image D 21  is defined as V 2 , a distance between a lower end of the size F 2  and that of the image D 21  is defined as V 3 , a distance between a right end of the size F 2  and that of the image D 21  is defined as V 4 , a distance between the upper end of the size F 2  and that of the image D 22  is defined as V 5 , a distance between the left end of the size F 2  and that of the image D 22  is defined as V 6 , a distance between the lower end of the size F 2  and that of the image D 22  is defined as V 7 , and a distance between the right end of the size F 2  and that of the image D 22  is defined as V 8 . Then, the left eye image and right eye image are cut out so that lengths of the distances V 1  and V 5  are equal to each other, lengths of the distances V 2  and V 6  are equal to each other, lengths of the distances V 3  and V 7  are equal to each other, and lengths of the distances V 4  and V 8  are equal to each other. 
       FIG. 5C  is a diagram illustrating a left eye image D 31  and a right eye image D 41  cut out from the images D 21  and D 22 , respectively, along lines of the size F 2 . After having cut out the left eye image D 31  and the right eye image D 41  from the images D 21  and D 22 , respectively, the cutout unit  112  outputs the cutout images to the resolution upgrading unit  113 . Then, the resolution upgrading unit  113  upgrades resolutions of these images so that sizes (resolutions) of the inputted left eye image D 31  and right eye image D 41  conform to the screen size (screen resolution) of the display unit  121 , and outputs the resulting images to the display processor  120 . 
     In the examples of the processes illustrated in  FIGS. 4A  to  4 D and  FIGS. 5A to 5D , the television apparatus  100  according to the present embodiment is capable of dividing a frame into a left part image and a right part image, and then cutting out each of the left eye image A 31  (D 31 ) and the right eye image A 41  (D 41 ) at a given range, thereby allowing the cutout images to be displayed with sizes conforming to the size of the display screen. As a result, the television apparatus  100  is capable of performing overscanning on images of three-dimensional video image data and performing zoom display thereof. 
     Moreover, when a left eye image and a right eye image are displayed on the display unit  121 , the television apparatus  100  according to the present embodiment is capable of cutting out the left eye image and right eye image so that the positional relationship between theses images is adaptive and a parallax between the right eye image and left eye image included in a frame of original video image data is maintained. Hence, the television apparatus  100  is capable of performing overscanning without changing the parallax between the left eye image and right eye image. 
     Next, referring to  FIGS. 6A to 6C , examples of processes performed by the video image processor  110  when two-dimensional video image data is inputted thereto will be described. 
     A frame G 1  illustrated in  FIG. 6A  is an example of a frame of two-dimensional video image data, which has been inputted to the L/R image separation unit  111 . In this embodiment, the frame G 1  includes a two-dimensional image G 3 . Further, an image G 4  is located around the image G 3 . Furthermore, the image G 3  is located at a distance of a given part of a longitudinal/lateral length of the frame G 1 , for example, from an end of the frame G 1 . Alternatively, the image G 3  may be located at a distance of a given number of pixels, for example, from the end of the frame G 1 . Moreover, the frame G 1  is outputted to the cutout unit  112 . 
     In this embodiment, the cutout unit  112  cuts out the two-dimensional image from the frame G 1  at a position and a size (resolution) which are based on an instruction provided from the reproduction controller  105 . Specifically, when the cutout unit  112  receives, from the reproduction controller  105 , an instruction for allowing an image cutout size to be larger than a size of the two-dimensional image G 3  serving as the original image included in the frame G 1  inputted to the cutout unit  112 , the cutout unit  112  cuts out the two-dimensional image with a size H 1 . When the cutout unit  112  receives, from the reproduction controller  105 , an instruction for allowing an image cutout size to conform to the size of the two-dimensional image G 3 , the cutout unit  112  cuts out the two-dimensional image with a size H 2 . And when the cutout unit  112  receives, from the reproduction controller  105 , an instruction for partially enlarging the inputted image and allowing zoom display thereof on the display screen, the cutout unit  112  cuts out the two-dimensional image with a size H 3 . Note that  FIG. 6B  is a diagram illustrating a two-dimensional image G 31  cut out from the frame G 1  along lines of the size H 2 . 
     Furthermore, after having cut out the two-dimensional image G 31  from the frame G 1 , the cutout unit  112  outputs the cutout image to the resolution upgrading unit  113 . Then, the resolution upgrading unit  113  upgrades a resolution of this image so that the size (resolution) of the two-dimensional image G 31  conforms to the screen size (screen resolution) of the display unit  121 , thereby generating a two-dimensional image G 32  illustrated in  FIG. 6C . 
     Next, referring to  FIG. 7 , an example of a flow of processing concerning display of two-dimensional or three-dimensional image(s) on the television apparatus  100  will be described. 
     First, video image data is inputted to the reproduction controller  105  (S 701 ). Then, the reproduction controller  105  determines a format of this video image data, and outputs notification indicative of a determination result to the L/R image separation unit  111  (S 702 ). 
     Upon reception of notification that the video image data is three-dimensional video image data (Yes in S 702 ) and upon determination that the format of the video image data is a Side-by-Side format or a Top-and-Bottom format (Yes in S 703 ), the L/R image separation unit  111  divides an image included in the inputted frame, thereby separating a left eye image and a right eye image (S 704 ). Then, each of the divided images is outputted to the cutout unit  112 . On the other hand, upon determination in S 703  that the format of the video image data is neither a Side-by-Side format nor a Top-and-Bottom format (No in  5703 ), e.g., upon determination that the video image data is a three-dimensional video image of a Frame Packing format, the L/R image separation unit  111  outputs an image of the inputted frame to the cutout unit  112  without dividing the image. 
     Upon input of the image(s), the cutout unit  112  cuts out, from the inputted image (s), each of a left eye image and a right eye image with a size (resolution) and a position which are based on an instruction provided from the reproduction controller  105  (S 705 ), and outputs each of the cutout left eye image and right eye image to the resolution upgrading unit  113 . Note that when an instruction for performing no overscanning on the inputted image(s) is received from the reproduction controller  105 , the cutout unit  112  may output the image(s) to the resolution upgrading unit  113  without cutting out a left eye image and a right eye image. 
     Then, the resolution upgrading unit  113  enlarges the inputted image(s) to upgrade resolution(s) thereof (S 706 ), and outputs the resulting image (s) to the display processor  120  (S 707 ). Note that when video image data of a Frame Packing format, for example, is inputted in this embodiment, the resolution upgrading unit  113  may output the inputted images to the display processor  120  without enlarging the inputted images. 
     Further, in that case, the resolution upgrading unit  113  alternately outputs the left eye image and right eye image to the display processor  120 , and the display processor  120  outputs video image signals of these images to the display unit  121 . Then, the display unit  121  displays a video image based on the video image signals for the left eye image and right eye image which are alternately inputted, thereby displaying a three-dimensional video image. 
     On the other hand, upon reception of notification that the video image data is two-dimensional video image data in S 702  (No in  5702 ), the L/R image separation unit  111  outputs the frame of this video image data to the cutout unit  112  without separating any image from the frame. Then, the cutout unit  112  cuts out a two-dimensional image from the frame (S 708 ), and outputs the cutout image to the resolution upgrading unit  113 . 
     The resolution upgrading unit  113  enlarges the size (resolution) of the inputted image so that the size of the inputted image conforms to the screen size of the display unit  121  (S 709 ), and outputs the enlarged image to the display processor  120  (S 710 ). Then, the display processor  120  generates a video image signal of the inputted image to output the generated signal to the display unit  121 , and the display unit  121  displays a two-dimensional video image based on the inputted video image signal. 
     Next, referring to  FIGS. 8 to 11 , a second embodiment of the present invention will be described. A video image processing apparatus according to the second embodiment is implemented as a television apparatus  300  (not illustrated) including a video image processor  310 . Note that the television apparatus  300  according to the second embodiment has a configuration similar to that of the television apparatus  100  according to the first embodiment, and therefore, the following description will be focused on functions of performing operations different from those of the first embodiment. 
       FIG. 8  is a diagram illustrating an example of a functional block of the video image processor  310  included in the television apparatus  300  according to the second embodiment. 
     The video image processor  310  includes modules such as: a first cutout unit  311 ; an L/R image separation unit  312 ; a second cutout unit  313 ; and a resolution upgrading unit  314 . 
     The reproduction controller  105  decides a range of an image to be cut out from a frame, i.e., a position and a size (resolution) of an image to be cut out from a frame, and provides, to the first and second cutout units  311  and  313 , an instruction for cutting out an image in accordance with the decided range. In this embodiment, the reproduction controller  105  may decide cutout position and size by default, for example, or may decide cutout position and size in accordance with notification provided from the operation receiving unit  106 . 
     Further, when three-dimensional video image data is inputted to the first cutout unit  311 , the reproduction controller  105  provides, to the second cutout unit  313 , an instruction for cutout position and size conforming to a position and a size (resolution) of the image cut out by the first cutout unit  311 . Note that details of the cutout range will be described later with reference to  FIGS. 9A to 100 . 
     The first cutout unit  311  has the function of cutting out image (s) from a frame of video image data inputted from the reproduction controller  105 . In this embodiment, when a frame of two-dimensional video image data is inputted to the first cutout unit  311 , the first cutout unit  311  performs a process similar to that described with reference to  FIGS. 6A and 6C  and performed by the cutout unit  112 . On the other hand, when a frame of three-dimensional video image data is inputted, the first cutout unit  311  performs a cutout process different from that described with reference to  FIGS. 6A to 6C  and performed by the cutout unit  112 , but this process will be described later with reference to  FIGS. 9A to 100 . 
     Further, together with a frame of video image data, notification indicating that this video image data is two-dimensional video image data or three-dimensional video image data is inputted to the first cutout unit  311  from the reproduction controller  105 . Then, when three-dimensional video image data is inputted, the first cutout unit  311  outputs the cutout images to the L/R image separation unit  312 . On the other hand, when two-dimensional video image data is inputted, the first cutout unit  311  outputs the cutout image to the resolution upgrading unit  314 . 
     The L/R image separation unit  312  divides an image included in the inputted video image data frame into two images, thereby separating a right eye image and a left eye image which are included in the image of the inputted frame. Then, the L/R image separation unit  312  outputs each of the divided images to the second cutout unit  313 . Note that in this embodiment, after having dividing the image of the inputted frame, the L/R image separation unit  312  alternately outputs an image including a right eye image and an image including a left eye image, for example, to the second cutout unit  313 . 
     The second cutout unit  313  has the function of cutting out the left eye image and right eye image from the image including the left eye image and the image including the right eye image, respectively. In this embodiment, the second cutout unit  313  cuts out each of the left eye image and right eye image at a range based on an instruction provided from the reproduction controller  105 . Note that details of the process performed by the second cutout unit  313  will be described later with reference to  FIGS. 9A to 10C . Then, the second cutout unit  313  outputs the cutout left eye image and right eye image to the resolution upgrading unit  314 . 
     The resolution upgrading unit  314  upgrades a resolution of each image inputted from the first cutout unit  311  or the second cutout unit  313 . In this embodiment, the resolution upgrading unit  314  enlarges a size (resolution) of the inputted image to a size conforming to the screen size (resolution) of the display unit  121 . Then, the resolution upgrading unit  314  outputs, to the display processor  120 , the image whose resolution has been upgraded. 
     Next, referring to  FIGS. 9A to 10C , examples of processes performed by the first cutout unit  311 , the L/R image separation unit  312  and the second cutout unit  313  when three-dimensional video image data is inputted will be described. 
       FIGS. 9A to 9C  are diagrams illustrating examples of processes performed by the first cutout unit  311 , the L/R image separation unit  312  and the second cutout unit  313  when a frame of a Side-by-Side format is inputted to the first cutout unit  311 . 
     A frame J 1  illustrated in  FIG. 9A  is an example of a frame of a Side-by-Side format, which is inputted to the first cutout unit  311 . Upon input of the frame J 1  for an image J 2  including a left eye image J 3 , a right eye image J 4  and an image J 5 , the first cutout unit  311  cuts out an image including a left eye image and a right eye image from the image J 2  of the frame J 1  at a range based on an instruction provided from the reproduction controller  105 . Note that in this embodiment, the range refers to a position and a size (resolution), for example. 
     In this embodiment, when the first cutout unit  311  receives, from the reproduction controller  105 , for example, an instruction for allowing an image cutout size (resolution) to conform to a size of the left eye image J 3  and right eye image J 4  serving as the original images included in the frame inputted to the first cutout unit  311 , the first cutout unit  311  cuts out an image including the left eye image and right eye image along a cutout line L 1 . Note that the first cutout unit  311  may cut out an image with a size (resolution) larger than or smaller than a size of the cutout line L 1  in accordance with an instruction provided from the reproduction controller  105 . Then, the image cut out by the first cutout unit  311  is outputted to the L/R image separation unit  312 . 
     An image J 21  illustrated in  FIG. 9B  is an example of the image cut out by the first cutout unit  311  and outputted to the L/R image separation unit  312 . In this embodiment, the image J 21  includes a left eye image J 31 , a right eye image J 41  and an image J 51 . In this embodiment, the L/R image separation unit  312  separates the image J 21  into images along a center line K 3  passing through the center of the image J 21 . Then, the L/R image separation unit  312  outputs each of the separated images to the second cutout unit  313 . 
     Images J 22  and J 23  illustrated in  FIG. 9C  each serve as an example of the image separated by the L/R image separation unit  312 . The image J 22  includes the left eye image J 31  and an image J 52 , and the image J 23  includes the right eye image J 41  and an image J 53 . Furthermore, the second cutout unit  313  cuts out the left eye image J 31  and the right eye image J 41  from the images J 22  and J 23 , respectively. 
     In this embodiment, the second cutout unit  313  cuts out the left eye image and right eye image from the images J 22  and J 23 , respectively, with sizes (resolutions) and positions based on an instruction provided from the reproduction controller  105 . When the second cutout unit  313  receives, from the reproduction controller  105 , for example, an instruction for allowing an image display size to conform to the screen size, the second cutout unit  313  cuts out the left eye image along a cutout line L 2  and cuts out the right eye image along a cutout line L 3 . 
     In this case, based on the instruction provided from the reproduction controller  105 , the second cutout unit  313  cuts out the images so that a parallax between the cutout left eye image and right eye image is equal to a parallax between the original images of these left eye image and right eye image. Specifically, when the second cutout unit  313  cuts out the images along the cutout lines L 2  and L 3 , a distance K 1  between a left end of the frame J 1  and the left-end cutout line L 1  and a distance K 4  between the center line K 3  and the right-end cutout line L 2  are preferably equal to each other, and furthermore, a distance K 2  between a right end of the frame J 1  and the right-end cutout line L 1  and a distance K 5  between the center line K 3  and the left-end cutout line L 3  are preferably equal to each other. 
     In accordance with an instruction provided from the reproduction controller  105 , the second cutout unit  313  may cut out the images with sizes (resolutions) smaller than those of the cutout lines L 2  and L 3 . 
     In the examples of the processes illustrated in  FIGS. 9A to 9C , the second cutout unit  313  cuts out the left eye image J 31  from the image J 22  in an area where the image J 21  has been cut out by the first cutout unit  311 , i.e., at a position corresponding to a length of the distance K 2  between a right end of the image J 21  and that of the frame J 1 . In addition, the second cutout unit  313  cuts out the right eye image J 41  from the image J 23  in an area where the image J 21  has been cut out by the first cutout unit  311 , i.e., at a position corresponding to a length of the distance K 1  between a left end of the image J 21  and that of the frame J 1 . As a result, the television apparatus  300  is capable of preventing the parallax between the right eye image and left eye image cut out by the second cutout unit  313  from being deviated from the parallax between the images that are not yet cut out by the first cutout unit  311 . 
     Subsequently, referring to  FIGS. 10A to 10C , examples of processes performed by the first cutout unit  311 , the L/R image separation unit  312  and the second cutout unit  313  when a frame of a Top-and-Bottom format is inputted to the first cutout unit  311  will be described. 
     A frame M 1  illustrated in  FIG. 10A  is an example of a frame of a Top-and-Bottom format, which is inputted to the first cutout unit  311 . Upon input of the frame M 1  including a left eye image M 3 , a right eye image M 4  and an image M 5 , the first cutout unit  311  cuts out an image including a left eye image and a right eye image from the frame M 1  with a size (resolution) and a position based on an instruction provided from the reproduction controller  105 . 
     In this embodiment, when the first cutout unit  311  receives, from the reproduction controller  105 , for example, an instruction for allowing an image cutout size to conform to a size of the left eye image M 3  and right eye image M 4  serving as the original images included in the frame inputted to the first cutout unit  311 , the first cutout unit  311  cuts out an image including a left eye image and a right eye image along a cutout line N 1 . Note that the first cutout unit  311  may cut out an image with a size (resolution) larger than or smaller than a size of the cutout line N 1  in accordance with an instruction provided from the reproduction controller  105 . Then, the image cut out by the first cutout unit  311  is outputted to the L/R image separation unit  312 . 
     An image M 21  illustrated in  FIG. 10B  is an example of the image cut out by the first cutout unit  311  and outputted to the L/R image separation unit  312 . In this embodiment, the image M 21  includes a left eye image M 31 , a right eye image M 41  and an image M 51 . In this embodiment, the L/R image separation unit  312  separates the image M 21  into images along a center line P 3  passing through the center of the image M 21 . Then, the L/R image separation unit  312  outputs each of the separated images to the second cutout unit  313 . 
     Images M 22  and M 23  illustrated in  FIG. 100  each serve as an example of the image separated by the L/R image separation unit  312 . In this embodiment, the image M 22  includes the left eye image M 31  and an image M 52 , and the image M 23  includes the right eye image M 41  and an image M 53 . Furthermore, the second cutout unit  313  cuts out the left eye image M 31  and the right eye image M 41  from the images M 22  and M 23 , respectively. 
     In this embodiment, the second cutout unit  313  cuts out the left eye image and right eye image from the images M 22  and M 23 , respectively, with sizes (resolutions) and positions based on an instruction provided from the reproduction controller  105 . When the second cutout unit  313  receives, from the reproduction controller  105 , for example, an instruction for allowing an image cutout size to conform to a size of the left eye image M 3  and right eye image M 4  serving as the original images included in the frame inputted to the first cutout unit  311 , the second cutout unit  313  cuts out the left eye image along a cutout line N 2  and cuts out the right eye image along a cutout line N 3 . 
     Note that the second cutout unit  313  may cut out the images with sizes (resolutions) smaller than those of the cutout lines N 2  and N 3  in accordance with an instruction provided from the reproduction controller  105 . However, in this embodiment, the second cutout unit  313  preferably cuts out the images so that a distance P 1  between an upper end of the frame M 1  and the upper-end cutout line N 1  and a distance P 4  between the center line P 3  and the lower-end cutout line N 2  are equal to each other, and a distance P 2  between a lower end of the frame M 1  and the lower-end cutout line N 1  and a distance P 5  between the center line P 3  and the upper-end cutout line N 3  are equal to each other. 
     Next, referring to  FIG. 11 , an example of a flow of processing concerning display of two-dimensional or three-dimensional image(s) on the television apparatus  300  according to the second embodiment will be described. 
     First, upon input of video image data to the reproduction controller  105  (S 801 ), the reproduction controller  105  outputs the inputted video image data to the first cutout unit  311 . Further, in this case, the reproduction controller  105  determines whether or not the inputted video image data is three-dimensional video image data, and outputs a determination result to the first cutout unit  311 . 
     Upon input of the video image data, the first cutout unit  311  cuts out an image from a frame of the inputted video image data (S 802 ). 
     Furthermore, in this step, the first cutout unit  311  receives, from the reproduction controller  105 , notification about a format of the video image data inputted from the reproduction controller  105 . Then, upon determination that the frame from which the image is cut out is a three-dimensional video image frame (Yes in S 803 ) and that the format of the video image data is a Side-by-Side format or a Top-and-Bottom format (Yes in S 804 ), the first cutout unit  311  outputs the cutout image to the L/R image separation unit  312 . 
     Subsequently, the L/R image separation unit  111  separates, from the image included in the inputted frame, a left eye image and a right eye image (S 805 ). Then, each of the separated images is outputted to the second cutout unit  313 . 
     On the other hand, upon determination in S 804  that the format of the video image data is neither a Side-by-Side format nor a Top-and-Bottom format (No in S 804 ), e.g., upon determination that the video image data is a three-dimensional video image of a Frame Packing format, the first cutout unit  311  outputs the cutout image to the second cutout unit  313 . 
     Upon input of the image (s), the second cutout unit  313  cuts out, from the inputted image (s), each of a left eye image and a right eye image with a size (resolution) and a position which are responsive to an instruction provided from the reproduction controller  105  (S 806 ). 
     Then, each of the cutout left eye image and right eye image is outputted to the resolution upgrading unit  314 . The resolution upgrading unit  314  enlarges these images to upgrade resolutions thereof (S 807 ), and outputs the resulting images to the display processor  120  (S 808 ). Note that in this embodiment, the resolution upgrading unit  314  alternately outputs the left eye image and right eye image to the display processor  120 , and the display processor  120  outputs video image signals of these images to the display unit  121 . Then, the display unit  121  displays a video image based on the video image signals for the left eye image and right eye image which are alternately inputted, thereby displaying a three-dimensional video image. 
     On the other hand, upon determination in S 803  that the frame from which the image is cut out is a two-dimensional video image frame (No in S 803 ), the first cutout unit  311  outputs the cutout image to the resolution upgrading unit  314 . Then, the resolution upgrading unit  314  enlarges the size (resolution) of the inputted image so that the size of the inputted image conforms to the screen size of the display unit  121  (S 809 ), and outputs the enlarged image to the display processor  120  (S 810 ). Then, the display processor  120  generates a video image signal of the inputted image to output the generated signal to the display unit  121 , and the display unit  121  displays a two-dimensional video image based on the inputted video image signal. 
     According to each of the first and second embodiments, the television apparatus is capable of presenting a suitably-sized video image to a user. Moreover, when a left eye image and a right eye image included in a frame are cut out and displayed, the television apparatus is capable of displaying the cutout left eye image and right eye image without changing a parallax between the left eye image and right eye image which are not yet cut out. 
     While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.