Abstract:
Disclosed are a system and a method for generating and regenerating three-dimensional (3D) images file based on two-dimensional (2D) image media standards, a 3D image file generating device for generating a 3D image file having a data area, which includes first image data and second image data synchronized with the first image data so as to be used for generating a 3D image, a header area including information of the first image data, and a metadata area including information of the second image data, and a 3D image file regenerating device, which parses information of the first and the second image data when a 3D image file is inputted so as to synthesize and regenerate the first and the second image data into a 3D image file.

Description:
PRIORITY 
       [0001]    This application claims priority to an application entitled “System and Method For Generating and Regenerating 3D Image Files Based on 2D Image Media Standards” filed in the Korean Industrial Property Office on Jun. 11, 2007 and assigned Serial No. 2007-56475, the contents of which are incorporated herein by reference. 
       BACKGROUND OF THE INVENTION 
       [0002]    1. Field of the Invention 
         [0003]    The present invention relates to a system and a method for generating and regenerating a three-dimensional (3D) image file based on two-dimensional (2D) image media standards. 
         [0004]    2. Description of the Related Art 
         [0005]    Standardization of iMPEG-2, MPEG-4, MPEG-7, and MPEG-21 is in progress based on the Moving Picture Experts Group (MPEG), which is an international standardization organization regarding multimedia. As various standards have been developed, there has been a growing need for establishing one profile by combining different standard technologies. An example of an activity that has responded to this need is the MPEG-Application (MPEG-A: ISO/ICE 230000) multimedia application standardization. 
         [0006]    Various Multimedia Application Formats (MAFs) have been developed as activities of the MPEG-A, in order to combine non-MPEG standards with typical MPEG standards so that the value of activity of a standard is higher. As such, without an effort to establish new separate standards, it is possible to establish a multimedia application format in such a manner that standard technologies, which have been previously verified, are combined with each other, and the effective value of the multimedia application format can be maximized. Currently, standardization of technologies such as Digital Audio Broadcasting MAF (DAB MAF) and Digital Multimedia Broadcasting MAF (DMB MAF) is in progress. However, standardization regarding a file format for storing 3D images is not in progress. 
         [0007]    The latest image technology for implementing 3D images includes a technology for regenerating 3D images in only a portable terminal having a barrier Liquid Crystal Display (LCD) mounted therein. However, there are no known technologies for generating 3D images in typical portable terminals or a 3D image storing format for regeneration of 3D images. 
       SUMMARY OF THE INVENTION 
       [0008]    Accordingly, the present invention has been made to solve the above-mentioned problems occurring in the prior art, and provides a system and a method for regenerating a 3D image in a typical portable terminal. 
         [0000]    The present invention provides a three-dimensional file format for generating and regenerating a 3D image. 
         [0009]    Also, the present invention provides a three-dimensional file format formed in such a manner that a part of a 2D image file format prescribed in International Standardization Organization (ISO) 14496-12 is changed according to a standardization regarding the multimedia application format of Motion Picture Experts Group (MPEG)-A. 
         [0010]    The present invention achieves generation and regeneration of a 2D image file and a 3D image file by such a 3D file format. 
         [0011]    Meanwhile, the present invention provides a system and method for generating and regenerating such a 3D image file. 
         [0012]    In accordance with the present invention, there is provided a system for generating and regenerating 3D image files base on 2D image media standards, including a 3D image file generating device for generating a 3D image file including a data area having first image data and second image data synchronized with the first image data so as to be used for generating a 3D image, a header area including information of the first image data, and a metadata area including information of the second image data, and a 3D image file regenerating device, which parses information of the first and the second image data when a 3D image file is inputted so as to synthesize and regenerate the first image data and the second image data into a the 3D image file. 
         [0013]    In accordance with the present invention, there is provided a method for generating and regenerating 3D image files, based on 2D image media standards, including photographing an image of a left sight point respective to a subject so as to output first image data, and photographing an image of a right sight point respective to the subject so as to output second image data, performing a pre-process on the first image data and the second image data, storing the pre-processed first and second image data, encoding the stored first and second image data, and generating a 3D image file, which is constituted of a data area including the encoded first and encoded second image data, a header area including information of the first image data, and a metadata area including information of the second image data. 
         [0014]    In accordance with the present invention, there is provided a method for generating and regenerating 3D image files, based on 2D image media standards, further including parsing the information of the first and the second image data so as to extract the first image data and the second image data, storing the extracted first image and second image data, decoding the stored first and second image data, synthesizing and regenerating the decoded first and second image data as a three-dimensional image, and displaying the synthesized and regenerated three-dimensional image. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0015]    The above and other aspects, features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: 
           [0016]      FIG. 1  illustrates a conventional 2D image file storing format; 
           [0017]      FIG. 2   a  illustrates a first 3D image file storing format according to the present invention; 
           [0018]      FIG. 2   b  illustrates a second 3D image file storing format according to the present invention; 
           [0019]      FIG. 2   c  illustrates a third 3D image file storing format according to the present invention; 
           [0020]      FIG. 3   a  illustrates a 3D image file generating device according to the present invention; 
           [0021]      FIG. 4  illustrates a 3D image file regenerating device according to the present invention; 
           [0022]      FIG. 5  illustrates a method for generating a 3D image file according to the present invention; and 
           [0023]      FIG. 6  illustrates a method for regenerating a 3D image file according to the present invention. 
       
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
       [0024]    Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. In the following description, the same elements will be designated by the same reference numerals although they are shown in different drawings. Further, a detailed description of known functions and configurations incorporated herein will be omitted for the sake of clarity and conciseness. 
         [0025]      FIG. 1  illustrates a 2D image file storing format according to the conventional ISO 14496-12. The 2D image file storing format  100  includes a Moov box (Moov) area and an Media Data Box (Mdat) area. Herein, the Mdat area is a data area of the file format and includes actual image data and voice data in each track. The image data and the voice data are stored in each track with a frame module. 
         [0026]    The Moov area corresponds to a header area of the file format and has a structure based on an object. The Moov area includes all pieces of information for regenerating files regarding contents information including a frame rate, a bit rate, the size of an image, and synchronization information for supporting a function for regenerating commands such as fast forward (FF) and rewind (REW). Particularly, information regarding the number of all frames of image data or voice data and the size of each frame, is included so that image data and voice data can be restored and regenerated in such a manner that the moov area is parsed during regeneration. 
         [0027]      FIG. 2   a  illustrates a first 3D image file storing format according to the present invention. A 2D image file storing format  200  is formed in such a manner that only a metadata area is added to the 2D image file format shown in  FIG. 1 . Therefore, a structure and a function of the 2D image file format can be used without substantial alteration thereto. The Mdat area includes a voice track, a first image track and a second image track. The first image track includes first image data, and the second image track includes second image data. 
         [0028]    Herein, the first image data and the second image data are data formed by using the sense of sight of a human being, and are image data formed by photographing an image of the left sight point and an image of the right sight point by using the first camera and the second camera respective to a subject. As such, each separate image is generated and regenerated at the left and right eyes of the user so that the user feels a cubic effect. If one of the first image data and the second image data is regenerated, the user enjoys a 2D image, and if the first image data and the second image data are combined with each other to be regenerated, the user can enjoy a 3D image. 
         [0029]    The Moov area as a header area includes information regarding the first image track and information regarding the voice track, and the metadata area includes information regarding the second image track. Such track information includes information regarding the number of all frames of each piece of data and the sizes of the frames, so that when a three-dimensional image is regenerated, each piece of data can be combined in such a manner that such information is analyzed. 
         [0030]      FIG. 2   b  illustrates a second 3D image file storing format according to the present invention. The 3D image file storing format  210  includes an Mdat area as a data area, a Moov area as a header area, and a metadata area. However, in comparison with the first 3D image file storing format  200 , there is one image track instead of two image tracks, and the first and second image data are included in the one image track. 
         [0031]    According to a storing method of 3D image file storing format  210 , one of the first and the second image data is first stored, and then the remaining image data is stored. Therefore, it is possible to construct image data in only one track. 
         [0032]    The Moov area has the number of all frames of the first image data, the sizes of the frames, and information regarding a starting address of the image track, at which the first image data has been stored. The metadata area has the number of all frames of the second image data, the sizes of the frames, and information regarding a starting address, in which the second image data has been stored, of the image track. As such, it is possible to synthesize and regenerate the first and the second image data into a 3D image. 
         [0033]      FIG. 2   c  illustrates a third 3D image file storing format according to the present invention. The 3D image file storing format  220  also includes an Mdat area as a data area, a Moov area as a header area, and a metadata area. However, although the 3D image file storing format  220  also includes one image track, similar to the 3D image file storing format  210 , the first and the second image data are alternatively stored in the one image track in comparison with the 3D image file storing format  210 . Therefore, the Moov area as the header area includes the number of all frames of the first image data, the sizes of the frames and offset information until the next first image data is arranged after a first image data, as well as information regarding a starting address of the image track, at which the first image data has been stored. 
         [0034]    The metadata area also includes the number of all frames of the second image data, the sizes of the frames, and offset information until the next second image data is arranged after a second image data, as well as information regarding a starting address of the image track, at which the second image data has been stored. 
         [0035]      FIG. 3   a  illustrates a 3D image file generating device according to the present invention. The 3D image file generating unit  300  includes a first camera  310 , a second camera  312 , an image signal processing unit  320 , a storing unit  330 , an encoding unit  340  and a file generating unit  350 . 
         [0036]    The first camera  301  photographs an image of a left sight point or an image of a right sight point respective to a subject so as to output a first image data. The second camera  320  photographs an image of another sight point, which is different from the sight point of the first camera  301 , respective to the subject, so as to output second image data. 
         [0037]    The first and the second image data, which are output from the first camera  301  and the second camera  320 , undergo a pre-process through the image signal processing unit  320 . The pre-process operation is to convert an analog value of an outer image value, i.e. elements of light and colors, which have been recognized through a sensor in a Charge Coupled Device (CCD) type or a Complementary Metal-Oxide Semiconductor (CMOS) type, to a digital value. 
         [0038]    The storing unit  330  stores the first and the second image data which have undergone a pre-process through the image signal processing unit  320 . Also, the encoding unit  340  encodes the stored first image data and the stored second image data. The encoding operation of the encoding unit  340  relates to data compression, and can be omitted if needed. 
         [0039]    The file generating unit  350  generates a three-dimensional file by using the first and the second image data, which have been encoded in the encoding unit  340 . At this time, the first and the second image data are stored in the data area, information for parsing the first image data is stored in the header area, and information for parsing the second image data is stored in the metadata area. 
         [0040]      FIG. 4  illustrates a 3D image file regenerating device according to the present invention. In  FIG. 4 , the 3D image file regenerating unit  400  includes a file parsing unit  410 , a storing unit  420 , a decoding unit  430 , a regenerating unit  440  and a display unit  450 . 
         [0041]    The file parsing unit  410  receives a three-dimensional image file generated in the file generating unit  350  of the 3D image file generating device  300  so as to use it in parsing the 3D image file. At this time, the information of the first and the second image data, which are stored in the header area and the metadata area, respectively, is parsed, and then the stored first and second image data are extracted. Then, they are stored in the storing unit  420 . 
         [0042]    The decoding unit  430  decodes the first and second image data, which are stored in the storing unit  420 . This operation is performed when the first and second image data have been encoded by the encoding unit  340  in the 3D image file generating unit  300 . 
         [0043]    The regenerating unit  325  synthesizes the first image data and the second image data, which have been decoded, into a three-dimensional image so as to regenerate them. At this time, track information stored in the header area and the metadata area of the 3D image file is used for the synthesis. Herein, when the regenerating unit  440  does not refer to the information of the second image data, which is stored in the metadata area, only first image data is regenerated, so that a typical 2D image is regenerated. 
         [0044]    Also, although a typical regenerating device, which can not regenerate a 3D image, receives a 3D image file, it is enough to refer only a Moov area according to a conventional standard, and not the metadata area, so that it is possible to regenerate a 2D image. As such, the 3D image file storing format according to the present invention has compatibility respective to regeneration of a conventional 2D image and a 3D image. The display unit  450  displays a three-dimensional image, which is synthesized and regenerated in the regenerating unit  440 . 
         [0045]      FIG. 5  illustrates a method for generating a 3D image file according to the present invention. In  FIG. 5 , the 3D image file generating method includes a photographing step S 510 , a pre-processing step S 520 , a storing step S 530  and an encoding step S 540 , and a file generating step S 550 . 
         [0046]    In the photographing step S 510 , one of an image of a left sight point and an image of a right sight point respective to a subject is photographed so as to output the first image data. An image of the remaining sight point is photographed so as to output the second image data. 
         [0047]    In the pre-processing step S 520 , a pre-processing is performed on the first image data and the second image data so that the first and the second image data, which are recognized through a CCD sensor or a CMOS sensor, are converted from analog values to digital values. 
         [0048]    In the storing step S 530 , the first and second image data, which have undergone the pre-processing in step S 520 , are stored in the storing unit  330 . Also, the first image data and the second image data, which have been stored in the storing unit  330 , are compressed in the encoding step S 540 . The encoding step S 540  can be omitted, if desired. 
         [0049]    In the file generating step S 550 , a 3D image file is generated by using the first and the second image data, which have been encoded in the encoding unit  340 . At this time, the first and the second image data are stored in the data area, information for parsing the first image data is stored in the header area, and information for parsing the second image data is stored in the metadata area. 
         [0050]      FIG. 6  illustrates a method for regenerating a 3D image file according to the present invention. In  FIG. 6 , the 3D image file regenerating method includes an image extracting step S 610 , a storing step S 620 , a decoding step S 630 , a regeneration step S 640  and a displaying step S 650 . The method of  FIG. 6  is for regenerating the 3D image file generated in  FIG. 5 . 
         [0051]    In the image extracting step S 610 , information of the first image data, which is stored in the header area of the 3D image file, and information of the second image data, which is stored in the metadata area, are parsed so that the first image data and the second image data are extracted. 
         [0052]    The first image data and the second image data, which have been extracted in the image extracting step S 610 , are stored in the storing unit  420  in the storing step S 620 . Then, the first image data and the second image data, which have been stored in the storing unit  420 , are decoded in the decoding step S 630 . When the encoding step S 540  is omitted in the method for generating a 3D image file, the decoding step S 630  is also omitted. 
         [0053]    In the regeneration step S 640 , the first and the second image data, which have been decoded in the decoding step S 630 , are synthesized as a three-dimensional image so as to be regenerated. If the second image data isn&#39;t included in the data area of the 3D image file, or the generating unit  440  does not refer to information of the second image data stored in the metadata area of the 3D image file, a typical 2D image is regenerated instead of a 3D image. Therefore, it is possible to select a 2D image or a 3D image according to the user&#39;s choice and regenerate it. 
         [0054]    Also, although a typical regenerating device, which does not support regeneration of a 3D image, receives a 3D image file, it is possible to regenerate it as a 2D image. In the display step S 650 , the 3D image file, which is synthesized and regenerated in the regeneration step S 640 , is displayed on the displaying unit  450 . It is also possible to achieve regeneration on a typical Liquid Crystal Display (LCD) as such a displaying unit. 
         [0055]    According to the present invention, a verification process as a new standard can be simplified by using a standard technique, which has been already verified, in a regulation of a 3D image file format. There is also an advantage in that one of a 2D image file or a 3D image file is selected so as to be generated or regenerated by the new 3D image file format.