Abstract:
The present disclosure relates to the transmission of sets of data and metadata and more particularly to the transmission of light-field contents. Light-field data take up large amounts of storage space which makes storage cumbersome and processing less efficient. In addition, light-field acquisition devices are extremely heterogeneous and each camera has its own proprietary file format. Since acquired light-field data from different cameras have a diversity of formats a complex processing is induced on the receiver side. To this end, it is proposed a method for encoding a signal representative of a light-field content in which the parameters representing the rays of light sensed by the different pixels of the sensor are mapped on the sensor. A second set of encoded parameters are used to reconstruct the light-field content from the parameters representing the rays of light sensed by the different pixels of the sensor.

Description:
REFERENCE TO RELATED EUROPEAN APPLICATION 
       [0001]    This application claims priority from European No. 16305757.3, entitled “A METHOD AND A DEVICE FOR ENCODING A SIGNAL REPRESENTATIVE OF A LIGHT-FIELD CONTENT,” filed on Jun. 22, 2016, the contents of which are hereby incorporated by reference in its entirety. 
       TECHNICAL FIELD 
       [0002]    The present invention relates to the transmission of sets of data and metadata and more particularly to the transmission of light-field contents. 
       BACKGROUND 
       [0003]    The acquisition of four-dimensional or 4D light-field data, which can be viewed as a sampling of a 4D light field, i.e. the recording of light rays, is explained in the article  “Understanding camera trade - offs through a Bayesian analysis of light field projections”  by Anat Levin and al., which has been published in the conference proceedings of ECCV 2008. 
         [0004]    Compared to classical two-dimensional or 2D images obtained from a camera, 4D light-field data enable a user to have access to more post-processing features that enhance the rendering of images and the interactivity with the user. For example, with 4D light-field data, it is possible to perform refocusing of images with freely selected distances of focalization meaning that the position of a focal plane can be specified/selected a posteriori, as well as changing slightly the point of view in the scene of an image. 
         [0005]    There are several ways to represent 4D light-field data. Indeed, in the Chapter 3.3 of the Ph.D dissertation thesis entitled “ Digital Light Field Photography ” by Ren Ng, published in July 2006, three different ways to represent 4D light-field data are described. Firstly, 4D light-field data can be represented, when recorded by a plenoptic camera by a collection of micro-lens images. 4D light-field data in this representation are named raw images or raw 4D light-field data. Secondly, 4D light-field data can be represented, either when recorded by a plenoptic camera or by a camera array, by a set of sub-aperture images. A sub-aperture image corresponds to a captured image of a scene from a point of view, the point of view being slightly different between two sub-aperture images. These sub-aperture images give information about the parallax and depth of the imaged scene. Thirdly, 4D light-field data can be represented by a set of epipolar images see for example the article entitled: “ Generating EPI Representation of a  4 D Light Fields with a Singe Lens Focused Plenoptic Camera ”, by S. Wanner and al., published in the conference proceedings of ISVC 2011. 
         [0006]    Light-field data take up large amounts of storage space which makes storage cumbersome and processing less efficient. In addition, light-field acquisition devices are extremely heterogeneous. Light-field cameras are of different types for example plenoptic or camera arrays. Within each type there are many differences such as different optical arrangements, or micro-lenses of different focal lengths. Each camera has its own proprietary file format. At present, there is no standard supporting the acquisition and transmission of multi-dimensional information for an exhaustive over-view of the different parameters upon which a light-field depends. Since acquired light-field data from different cameras have a diversity of formats a complex processing is induced on the receiver side. 
         [0007]    The present invention has been devised with the foregoing in mind. 
       SUMMARY OF INVENTION 
       [0008]    According to a first aspect of the invention there is provided a computer implemented method for encoding a signal representative of a light-field content said method comprising:
       encoding, for at least one pixel of a sensor, a first set of parameters representing a ray of light sensed by said pixel,   encoding a second set of parameters intended to be used to reconstruct the light-field content from the first set of parameters.       
 
         [0011]    The parameters transmitted according to the encoding method according to an embodiment of the invention are independent of the optical acquisition system used to acquire the light-field content intended to be transmitted and processed by a receiving device. 
         [0012]    In the method, according to an embodiment of the invention, the parameters representing the rays of light sensed by the different pixels of the sensor of the optical acquisition system, i.e. the parameters of the first set of parameters, are mapped on the sensor. Thus, these parameters can be considered as pictures. For example, when a ray of light sensed by a pixel of the optical acquisition system is represented by four parameters, the parameters representing the rays of light sensed by the pixels of the sensor of the optical acquisition system are grouped in four pictures. 
         [0013]    Such pictures can be encoded and transmitted according to video standards such as MPEG-4 part 10 AVC (also called h264), h265/HEVC or their probable successor h266, and transmitted in a joined video bitstream. The second encoded set may be encoded using Supplemental enhancement information (SEI) messages. The format defined in the method according to an embodiment of the invention enables a strong compression of the data to be transmitted without introducing any strong error (lossless coding) or a limited amount of errors (lossy coding). 
         [0014]    The method according to an embodiment of the invention is not limited to light-field data directly acquired by an optical device. These data may be Computer Graphics Image (CGI) that are totally or partially simulated by a computer for a given scene description. Another source of light-field data may be post-produced data that are modified, for instance color graded, light-field data obtained from an optical device or CGI. It is also now common in the movie industry to have data that are a mix of both data acquired using an optical acquisition device, and CGI data. It is to be understood that the pixel of a sensor can be simulated by a computer-generated scene system and, by extension, the whole sensor can be simulated by said system. From here, it is understood that any reference to a “pixel of a sensor” or a “sensor” can be either a physical object attached to an optical acquisition device or a simulated entity obtained by a computer-generated scene system. 
         [0015]    According to an embodiment of the encoding method, said encoding method further comprises:
       encoding a third set of parameters representing color data associated to the ray of light represented by said first set of parameters.       
 
         [0017]    According to an embodiment of the encoding method, at least one parameter of the first set of parameters represents a distance between a coordinate of said ray of light and a plane fitting a set of coordinates of a plurality of rays of light sensed by a plurality of pixels of the optical acquisition system, and at least one parameter of the second set of parameters represents coordinates of the fitting plane. 
         [0018]    Encoding the distance between a coordinate of the ray of light and a plane fitting a set of coordinates of a plurality of rays of light sensed by the different pixels of the sensor enables compressing the data to be transmitted since the amplitude between the different values of the computed distances is usually lower than the amplitude between the different values of the coordinates. 
         [0019]    According to an embodiment of the encoding method, at least one parameter of the first set of parameters represents:
       a difference between a value representing the ray of light sensed by said pixel and a value representing a ray of light sensed by another pixel preceding said pixel in a row of the sensor, or   when said pixel is the first pixel of a row of the sensor, a difference between a value representing the ray of light sensed by said pixel and a value representing a ray of light sensed by the first pixel of a row preceding the row to which said pixel belongs.       
 
         [0022]    The value representing the ray of light could be either the coordinates representing the ray of light or the distance between the coordinates or planes fitting sets of coordinates of a plurality of rays of light sensed by the different pixels of the sensor. 
         [0023]    This enables compressing the data by reducing the amplitude between the different values of the parameters to be transmitted. 
         [0024]    According to an embodiment of the encoding method, independent codecs are used to encode the parameters of the first set of parameters. 
         [0025]    According to an embodiment of the encoding method, when the second set of parameters comprises a parameter indicating that the first set of parameters is unchanged since a last transmission of the first set of parameters, only said second set of parameters is transmitted. 
         [0026]    This enables to reduce the amount of data to be transmitted to the decoding devices. 
         [0027]    According to an embodiment of the encoding method, the light-field data is made of a sequence of subsets of light-field data. For instance, the sub-sets are indexed temporally in order to represent a dynamic or moving scene. Typically, an element (or sub-set) of the sequence is called a frame. Under this condition, the transmission rate, usually characterized by, but no limited to, a number of frames per second, of the signal representative of the light-content is higher than the transmission rate of the encoded first set of parameters and the encoded second set of parameters. 
         [0028]    This enables to reduce the amount of data to be transmitted to the decoding devices. 
         [0029]    Another object of the invention concerns a device for encoding a signal representative of a light-field content comprising a processor configured to:
       encode, for at least one pixel of a sensor, a first set of parameters representing a ray of light sensed by said pixel,   encode a second set of parameters intended to be used to reconstruct the light-field content from the first set of parameters.       
 
         [0032]    Another aspect of the invention concerns a computer implemented method for decoding a signal representative of a light-field content said method comprising
       decoding, for at least one pixel of a sensor, a first set of parameters representing a ray of light sensed by said pixel,   decoding a second set of parameters intended to be used to reconstruct the light-field content from the first set of parameters,   reconstructing the light-field content based on the decoded first set of parameters and the decoded second set of parameters.       
 
         [0036]    According to an embodiment of the decoding method, said encoding method further comprises:
       decoding a third set of parameters representing color data associated to the ray of light represented by said first set of parameters,   reconstructing the light-field content based on a decoded third set of parameters together with the decoded first set of parameters and the decoded second set of parameters.       
 
         [0039]    Another aspect of the invention concerns a device for decoding a signal representative of a light-field content comprising a processor configured to:
       decode, for at least one pixel of a sensor, a first set of parameters representing a ray of light sensed by said pixel,   decode a second set of parameters intended to be used to reconstruct the light-field content from the first set of parameters,   reconstruct the light-field content based on the decoded first set of parameters and the decoded second set of parameters.       
 
         [0043]    Another aspect of the invention concerns a signal transmitted by a device for encoding a signal representative of a light-field content to a device for decoding said signal representative of a light-field content, said signal carrying a message comprising
       a first set of parameters representing a ray of light sensed by at least one pixel of a sensor,   a second set of parameters intended to be used to reconstruct the light-field content from the first set of parameters,   the reconstruction of the light-field content by the decoding device is based on a decoded first set of parameters and a decoded second set of parameters.       
 
         [0047]    Some processes implemented by elements of the invention may be computer implemented. Accordingly, such elements may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit”, “module” or “system’. Furthermore, such elements may take the form of a computer program product embodied in any tangible medium of expression having computer usable program code embodied in the medium. 
         [0048]    Since elements of the present invention can be implemented in software, the present invention can be embodied as computer readable code for provision to a programmable apparatus on any suitable carrier medium. A tangible carrier medium may comprise a storage medium such as a floppy disk, a CD-ROM, a hard disk drive, a magnetic tape device or a solid-state memory device and the like. A transient carrier medium may include a signal such as an electrical signal, an electronic signal, an optical signal, an acoustic signal, a magnetic signal or an electromagnetic signal, e.g. a microwave or RF signal. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0049]    Embodiments of the invention will now be described, by way of example only, and with reference to the following drawings in which: 
           [0050]      FIG. 1  is a block diagram of a light-field camera device in accordance with an embodiment of the invention; 
           [0051]      FIG. 2  is a block diagram illustrating a particular embodiment of a potential implementation of light-field data formatting module, 
           [0052]      FIG. 3  illustrates a ray of light passing through two reference planes P 1  and P 2  used for parameterization, 
           [0053]      FIG. 4  illustrates a ray of light passing through a reference plane P 3  located at known depths, 
           [0054]      FIG. 5  is a flow chart illustrating the steps of a method for formatting the light-field data according to an embodiment of the invention, 
           [0055]      FIG. 6  is a flow chart illustrating the steps of a method for formatting the light-field data according to an embodiment of the invention, 
           [0056]      FIG. 7  represents the χ i     u,v    maps, χ′″ i     u,v    maps or Δχ i     u,v    maps when transmitted to a receiver using four independent monochrome codecs, 
           [0057]      FIG. 8  represents the χ i     u,v    maps, χ′″ i     u,v    maps or Δχ i     u,v    maps when grouped in a single image. 
       
    
    
     DETAILED DESCRIPTION 
       [0058]    As will be appreciated by one skilled in the art, aspects of the present principles can be embodied as a system, method or computer readable medium. Accordingly, aspects of the present principles can take the form of an entirely hardware embodiment, an entirely software embodiment, (including firmware, resident software, micro-code, and so forth) or an embodiment combining software and hardware aspects that can all generally be referred to herein as a “circuit”, “module”, or “system”. Furthermore, aspects of the present principles can take the form of a computer readable storage medium. Any combination of one or more computer readable storage medium (a) may be utilized. 
         [0059]    Embodiments of the invention provide formatting of light-field data for further processing applications such as format conversion, refocusing, viewpoint change, etc. The provided formatting enables a proper and easy reconstruction of the light-field data on the receiver side in order to process it. An advantage of the provided format is that it is agnostic to the device used to acquire the light-field data. 
         [0060]      FIG. 1  is a block diagram of a light-field camera device in accordance with an embodiment of the invention. The light-field camera comprises an aperture/shutter  102 , a main (objective) lens  101 , a micro lens array  110  and a photosensor array. In some embodiments, the light-field camera includes a shutter release that is activated to capture a light-field image of a subject or scene. 
         [0061]    The photosensor array  120  provides light-field image data which is acquired by LF Data acquisition module  140  for generation of a light-field data format by light-field data formatting module  150  and/or for processing by light-field data processor  155 . Light-field data may be stored, after acquisition and after processing, in memory  190  in a raw data format, as sub aperture images or focal stacks, or in a light-field data format in accordance with embodiments of the invention. 
         [0062]    In the illustrated example, the light-field data formatting module  150  and the light-field data processor  155  are disposed in or integrated into the light-field camera  100 . In other embodiments of the invention the light-field data formatting module  150  and/or the light-field data processor  155  may be provided in a separate component external to the light-field capture camera. The separate component may be local or remote with respect to the light-field image capture device. It will be appreciated that any suitable wired or wireless protocol may be used for transmitting light-field image data to the formatting module  150  or light-field data processor  155 ; for example, the light-field data processor may transfer captured light-field image data and/or other data via the Internet, a cellular data network, a WiFi network, a Bluetooth® communication protocol, and/or any other suitable means. 
         [0063]    The light-field data formatting module  150  is configured to generate data representative of the acquired light-field, in accordance with embodiments of the invention. The light-field data formatting module  150  may be implemented in software, hardware or a combination thereof. 
         [0064]    The light-field data processor  155  is configured to operate on raw light-field image data received directly from the LF data acquisition module  140  for example to generate formatted data and metadata in accordance with embodiments of the invention. Output data, such as, for example, still images, 2D video streams, and the like of the captured scene may be generated. The light-field data processor may be implemented in software, hardware or a combination thereof. 
         [0065]    In at least one embodiment, the light-field camera  100  may also include a user interface  160  for enabling a user to provide user input to control operation of camera  100  by controller  170 . Control of the camera may include one or more of control of optical parameters of the camera such as shutter speed, or in the case of an adjustable light-field camera, control of the relative distance between the microlens array and the photosensor, or the relative distance between the objective lens and the microlens array. In some embodiments, the relative distances between optical elements of the light-field camera may be manually adjusted. Control of the camera may also include control of other light-field data acquisition parameters, light-field data formatting parameters or light-field processing parameters of the camera. The user interface  160  may comprise any suitable user input device(s) such as a touchscreen, buttons, keyboard, pointing device, and/or the like. In this way, input received by the user interface can be used to control and/or configure the LF data formatting module  150  for controlling the data formatting, the LF data processor  155  for controlling the processing of the acquired light-field data and controller  170  for controlling the light-field camera  100 . 
         [0066]    The light-field camera includes a power source  180 , such as one or more replaceable or rechargeable batteries. The light-field camera comprises memory  190  for storing captured light-field data and/or processed light-field data or other data such as software for implementing methods of embodiments of the invention. The memory can include external and/or internal memory. In at least one embodiment, the memory can be provided at a separate device and/or location from camera  100 . In one embodiment, the memory includes a removable/swappable storage device such as a memory stick. 
         [0067]    The light-field camera may also include a display unit  165  (e.g., an LCD screen) for viewing scenes in front of the camera prior to capture and/or for viewing previously captured and/or rendered images. The screen  165  may also be used to display one or more menus or other information to the user. The light-field camera may further include one or more I/O interfaces  195 , such as FireWire or Universal Serial Bus (USB) interfaces, or wired or wireless communication interfaces for data communication via the Internet, a cellular data network, a WiFi network, a Bluetooth® communication protocol, and/or any other suitable means. The I/O interface  195  may be used for transferring data, such as light-field representative data generated by LF data formatting module in accordance with embodiments of the invention and light-field data such as raw light-field data or data processed by LF data processor  155 , to and from external devices such as computer systems or display units, for rendering applications. 
         [0068]      FIG. 2  is a block diagram illustrating a particular embodiment of a potential implementation of light-field data formatting module  250  and the light-field data processor  253 . 
         [0069]    The circuit  200  includes memory  290 , a memory controller  245  and processing circuitry  240  comprising one or more processing units (CPU(s)). The one or more processing units  240  are configured to run various software programs and/or sets of instructions stored in the memory  290  to perform various functions including light-field data formatting and light-field data processing. Software components stored in the memory include a data formatting module (or set of instructions)  250  for generating data representative of acquired light data in accordance with embodiments of the invention and a light-field data processing module (or set of instructions)  255  for processing light-field data in accordance with embodiments of the invention. Other modules may be included in the memory for applications of the light-field camera device such as an operating system module  251  for controlling general system tasks (e.g. power management, memory management) and for facilitating communication between the various hardware and software components of the device  200 , and an interface module  252  for controlling and managing communication with other devices via I/O interface ports. 
         [0070]    Embodiments of the invention provide a representation of light-field data based on rays of light sensed by the pixels of the sensor of a camera or simulated by a computer-generated scene system. Indeed, another source of light-field data may be post-produced data that are modified, for instance color graded, light-field data obtained from an optical device or CGI. It is also now common in the movie industry to have data that are a mix of both data acquired using an optical acquisition device, and CGI data. It is to be understood that the pixel of a sensor can be simulated by a computer-generated scene system and, by extension, the whole sensor can be simulated by said system. From here, it is understood that any reference to a “pixel of a sensor” or a “sensor” can be either a physical object attached to an optical acquisition device or a simulated entity obtained by a computer-generated scene system. 
         [0071]    Knowing that whatever the type of acquisition system, to a pixel of the sensor of said acquisition system corresponds at least a linear light trajectory, or ray of light, in space outside the acquisition system, data representing the ray of light in a three-dimensional (or 3D) space are computed. 
         [0072]    In a first embodiment,  FIG. 3  illustrates a ray of light passing through two reference planes P 1  and P 2  used for parameterization positioned parallel to one another and located at known depths z 1  and z 2  respectively. The ray of light intersects the first reference plane P 1  at depth z 1  at intersection point (x 1 , y 1 ) and intersects the second reference plane P 2  at depth z 2  at intersection point (x 2 , y 2 ). In this way, given z 1  and z 2 , the ray of light can be identified by four coordinates (x 1 , y 1 , x 2 , y 2 ). The light-field can thus be parameterized by a pair of reference planes for parameterization P 1 , P 2  also referred herein as parametrization planes, with each ray of light being represented as a point (x 1 , y 1 , x 2 , y 2 ,)εR 4  in 4D ray space. 
         [0073]    In a second embodiment represented on  FIG. 4 , the ray of light is parametrized by means a point of intersection between a reference plane P 3  located at known depths z 3  and the ray of light. The ray of light intersects the reference plane P 3  at depth z 3  at intersection point (x 3 ,y 3 ). A normalized vector v, which provides the direction of the ray of light in space has the following coordinates: (v x , v y , √{square root over (1−(v x   2 +v y   2 ))}), since v z =√{square root over (1−(v x   2 +v y   2 ))}v z  is assumed to be positive and it can be recalculated knowing v x  and v y , the vector can be described only by its two first coordinates (v x , v y ). 
         [0074]    According to this second embodiment, the ray of light may be identified by four coordinates (x 3 , y 3 , v x , v y ). The light-field can thus be parameterized by a reference plane for parameterization P 3  also referred herein as parametrization plane, with each ray of light being represented as a point (x 3 , y 3 , v x , v y )εR 4  in 4D ray space. 
         [0075]    The parameters representing a ray of light in 4D ray space are computed by the light-field data formatting module  150 .  FIG. 5  is a flow chart illustrating the steps of a method for formatting the light-field data acquired by the camera  100  according to an embodiment of the invention. This method is executed by the light-field data formatting module  150 . 
         [0076]    In case the light-field acquisition system is calibrated using a pinhole model, the basic projection model, without distortion, is given by the following equation: 
         [0000]    
       
         
           
             
               ( 
               
                 
                   
                     u 
                   
                 
                 
                   
                     v 
                   
                 
                 
                   
                     1 
                   
                 
               
               ) 
             
             = 
             
               
                 1 
                  
                 
                   / 
                 
                  
                 
                   
                     Z 
                     c 
                   
                    
                   
                     ( 
                     
                       
                         
                           f 
                         
                         
                           0 
                         
                         
                           
                             c 
                             u 
                           
                         
                         
                           0 
                         
                       
                       
                         
                           0 
                         
                         
                           f 
                         
                         
                           
                             c 
                             v 
                           
                         
                         
                           0 
                         
                       
                       
                         
                           0 
                         
                         
                           0 
                         
                         
                           1 
                         
                         
                           0 
                         
                       
                     
                     ) 
                   
                 
                  
                 
                   ( 
                   
                     
                       
                         
                           X 
                           c 
                         
                       
                     
                     
                       
                         
                           Y 
                           c 
                         
                       
                     
                     
                       
                         
                           Z 
                           c 
                         
                       
                     
                     
                       
                         1 
                       
                     
                   
                   ) 
                 
               
               = 
               
                 ( 
                 
                   
                     
                       
                         
                           f 
                            
                           
                             
                               X 
                               C 
                             
                             
                               Z 
                               c 
                             
                           
                         
                         + 
                         
                           c 
                           u 
                         
                       
                     
                   
                   
                     
                       
                         
                           f 
                            
                           
                             
                               Y 
                               C 
                             
                             
                               z 
                               c 
                             
                           
                         
                         + 
                         
                           c 
                           v 
                         
                       
                     
                   
                   
                     
                       1 
                     
                   
                 
                 ) 
               
             
           
         
       
     
         [0077]    where
       f is the focal length of the main lens of the camera  100 ,   c u  and c v  are the coordinates of the intersection of the optical axis of the camera  100  with the sensor,   (χ c , Y c , Z c , 1) T  is the position in the camera coordinate system of a point in the space sensed by the camera,   (u, v, 1) T  are the coordinates, in the sensor coordinate system, of the projection of the point which coordinates are (χ c , Y c , Z c , 1) T  in the camera coordinate system on the sensor of the camera.       
 
         [0082]    In a step  501 , the light-field data formatting module  150  computes the coordinates of a vector V representing the direction of the ray of light in space that is sensed by the pixel of the sensor which coordinates are (u, v, 1) T  in the sensor coordinate system. In the sensor coordinate system, the coordinates of vector V are: 
         [0000]      ( u−c   u   ,v−c   v   ,f ) T . 
         [0083]    In the pinhole model, the coordinates of the intersection of the ray of light sensed by the pixel which coordinates are (u,v, 1) T , with a plane placed at coordinate Z 1  from the pinhole and parallel to the sensor plane are: 
         [0000]    
       
         
           
             
               ( 
               
                 
                   
                     ( 
                     
                       u 
                       - 
                       
                         c 
                         u 
                       
                     
                     ) 
                   
                    
                   
                     
                       Z 
                       1 
                     
                     f 
                   
                 
                 , 
                 
                   
                     ( 
                     
                       v 
                       - 
                       
                         c 
                         v 
                       
                     
                     ) 
                   
                    
                   
                     
                       Z 
                       1 
                     
                     f 
                   
                 
                 , 
                 
                   Z 
                   1 
                 
               
               ) 
             
             T 
           
         
       
     
         [0084]    and are computed during a step  502 . 
         [0085]    If several acquisitions are mixed, i.e. acquisition of light-field data by different types of cameras, then a single coordinate system is used. In this situation, modifications of coordinates of the points and vectors should be modified accordingly. 
         [0086]    According to an embodiment of the invention, the sets of coordinates defining the rays of light sensed by the pixels of the sensor of the camera and computed during steps  501  and  502  are regrouped in maps. In another embodiment, the rays of light are directly computed by a computer-generated scene system that simulates the propagation of rays of light. 
         [0087]    In an embodiment of the invention, these maps are associated with a color map of the light-field data to be transmitted to a receiver. Thus in this embodiment, to each pixel (u, v) of the sensor of the camera, parameter representative of the color data associated to a ray of light sensed by a given pixel and a quadruplet of floating point values (χ 1  χ 2  χ 3  χ 4 ) which correspond either to (x 1 , y 1 , x 2 , y 2 ,) when light-field can thus be parameterized by a pair of reference planes for parameterization P 1 , P 2  or (x 3 , y 3 , v x , y v ) when the ray of light is parametrized by means of a normalized vector. In the following description, the quadruplet of floating point values (χ 1  χ 2  χ 3  χ 4 ) is given by: 
         [0000]    
       
         
           
             
               χ 
               1 
             
             = 
             
               
                 ( 
                 
                   u 
                   - 
                   
                     c 
                     u 
                   
                 
                 ) 
               
                
               
                 
                   Z 
                   1 
                 
                 f 
               
             
           
         
       
       
         
           
             
               χ 
               2 
             
             = 
             
               
                 ( 
                 
                   v 
                   - 
                   
                     c 
                     v 
                   
                 
                 ) 
               
                
               
                 
                   Z 
                   1 
                 
                 f 
               
             
           
         
       
       
         
           
             
               χ 
               3 
             
             = 
             
               
                 ( 
                 
                   u 
                   - 
                   
                     c 
                     u 
                   
                 
                 ) 
               
                
               
                 
                   Z 
                   2 
                 
                 f 
               
             
           
         
       
       
         
           
             
               χ 
               4 
             
             = 
             
               
                 ( 
                 
                   v 
                   - 
                   
                     c 
                     v 
                   
                 
                 ) 
               
                
               
                 
                   
                     z 
                     2 
                   
                   f 
                 
                 . 
               
             
           
         
       
     
         [0088]    In another embodiment, the acquisition system is not calibrated using a pinhole model, consequently the parametrization by two planes is not recalculated from a model. Instead, the parametrization by two planes has to be measured during a calibration operation of the camera. This may be for instance the case for a plenoptic camera which includes in between the main lens and the sensor of the camera a micro-lens array. 
         [0089]    In yet another embodiment, these maps are directly simulated by a computer-generated scene system or post-produced from acquired data. 
         [0090]    Since a ray of light sensed by a pixel of the sensor of the camera is represented by a quadruplet (χ 1  χ 2  χ 3  χ 4 ) of floating point, it is possible to put these four parameters into four maps of parameters, e.g. a first map comprising the parameter χ 1  of each ray of light sensed by a pixel of the sensor of the camera, a second map comprising the parameter χ 2 , a third map comprising the parameter χ 3  and a fourth map comprising the parameter χ 4 . Each of the four above-mentioned maps, called χ i  maps, have the same size as the acquired light-field image itself but have floating points content. 
         [0091]    After some adaptations taking into account the strong correlation between parameters representing rays of light sensed by adjacent pixels and arranging the population of rays of light, and consequently the parameters that represent them, these four maps can be compressed using similar tools as for video data. 
         [0092]    In order to compress the values of the floating points (χ 1  χ 2  χ 3  χ 4 ) and thus reduce the size of the χ i  maps to be transmitted, the light-field data formatting module  150  computes, in a step  503 , for each χ i  maps an equation of a plane fitting the values of said parameter χ i  comprised in the χ i  map. The equation of the fitting plane for the parameter χ i  is given by: 
         [0000]      {tilde over (χ)} i     (u,v)   =α i   u+β   i   v+γ   i  
 
         [0000]    where u and v are the coordinates of a given pixel of the sensor of the camera. 
         [0093]    In a step  504 , for each χ i  map, parameters α i , β i , γ i  are computed to minimize the error: 
         [0000]      ∥(χ i     (u,v)   −α i   u−β   i   v−γ   i )∥.
 
         [0000]    The result of the computation of step  504  is a parameter: 
         [0000]      χ′ i     u,v   =χ i     (u,v)   −(α i   u+β   i   v+γ   i )
 
         [0000]    that corresponds to the difference of the value of parameter χ i  with the plane fitting the values of said parameter χ i , resulting in a much lower range of amplitude of the values comprised in the χ i  map. 
         [0094]    It possible to compress the value X′ i     u,v    by computing X″ i     u,v   =X′ i     u,v   −min(X′ i     u,v   ) in a step  505 . 
         [0095]    Then, in a step  506 , a value X′″ i     u,v    of former parameter χ i  may be computed so that the value of parameter X′″ i     u,v    range from 0 to 2 N −1 included, where N is a chosen number of bits corresponding to the capacity of the encoder intend to be used for encoding the light-field data to be sent. The value of the parameter X′″ i     u,v    is given by: 
         [0000]    
       
         
           
             
               χ 
               
                 i 
                 
                   u 
                   , 
                   v 
                 
               
               ′′′ 
             
             = 
             
               
                 
                   ( 
                   
                     
                       2 
                       N 
                     
                     - 
                     1 
                   
                   ) 
                 
                 * 
                 
                   χ 
                   
                     i 
                     
                       u 
                       , 
                       v 
                     
                   
                   ″ 
                 
               
               
                 max 
                  
                 
                   ( 
                   
                     χ 
                     
                       i 
                       
                         u 
                         , 
                         v 
                       
                     
                     ″ 
                   
                   ) 
                 
               
             
           
         
       
     
         [0096]    In a step  507 , the light-field data formatting module  150  generates four maps, X′″ 1     u,v    map, X′″ 2     u,v    map, X′″ 3     u,v    map and X′″ 4     u,v    map, corresponding to each of the parameters (χ 1  χ 2  χ 3  χ 4 ) representing rays of light sensed by the pixels of the sensor of the camera. 
         [0097]    In a step  508 , the light-field data formatting module  150  generates a SEI (Supplemental Enhancement Information) message comprising the following fixed parameters α i , β i , (γ i +min(X′ i     u,v   )), max(X″ i     u,v   ) intended to be used during reciprocal computation on the receiver side to retrieve the original χ i     u,v    maps. These four parameters are considered as metadata conveyed in the SEI message the content of which is given by the following table: 
         [0000]    
       
         
               
               
               
             
           
               
                 TABLE 1 
               
               
                   
               
               
                 Length 
                   
                   
               
               
                 (bytes) 
                 Name 
                 Comment 
               
               
                   
               
             
             
               
                 1 
                 Message Type 
                 Value should be fixed in MPEG 
               
               
                   
                   
                 committee 
               
               
                 1 
                 Representation type 
                 ‘2points coordinates’ or ‘one point plus 
               
               
                   
                   
                 one vector’ 
               
               
                 4 
                 z1 
                 Z coordinate of the first plane 
               
               
                 4 
                 z2 
                 if type = ‘2points coordinates’, 
               
               
                   
                   
                 Z coordinate of the second plane 
               
               
                 4 
                 alpha_1 
                 plane coefficient α 
               
               
                 4 
                 beta_1 
                 plane coefficient β 
               
               
                 4 
                 gamma_1 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_1 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_2 
                 plane coefficient α 
               
               
                 4 
                 beta_2 
                 plane coefficient β 
               
               
                 4 
                 gamma_2 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_2 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_3 
                 plane coefficient α 
               
               
                 4 
                 beta_3 
                 plane coefficient β 
               
               
                 4 
                 gamma_3 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_3 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_4 
                 plane coefficient α 
               
               
                 4 
                 beta_4 
                 plane coefficient β 
               
               
                 4 
                 gamma_4 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_4 
                 max(χ″ i     u,v   ) 
               
               
                   
               
             
          
         
       
     
         [0098]    On the receiver side, the reciprocal computation enabling to retrieve the original χ i     u,v    maps is given by 
         [0000]              χ     i     u   ,   v       ″     =       χ     i     u   ,   v       ′′′            max        (     χ     i     u   ,   v       ″     )         2   N               χ i     u,v   =χ″ i     u,v   +α i   u+β   i   v +(γ i +min(χ′ i     u,v   )).  ii.
 
         [0099]    In a step  509 , the X′″ i     u,v    maps, the color map and the SEI message are transmitted to at least a receiver where these data are processed in order to render a light-filed content. 
         [0100]    It possible to further decrease the size of the maps representing the light-field data before their transmission to a receiver. The following embodiments are complementary of the one consisting of minimizing the error 
         [0000]      ∥(χ i     u,v   −α i   u−β   i   v−γ   i )∥.
 
         [0101]    In a first embodiment represented on  FIG. 6 , as the χ i     u,v    maps contain values with low spatial frequencies, it is possible to transmit only the derivative of a signal in a direction in space. 
         [0102]    For example, given χ i     0,0   , the value of parameter χ i  associated to the pixel of coordinates (0,0), the light-field data formatting module  150  computes, in a step  601 , the difference Δχ i     i,0    between the value χ i     i,0    of parameter χ i  associated to the pixel of coordinates (1,0) and the value χ i     0,0    of parameter χ i  associated to the pixel of coordinates (0,0): 
         [0000]      Δχ i     1,0   =χ i     1,0   −χ i     0,0    
 
         [0103]    More generally, during step  601 , the light-field data formatting module  150  computes a difference between a value of parameter χ i  associated to a given pixel of the sensor and a value of parameter χ i  associated to another pixel preceding the given pixel in a row of the sensor of the optical acquisition system or of a computer-generated scene system: 
         [0000]      Δχ i     u+1,v   =χ i     u+1,v   −χ i     u,v   .
 
         [0104]    When the given pixel is the first pixel of a row of the sensor, the light-field data formatting module  150  computes a difference between a value of parameter χ i  associated to the given pixel and a value of parameter χ i  associated to the first pixel of a row preceding the row to which the given pixel belongs: 
         [0000]      Δχ i     0,v+1   =χ i     0,v+1   −χ i     0,v   .
 
         [0105]    In a step  602 , the Δχ i     u,v    maps, the color map and the SEI message, generated during step  508 , are transmitted to at least a receiver where these data are processed in order to render a light-filed content. 
         [0106]    In a second embodiment, as the χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v    maps contain values having very slow spatial frequencies, it is possible to perform a spatial down-sampling in both dimensions of the χ i     u,v    map and then to recover the entire χ i     u,v    map on the receiver side by making a linear interpolation between transmitted samples of said χ i     u,v    maps. 
         [0107]    For instance if we can reduce the size of the maps from N_rows*M_columns to from N_rows/2*M_columns/2. At reception the maps can be extended to original size; the created holes can be filled by an interpolation method (or so-called up-sampling process). A simple bilinear interpolation is generally sufficient 
         [0000]      χ i     u,v   =(χ i     u−1,v−1   +χ i     u+1,v−1   +χ i     u−1,v+1   +χ i     u+1,v+1   )/4
 
         [0108]    In a third embodiment represented on  FIG. 7 , each χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v    maps may be transmitted to a receiver using four independent monochrome codecs, such as h265/HEVC for example. 
         [0109]    In a fourth embodiment, the χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v    maps may be grouped in a single image as represented on  FIG. 8 . In order to reach this goal, one method consists in reducing the size of the maps by a factor  2  using the subsampling method, as in the second embodiment, and then in joining the χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v    maps each in a quadrant of an image having the same size as the color map. This method is usually named “frame packing” as it packs several frame into a single one. Adequate meta-data should be transmitted, for instance in the SEI message, to signal the way the frame packing has been performed such that the decoder can adequately unpack the frames. The packed maps into a single frame can be then transmitted using a single monochrome codec, such as, but not limited to, H265/HEVC for example 
         [0110]    In this case, the SEI message as presented in Table 1 must also contain a flag indicating a frame packing method has been used to pack the 4 maps in a single one (refer to Table 1b). 
         [0000]    
       
         
               
               
               
             
           
               
                 TABLE 1b 
               
               
                   
               
               
                 Length 
                   
                   
               
               
                 (bytes) 
                 Name 
                 Comment 
               
               
                   
               
             
             
               
                 1 
                 Message Type 
                 Value should be fixed in MPEG 
               
               
                   
                   
                 committee 
               
               
                 1 
                 Representation type 
                 ‘2points coordinates’ or ‘one point plus 
               
               
                   
                   
                 one vector’ 
               
               
                 4 
                 z1 
                 Z coordinate of the first plane 
               
               
                 4 
                 z2 
                 if type = ‘2points coordinates’, 
               
               
                   
                   
                 Z coordinate of the second plane 
               
               
                 1 
                 Packing mode 
                 0: means no frame packing (separated 
               
               
                   
                   
                 single maps); 
               
               
                   
                   
                 1: means frame packing (single 4 
               
               
                   
                   
                 quadrants map) 
               
               
                 4 
                 alpha_1 
                 plane coefficient α 
               
               
                 4 
                 beta_1 
                 plane coefficient β 
               
               
                 4 
                 gamma_1 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_1 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_2 
                 plane coefficient α 
               
               
                 4 
                 beta_2 
                 plane coefficient β 
               
               
                 4 
                 gamma_2 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_2 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_3 
                 plane coefficient α 
               
               
                 4 
                 beta_3 
                 plane coefficient β 
               
               
                 4 
                 gamma_3 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_3 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_4 
                 plane coefficient α 
               
               
                 4 
                 beta_4 
                 plane coefficient β 
               
               
                 4 
                 gamma_4 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_4 
                 max(χ″ i     u,v   ) 
               
               
                   
               
             
          
         
       
     
         [0111]    When several cameras are grouped to form a rig, it is better and more consistent to define a single world coordinate system and 2 parametrization planes common for all the cameras. Then the description message (SEI for instance) can contain common information (representation type, z1 and z2) plus the description parameters of the 4 maps (χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v   ) for each camera as shown in table 2. 
         [0112]    In that case χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v    maps may be transmitted to a receiver using monochrome codecs taking into account the multi-view aspect of the configuration such as MPEG Multiview Video coding (MVC) or MPEG Multiview High Efficiency Video Coding (MV-HEVC) for example. 
         [0000]    
       
         
               
               
               
             
               
             
               
               
               
             
           
               
                 TABLE 2 
               
               
                   
               
               
                 Length 
                   
                   
               
               
                 (bytes) 
                 Name 
                 Comment 
               
               
                   
               
             
             
               
                 1 
                 Message Type 
                 Value should be fixed in MPEG 
               
               
                   
                 committee 
               
               
                 1 
                 Representation type 
                 ‘2points coordinates’ or ‘one point plus 
               
               
                   
                   
                 one vector’ 
               
               
                 4 
                 z1 
                 Z coordinate of the first plane 
               
               
                 4 
                 z2 
                 if type = ‘2points coordinates’, 
               
               
                   
                   
                 Z coordinate of the second plane 
               
             
          
           
               
                 For each set of 4 component maps 
               
             
          
           
               
                 1 
                 Packing mode 
                 0: means no frame packing 
               
               
                   
                   
                 (single map); 
               
               
                   
                   
                 1: means frame packing 
               
               
                   
                   
                 (4 quadrants) 
               
               
                 4 
                 alpha_1 
                 plane coefficient α 
               
               
                 4 
                 beta_1 
                 plane coefficient β 
               
               
                 4 
                 gamma_1 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_1 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_2 
                 plane coefficient α 
               
               
                 4 
                 beta_2 
                 plane coefficient β 
               
               
                 4 
                 gamma_2 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max _2 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_3 
                 plane coefficient α 
               
               
                 4 
                 beta_3 
                 plane coefficient β 
               
               
                 4 
                 gamma_3 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max _3 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_4 
                 plane coefficient α 
               
               
                 4 
                 beta_4 
                 plane coefficient β 
               
               
                 4 
                 gamma_4 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_4 
                 max(χ″ i     u,v   ) 
               
               
                   
               
             
          
         
       
     
         [0113]    In a fifth embodiment, when modifications of the χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v    maps are null during a certain amount of time, these χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v    are marked as skipped and are not transferred to the receiver. In this case, the SEI message comprises a flag indicating to the receiver that no change has occurred on the χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v    since their last transmission. The content of such a SEI message is shown on table 3: 
         [0000]    
       
         
               
               
               
             
               
             
               
               
               
             
               
             
               
               
               
             
           
               
                 TABLE 3 
               
               
                   
               
               
                 Length 
                   
                   
               
               
                 (bytes) 
                 Name 
                 Comment 
               
               
                   
               
             
             
               
                 1 
                 Message Type 
                 Value should be fixed in MPEG committee 
               
               
                 1 
                 Skip_flag 
                 0: means further data are present; 
               
               
                   
                   
                 1 means keep previous registered parameters 
               
             
          
           
               
                 If !skip_flag 
               
             
          
           
               
                 1 
                 Representation 
                 ‘2points coordinates’ or ‘one point 
               
               
                   
                 type 
                 plus one vector’ 
               
               
                 4 
                 z1 
                 Z coordinate of the first plane 
               
               
                 4 
                 z2 
                 if type = ‘2points coordinates’, Z 
               
               
                   
                   
                 coordinate of the second plane 
               
             
          
           
               
                 For each quadrant 
               
             
          
           
               
                 1 
                 Packing mode 
                 0: means no frame packing (single 
               
               
                   
                   
                 map); 
               
               
                   
                   
                 1: means frame packing (4 
               
               
                   
                   
                 quadrants) 
               
               
                 4 
                 alpha_1 
                 plane coefficient α 
               
               
                 4 
                 beta_1 
                 plane coefficient β 
               
               
                 4 
                 gamma_1 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_1 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_2 
                 plane coefficient α 
               
               
                 4 
                 beta_2 
                 plane coefficient β 
               
               
                 4 
                 gamma_2 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_2 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_3 
                 plane coefficient α 
               
               
                 4 
                 beta_3 
                 plane coefficient β 
               
               
                 4 
                 gamma_3 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_3 
                 max(χ″ i     u,v   ) 
               
               
                 4 
                 alpha_4 
                 plane coefficient α 
               
               
                   
                 beta_4 
                 plane coefficient β 
               
               
                 4 
                 gamma_4 
                 plane coefficient γ + min(χ′ u,v ) 
               
               
                 4 
                 max_4 
                 max(χ″ i     u,v   ) 
               
               
                   
               
             
          
         
       
     
         [0114]    In a sixth embodiment, as the modifications of acquisition system parameters, represented in the χ i     u,v    maps, X′″ i     u,v    maps or Δχ i     u,v   , are slowly modified in time, it is worthwhile to transmit them to a receiver with a frame rate slower than the frame rate of the color map. The frequency of the transmission of the χ i     u,v    maps, χ′″ i     u,v    maps or Δχ i     u,v    must be at least the one of the IDR frames. 
         [0115]    In a seventh embodiment, the color maps use the YUV or RGB format and are coded with a video coder such as MPEG-4 AVC, h265/HEVC, or h266, etc. or an image coder such as JPEG, JPEG2000, MJEG. When several cameras are used to acquire the light-field content, color maps may be coded relatively using the MV-HEVC codec. 
         [0116]    Although the present invention has been described hereinabove with reference to specific embodiments, the present invention is not limited to the specific embodiments, and modifications will be apparent to a skilled person in the art which lie within the scope of the present invention. 
         [0117]    Many further modifications and variations will suggest themselves to those versed in the art upon making reference to the foregoing illustrative embodiments, which are given by way of example only and which are not intended to limit the scope of the invention, that being determined solely by the appended claims. In particular the different features from different embodiments may be interchanged, where appropriate.