A method for processing a plurality of multiview videos of a scene, in which each video is acquired by a corresponding camera arranged at a particular pose, and in which a view of each camera overlaps with the view of at least one other camera, comprising the steps of: obtaining side information for synthesizing a particular view of the multiview video; synthesizing a synthesized multiview video from the plurality of multiview videos and the side information; generating, for each block of a current picture, a motion vector predictor list, wherein the MVP list indexes a set of motion vectors associated with neighboring blocks in: the current picture; spatial reference pictures: temporal reference pictures; and synthesized reference pictures; determining, for each block of the current picture, a motion vector predictor from the set of motion vectors in the MVP list according to an index; deriving, for each block of the current picture, a motion vector based on the motion vector predictor; maintaining a reference picture list for each current picture of each of the plurality of multiview videos, the reference picture list indexing temporal reference pictures and spatial reference pictures of the plurality of acquired multiview videos and the synthesized reference pictures of the synthesized multiview video; and predicting each block of the current picture of the plurality of multiview videos according to a reference picture indexed by the associated reference picture list and the derived motion vector, wherein a check is made if the reference picture index, which may point to a synthetic, spatial, or temporal reference picture, points to a synthetic reference picture and, if false, the reference picture is set as the spatial or temporal reference picture and the MVP is set according to the index, and, if true, the reference picture is set as the synthetic reference picture and the value of the MVP is set to zero, wherein the steps are performed in a decoder. obtaining side information for synthesizing a particular view of the multiview video; synthesizing a synthesized multiview video from the plurality of multiview videos and the side information; generating, for each block of a current picture, a motion vector predictor list, wherein the MVP list indexes a set of motion vectors associated with neighboring blocks in: the current picture; spatial reference pictures: temporal reference pictures; and synthesized reference pictures; the current picture; spatial reference pictures: temporal reference pictures; and synthesized reference pictures; temporal reference pictures; and synthesized reference pictures; determining, for each block of the current picture, a motion vector predictor from the set of motion vectors in the MVP list according to an index; deriving, for each block of the current picture, a motion vector based on the motion vector predictor; maintaining a reference picture list for each current picture of each of the plurality of multiview videos, the reference picture list indexing temporal reference pictures and spatial reference pictures of the plurality of acquired multiview videos and the synthesized reference pictures of the synthesized multiview video; and predicting each block of the current picture of the plurality of multiview videos according to a reference picture indexed by the associated reference picture list and the derived motion vector, wherein a check is made if the reference picture index, which may point to a synthetic, spatial, or temporal reference picture, points to a synthetic reference picture and, if false, the reference picture is set as the spatial or temporal reference picture and the MVP is set according to the index, and, if true, the reference picture is set as the synthetic reference picture and the value of the MVP is set to zero, wherein the steps are performed in a decoder.