A method for processing a three-dimensional image, the method comprising: receiving original color data and original depth data of each of four or more layers with respect to a three-dimensional image; selecting at least three reference layers from among the four or more layers, the number of reference layers being less than the total number of layers; mapping adjustment color values of pixels included in a non-selected layer, which is determined based on the original depth data of the non-selected layer and the at least three reference layers, to each of the at least three reference layers; and generating a computer generated hologram, CGH, image based on the original color values of the at least three reference layers and the mapped adjustment color values, wherein the mapping the adjustment color values comprises: determining respective adjustment color values of pixels included in the non-selected layer in correspondence with each of the at least three reference layers based on a respective distance between the non-selected layer and each of the at least three reference layers; and mapping the determined adjustment color values of the pixels to each of the at least three reference layers, wherein the determining the adjustment color values comprises determining the respective adjustment color values by applying a respective weight value to color values of the pixels included in the non-selected layer, and wherein each respective weight value is set in inverse proportion to a difference between a respective depth of a corresponding pixel included in the non-selected layer and a depth of the at least three reference layers. receiving original color data and original depth data of each of four or more layers with respect to a three-dimensional image; selecting at least three reference layers from among the four or more layers, the number of reference layers being less than the total number of layers; mapping adjustment color values of pixels included in a non-selected layer, which is determined based on the original depth data of the non-selected layer and the at least three reference layers, to each of the at least three reference layers; and generating a computer generated hologram, CGH, image based on the original color values of the at least three reference layers and the mapped adjustment color values, wherein the mapping the adjustment color values comprises: determining respective adjustment color values of pixels included in the non-selected layer in correspondence with each of the at least three reference layers based on a respective distance between the non-selected layer and each of the at least three reference layers; and mapping the determined adjustment color values of the pixels to each of the at least three reference layers, wherein the determining the adjustment color values comprises determining the respective adjustment color values by applying a respective weight value to color values of the pixels included in the non-selected layer, and wherein each respective weight value is set in inverse proportion to a difference between a respective depth of a corresponding pixel included in the non-selected layer and a depth of the at least three reference layers. determining respective adjustment color values of pixels included in the non-selected layer in correspondence with each of the at least three reference layers based on a respective distance between the non-selected layer and each of the at least three reference layers; and mapping the determined adjustment color values of the pixels to each of the at least three reference layers, wherein the determining the adjustment color values comprises determining the respective adjustment color values by applying a respective weight value to color values of the pixels included in the non-selected layer, and wherein each respective weight value is set in inverse proportion to a difference between a respective depth of a corresponding pixel included in the non-selected layer and a depth of the at least three reference layers.