Patent ID: 11895287
Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 7:
8. An operating method of an electronic device which generates an image of an arbitrary viewpoint, the method comprising:
reading a plurality of images impinging a plenoptic image from a memory of the electronic device;
selecting, by at least one processor of the electronic device, a first image from the plurality of images as a reference;
selecting, by the at least one processor of the electronic device, at least two overlapping images from the plurality of element images by performing geometric calibration on the plurality of images using the reference;
calculating, by the at least one processor, a plane sweep volume including at least two layer images corresponding to at least two depth layers for each of the plurality of images, by using the at least two selected images and a result of the geometric calibration.;
performing, by the at least one processor, an operation of a deep neural network, which uses a softmax function as an activation function, on each of the at least two depth layers of the calculated plane sweep volume, for each of the plurality of images, to generate a plurality of multi-plane images having probability values respectively corresponding to the at least two depth layers thus calculated; and
generating, by the at least one processor, the image of the arbitrary viewpoint by composing the plurality of multi-plane images thus generated and storing the image of the arbitrary viewpoint in the memory.