Patent ID: 11895287
Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. An electronic device comprising:
a memory configured to store a plurality of images; and
at least one processor configured to execute a machine learning-based multi-plane image generating module generating an image of an arbitrary viewpoint from the plurality of images stored in the memory,
wherein, when the multi-plane image generating module is executed, the processor is configured to:
select a first image from the plurality of images as a reference;
select at least two overlapping images from the plurality of images by performing geometric calibration on the plurality of images using the reference;
calculate a plane sweep volume including at least two layer images corresponding to at least two depth layers for each of the plurality of images, by using the at least two selected images and a result of the geometric calibration;
perform an operation of a deep neural network, which uses a softmax function as an activation function, on each of the at least two depth layers of the calculated plane sweep volume, for each of the plurality of images, to generate a plurality of multi-plane images having probability values respectively corresponding to the at least two depth layers thus calculated, and
generate the image of the arbitrary viewpoint by composing the plurality of multi-plane images thus generated and store the image of the arbitrary viewpoint in the memory.