Patent ID: 11877018
Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC H

Claim 24:
25. A non-transitory computer-readable medium comprising instructions which, when executed by at least one processor, cause the at least one processor to:
capture a live video by an image capture device;
receive, by an ingest device, one or more raw frames of the live video from the image capture device and sampling, by the ingest device, a fraction of a raw frame of the one or more raw frames as patches;
allocate, by the ingest device, all or part of an available bandwidth as a bandwidth for transmitting sampled patches and a bandwidth for transmitting the live video, respectively;
receive, by a media server, the live video and the sampled patches from the ingest device;
train, by the media server, a deep neural network-based super-resolution model by subjecting the super-resolution model to an online learning by using the sampled patches as ground truth; and
perform, by the media server, a super-resolution process on the live video into a super-resolution live video by using the super-resolution model,
wherein based on the sampled patches having an encoding quality lower than the raw frame, the sampled patches are included in a transmission target to be transmitted to the media server, and
wherein the performing of the super-resolution process comprises:
when graphics processing unit (GPU) resources of a plurality of GPUs are available for the media server to use, performing a distributed super-resolution process by dividing each frame of the live video to be super-resolution-processed by a count of the GPU resources into divided frames and allocating the GPU resources to each of the divided frames.