Patent ID: 11877018
Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC H

Claim 0:
1. A live video ingest system for real-time streaming, comprising:
an ingest device configured to generate sampled patches by sampling patches which are a fraction of a frame of a live video generated by an image capture device, and to transmit the sampled patches and the live video by allocating and using a bandwidth for transmitting the sampled patches and a bandwidth for transmitting the live video, respectively; and
a media server configured to receive the sampled patches and the live video from the ingest device, to perform online-learning, based on the sampled patches, on a deep neural network-based super-resolution model, and to use the super-resolution model for super-resolution processing the live video into a super-resolution live video,
wherein based on the sampled patches having an encoding quality lower than the frame, the sampled patches are included in a transmission target to be transmitted to the media server,
wherein the media server comprises a super-resolution processor configured to use the super-resolution model for performing the super-resolution processing on the live video into the super-resolution live video, and
wherein the super-resolution processor is operable when graphics processing unit (GPU) resources of a plurality of GPUs are available for the media server to use, to perform a distributed super-resolution process on the super-resolution model by dividing each frame of the live video to be super-resolution-processed by a count of the GPU resources into divided frames and allocating the GPU resources to each of the divided frames.