Enhancement and optimization of new heterogeneous accelerators based on Cyborg
Channel: OpenInfra Foundation
Date: 2020-10-28

Special thanks to our 2020 Open Infrastructure Summit sponsors for making the event possible: Canonical (Ubuntu), Huawei, VEXXHOST, Cisco, Tencent Cloud, InMotion Hosting, Mirantis, Red Hat, Trilio, VanillaStack.io, and ZTE!
--

With the rapid development of 5G, AI and edge computing, heterogeneous computing has become a trend, hardware accelerators have become a necessary function of VMs, and the accelerator management project Cyborg has emerged.
In the actual production environment, we have done a lot of improvement to make up for the lack of functions of Cyborg community and solve the problem of difficult management of users' hardware acceleration devices.
Such as, for functions  improvement, we have added vGPU and NVMe SSDs to current practical scenarios, enhanced the existing FPGA features, and improved the online binding and unbinding features of the accelerator cards. 
Also for performance optimization, we optimize resource data synchronization mechanism through data aggregation and transaction processing, solves the resource inconsistency problem of cloud platform,  which improves data synchronization performance by more than 30%.

Speakers: Brin Zhang, Shaohe Feng, wenping song
Track: AI, Machine Learning, HPC