[Huawei Developers] Jack Wu Shenzhen:
AV Pipeline Kit is a new product released in HMS Core 6.0 that embodies Huawei's effort to open its technologies in the media field. With a framework that enables you to design your own service scenarios, it equips your app with rich and customizable audio and video processing capabilities. The preset plugins and pipelines for audio and video collection, editing, and playback have simplified the development of audio and video apps, social apps, e-commerce apps, and more.

AV Pipeline Kit provides three major capabilities: pipeline customization, video super-resolution, and sound event detection.

With pipeline customization, you'll be able to build brand new media collection, editing, and playback capabilities and offer excellent user experience. Customized plugins will be automatically parsed by the framework of AV Pipeline Kit, and plugins will be used intelligently according to the hardware capabilities. On top of this, third-party plugins are also available for integration as long as they comply with the requirements of this kit, freeing you from complicated development work and allowing you to prioritize media service innovations.

Video super-resolution offers users an excellent experience even when they watch low-resolution videos. It supports frame-by-frame super-resolution during the playback of a low-resolution video to reduce noise and enhance color in real time, while high-resolution videos will be processed to deliver better images. Currently, resolutions from 270P to 720P and a maximum scale factor of 3 are supported. This capability also enables your app to flexibly adjust the super-resolution effect according to the video resolution and bit rate.

Another capability of AV Pipeline Kit is sound event detection, which detects sound events during audio playback in a fast and accurate manner. Currently, 13 types of sound events can be detected, like knocking on the door, vehicle horns, baby's cry, and sounds made by cats and dogs. With this capability integrated, your app will make users' home safer by detecting potential accidents around the home.

AV Pipeline Kit is easy to use, high performing, and consumes low power.

It provides preset pipelines that support basic media collection, editing, and playback capabilities. You can quickly integrate these pipelines into your app or tailor them to your specific service needs.

In terms of performance, AV Pipeline Kit ensures that data is uniformly encapsulated regardless of its formats, so that data will not be copied between modules. With hardware detection capabilities, the kit has managed to achieve more than 10% performance increase compared with traditional pipelines by preferentially calling nodes that support hardware acceleration.

A major difficulty in media app development has been to ensure better user experience by cutting power consumption. AV Pipeline Kit has managed to save power consumption by more than 20% by preferentially loading hardware capabilities, balancing out performance and power consumption. This is realized by a multi-modal media framework that always avoids unnecessary data copy and data format conversion.

With the open capabilities of AV Pipeline Kit, developing audio and video apps that deliver excellent user experience will be much easier.

View attachment 5374845​