Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# Step-Audio-Tokenizer
|
2 |
+
|
3 |
+
|
4 |
+
Step-Audio LLM是业界首个拥有1300亿参数的类人化统一端到端模型,整合了多模态语音理解与生成能力,涵盖歌声合成、工具调用、角色扮演及多语言/方言理解与合成等功能。
|
5 |
+
|
6 |
+
Step-Audio LLM is the industry’s first 130-billion parameter hu-manlike unified end-to-end model that integrates multimodal speech un-derstanding and generation capabilities, including singing voice synthesis, tool utilization, role-play and multilingual/dialectal comprehension and synthesis.
|
7 |
+
|
8 |
+
本仓库提供 Step-Audio LLM的speech tokenizer模块。针对linguistic tokenization,我们采用 Paraformer 编码器的输出特征,将其量化至离散表示,码率为 16.7 Hz;针对semantic tokenization,我们使用 CosyVoice 的tokenizer——专为高效编码、自然且富有表现力的语音输出设计,码率为 25 Hz。
|
9 |
+
|
10 |
+
This repository provides the speech tokenizer component of Step-Audio LLM. For linguistic tokenization, we utilize the output from the Paraformer encoder, which is quantized into discrete representations at a token rate of 16.7 Hz. For semantic tokenization, we employ CosyVoice’s tokenizer, specifically designed to efficiently encode features essential for generating natural and expressive speech outputs, operating at a token rate of 25 Hz.
|
11 |
+
|
12 |
+
更多信息请参考我们的仓库: [Step-Audio](https://github.com/stepfun-ai/Step-Audio).
|
13 |
+
|
14 |
+
For more information, please refer to our repository: [Step-Audio](https://github.com/stepfun-ai/Step-Audio).
|