SABER-LLM

Unofficial mirror of SABER-LLM by the original authors Zhao, Tian and Xie. Model weights and inference configuration files are unchanged. Maintained by mcflurryshuoz; not an official author release.

All four Safetensors shards, the model index, tokenizer, processors and speech dictionary are included. Training state and local download logs are excluded. Follow the upstream inference instructions and original project for ms-swift usage.

The upstream model repository requires acceptance of its access conditions. Refer to the original repository for those conditions. The upstream project's Apache-2.0 license is preserved in LICENSE.

Downloads last month
-
Safetensors
Model size
9B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for mcflurryshuoz/SABER-LLM

Finetuned
(83)
this model

Paper for mcflurryshuoz/SABER-LLM