|
--- |
|
license: apache-2.0 |
|
--- |
|
|
|
# **Llamion-14B** |
|
|
|
We have released Llamion (Llamafied Orion) by transforming [Orion-14B](https://huggingface.co/OrionStarAI/Orion-14B-Chat) |
|
into [the standard LLaMA architecture](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py) |
|
through parameter mapping and offline distillation. |
|
Further technical specifications and study results will be detailed in our upcoming paper, available on this page. |
|
<!-- [our paper](). --> |
|
|
|
 |
|
|
|
### Development |
|
|
|
- VAIV Company AI Lab ([vaiv.kr](https://www.vaiv.kr/)) |
|
|
