--- license: llama3 language: - ja - en base_model: rinna/llama-3-youko-70b pipeline_tag: text-generation --- **[2.2bpw](https://huggingface.co/rioshiina/llama-3-youko-70b-exl2/tree/2.2bpw)** (high quality loss, only for 24GB vRAM test.) **[4.0bpw](https://huggingface.co/rioshiina/llama-3-youko-70b-exl2/tree/4.0bpw)** **[6.0bpw](https://huggingface.co/rioshiina/llama-3-youko-70b-exl2/tree/6.0bpw)** **[8.0bpw](https://huggingface.co/rioshiina/llama-3-youko-70b-exl2/tree/8.0bpw)** # llama-3-youko-70b-exl2 - Model creator: [rinna](https://huggingface.co/rinna) - Original model: [llama-3-youko-70b](https://huggingface.co/rinna/llama-3-youko-70b) ## Prompt template ``` 西田幾多郎は、 ``` # Cite ```bibtex @misc{rinna-llama-3-youko-70b, title = {rinna/llama-3-youko-70b}, author = {Mitsuda, Koh and Chen, Xinqi and Wakatsuki, Toshiaki and Sawada, Kei}, url = {https://huggingface.co/rinna/llama-3-youko-70b} } @inproceedings{sawada2024release, title = {Release of Pre-Trained Models for the {J}apanese Language}, author = {Sawada, Kei and Zhao, Tianyu and Shing, Makoto and Mitsui, Kentaro and Kaga, Akio and Hono, Yukiya and Wakatsuki, Toshiaki and Mitsuda, Koh}, booktitle = {Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)}, month = {5}, year = {2024}, pages = {13898--13905}, url = {https://aclanthology.org/2024.lrec-main.1213}, note = {\url{https://arxiv.org/abs/2404.01657}} } ``` --- # References ```bibtex @article{llama3modelcard, title = {Llama 3 Model Card}, author = {AI@Meta}, year = {2024}, url = {https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md} } @software{gpt-neox-library, title = {{GPT}-{N}eo{X}: Large Scale Autoregressive Language Modeling in {P}y{T}orch}, author = {Andonian, Alex and Anthony, Quentin and Biderman, Stella and Black, Sid and Gali, Preetham and Gao, Leo and Hallahan, Eric and Levy-Kramer, Josh and Leahy, Connor and Nestler, Lucas and Parker, Kip and Pieler, Michael and Purohit, Shivanshu and Songz, Tri and Phil, Wang and Weinbach, Samuel}, doi = {10.5281/zenodo.5879544}, month = {8}, year = {2021}, version = {0.0.1}, url = {https://www.github.com/eleutherai/gpt-neox} } ``` --- # License [Meta Llama 3 Community License](https://llama.meta.com/llama3/license/)