File size: 963 Bytes
fe48447 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 |
---
license: other
license_name: exaone
license_link: LICENSE
language:
- en
- ko
tags:
- lg-ai
- exaone
- exaone-3.5
pipeline_tag: text-generation
library_name: transformers
---
# Updates in EXAONE-3.5
## Key Changes
- **RoPE Scaling Parameter**: Added to support longer `context_length`.
- **Memory Optimization**: For the 2.4B model, `tie_word_embeddings` is set to `True` for improved memory efficiency.
⚠️ Using the original [Llamafy script](https://huggingface.co/maywell/EXAONE-3.0-7.8B-Instruct-Llamafied) as-is may lead to performance degradation.
To address this, I have updated the script and uploaded the Llamafied version of the model.
## Special Thanks
- **[@maywell](https://huggingface.co/maywell)**
For updating the code and uploading the model.
- **LG AI Research**
For releasing the original model.
Check out the [original release here](https://huggingface.co/collections/LGAI-EXAONE/exaone-35-674d0e1bb3dcd2ab6f39dbb4). |