|
--- |
|
license: other |
|
license_name: exaone |
|
license_link: LICENSE |
|
language: |
|
- en |
|
- ko |
|
tags: |
|
- lg-ai |
|
- exaone |
|
- exaone-3.5 |
|
pipeline_tag: text-generation |
|
library_name: transformers |
|
--- |
|
|
|
|
|
# Updates in EXAONE-3.5 |
|
|
|
## Key Changes |
|
- **RoPE Scaling Parameter**: Added to support longer `context_length`. |
|
- **Memory Optimization**: For the 2.4B model, `tie_word_embeddings` is set to `True` for improved memory efficiency. |
|
|
|
⚠️ Using the original [Llamafy script](https://huggingface.co/maywell/EXAONE-3.0-7.8B-Instruct-Llamafied) as-is may lead to performance degradation. |
|
|
|
To address this, I have updated the script and uploaded the Llamafied version of the model. |
|
|
|
## Special Thanks |
|
|
|
- **[@maywell](https://huggingface.co/maywell)** |
|
For updating the code and uploading the model. |
|
|
|
- **LG AI Research** |
|
For releasing the original model. |
|
Check out the [original release here](https://huggingface.co/collections/LGAI-EXAONE/exaone-35-674d0e1bb3dcd2ab6f39dbb4). |
