Update README.md
Browse files
README.md
CHANGED
@@ -26,9 +26,12 @@ _Fast Inference with Customization:_ Once trained, the ELM model architecture pe
|
|
26 |
## ELM-v0.1 Model Release
|
27 |
This repository contains code to run our ELM models. The current ELM model `elm-v0.1` (named _Rambutan_) was pre-trained (an intermediate checkpoint was used) and then instruction fine-tuned for downstream tasks.
|
28 |
|
29 |
-
|
30 |
- news_classification
|
31 |
|
|
|
|
|
|
|
32 |
|
33 |
## Setup ELM
|
34 |
### Download ELM repo
|
|
|
26 |
## ELM-v0.1 Model Release
|
27 |
This repository contains code to run our ELM models. The current ELM model `elm-v0.1` (named _Rambutan_) was pre-trained (an intermediate checkpoint was used) and then instruction fine-tuned for downstream tasks.
|
28 |
|
29 |
+
ELM models (in the `models` folder) in this repository come in three sizes (elm-1.0, elm-0.75 and elm-0.25). **All these different slices are derived from the same ELM-1.0 finetuned checkpoint** and supports the following use-case.
|
30 |
- news_classification
|
31 |
|
32 |
+
```note
|
33 |
+
NOTE: ELM-v0.1 is an early version finetuned from an intermediate pretrained checkpoint & without any KV caching, decoding optimizations, or quantization applied.
|
34 |
+
```
|
35 |
|
36 |
## Setup ELM
|
37 |
### Download ELM repo
|