dev-slx commited on
Commit
ca0b3d6
·
verified ·
1 Parent(s): 327cae5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -26,9 +26,12 @@ _Fast Inference with Customization:_ Once trained, the ELM model architecture pe
26
  ## ELM-v0.1 Model Release
27
  This repository contains code to run our ELM models. The current ELM model `elm-v0.1` (named _Rambutan_) was pre-trained (an intermediate checkpoint was used) and then instruction fine-tuned for downstream tasks.
28
 
29
- Models are located in the `models` folder. ELM models in this repository comes in three sizes (elm-1.0, elm-0.75 and elm-0.25) and supports the following use-case.
30
  - news_classification
31
 
 
 
 
32
 
33
  ## Setup ELM
34
  ### Download ELM repo
 
26
  ## ELM-v0.1 Model Release
27
  This repository contains code to run our ELM models. The current ELM model `elm-v0.1` (named _Rambutan_) was pre-trained (an intermediate checkpoint was used) and then instruction fine-tuned for downstream tasks.
28
 
29
+ ELM models (in the `models` folder) in this repository come in three sizes (elm-1.0, elm-0.75 and elm-0.25). **All these different slices are derived from the same ELM-1.0 finetuned checkpoint** and supports the following use-case.
30
  - news_classification
31
 
32
+ ```note
33
+ NOTE: ELM-v0.1 is an early version finetuned from an intermediate pretrained checkpoint & without any KV caching, decoding optimizations, or quantization applied.
34
+ ```
35
 
36
  ## Setup ELM
37
  ### Download ELM repo