dumb-dev commited on
Commit
a17e7b2
1 Parent(s): 3920b6f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -23,4 +23,9 @@ language:
23
  - vicgalle/alpaca-gpt4
24
 
25
  ## Their LORAs can be found [here](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs)
26
- In the final model only the 1e-4 LORAs have been used!
 
 
 
 
 
 
23
  - vicgalle/alpaca-gpt4
24
 
25
  ## Their LORAs can be found [here](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs)
26
+ In the final model only the 1e-4 LORAs have been used!
27
+ Everything was trained a total of 2 epochs.
28
+ Following 3 are fp16, the other ones are fp32:
29
+ 1. [this](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs/300mb-DB-CodeFeedback-Tinyllama)
30
+ 2. [this](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs/tinyllama-rust)
31
+ 3. [this](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs/tinyllama-cpp)