Update README.md
Browse files
README.md
CHANGED
@@ -23,4 +23,9 @@ language:
|
|
23 |
- vicgalle/alpaca-gpt4
|
24 |
|
25 |
## Their LORAs can be found [here](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs)
|
26 |
-
In the final model only the 1e-4 LORAs have been used!
|
|
|
|
|
|
|
|
|
|
|
|
23 |
- vicgalle/alpaca-gpt4
|
24 |
|
25 |
## Their LORAs can be found [here](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs)
|
26 |
+
In the final model only the 1e-4 LORAs have been used!
|
27 |
+
Everything was trained a total of 2 epochs.
|
28 |
+
Following 3 are fp16, the other ones are fp32:
|
29 |
+
1. [this](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs/300mb-DB-CodeFeedback-Tinyllama)
|
30 |
+
2. [this](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs/tinyllama-rust)
|
31 |
+
3. [this](https://huggingface.co/dumb-dev/TinyLlama-1.1B-Chat-rust-cpp-encodings/tree/main/LORAs/tinyllama-cpp)
|