GGUF
English
Aryanne commited on
Commit
f6e7958
1 Parent(s): 14cb525

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - Open-Orca/OpenOrca
5
+ - bigcode/starcoderdata
6
+ - cerebras/SlimPajama-627B
7
+ language:
8
+ - en
9
+ ---
10
+
11
+ Some GGUF v2 quantizations of the model [jeff31415/TinyLlama-1.1B-1T-OpenOrca](https://huggingface.co/jeff31415/TinyLlama-1.1B-1T-OpenOrca)
12
+
13
+ #### Base model:
14
+ PY007/TinyLlama-1.1B-intermediate-step-480k-1T
15
+
16
+ #### Dataset:
17
+ Fine tuned on OpenOrca GPT4 subset for 1 epoch,Using CHATML format
18
+
19
+ #### Model License:
20
+ Apache 2.0, following the TinyLlama base model.
21
+
22
+ #### Hardware and training details:
23
+ Hardware: 1*RTX A5000, ~16 hours to complete 1 epoch. GPU from autodl.com, cost around $3 for this finetuning.
24
+ https://wandb.ai/jeff200402/TinyLlama-Orca?workspace= for more details.