AARon99 commited on
Commit
51b5f48
1 Parent(s): 81c8f53

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md CHANGED
@@ -1,3 +1,24 @@
1
  ---
2
  license: other
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
3
  ---
4
+ I am learning how to make LoRAs with Oobabooga, these data are for experimental and research purposes.
5
+
6
+ This is a Medical Knowledge LoRA made for use with this model: llama-2-70b-Guanaco-QLoRA-fp16
7
+ https://huggingface.co/TheBloke/llama-2-70b-Guanaco-QLoRA-fp16) (you can use the quantized version of the model too).
8
+
9
+ ---
10
+
11
+ Model lineage:
12
+
13
+ https://huggingface.co/timdettmers/guanaco-65b -> https://huggingface.co/Mikael110/llama-2-70b-guanaco-qlora -> https://huggingface.co/TheBloke/llama-2-70b-Guanaco-QLoRA-fp16
14
+
15
+ ---
16
+ Training Data and Formatting:
17
+
18
+ Training data were originally garnered from: https://huggingface.co/datasets/BI55/MedText
19
+
20
+ These training data were then formatted for use with the "Raw text file" training option in the Oobabooga text-generation-webui:
21
+ (https://github.com/oobabooga/text-generation-webui)
22
+
23
+ ---
24
+