lora
adamo1139 commited on
Commit
7877e04
1 Parent(s): 7f332a3

Update procedure/tips_and_tricks_for_training_with_qlora_on_cheap_desktop_PC.md

Browse files
procedure/tips_and_tricks_for_training_with_qlora_on_cheap_desktop_PC.md CHANGED
@@ -30,3 +30,4 @@ continous strings and if you train the model on raw book corpus, it will maybe a
30
  answer to question that could be answered by someone who read the book. For this, we need to transform the data from basic continous monologue to discussion where we have
31
  the name of the person who asks the question, followed by question, followed by newline and name of the person who responded to the question and an answer to the question.
32
  I've used this script as a base for my script https://pastebin.com/4DTKWpmY
 
 
30
  answer to question that could be answered by someone who read the book. For this, we need to transform the data from basic continous monologue to discussion where we have
31
  the name of the person who asks the question, followed by question, followed by newline and name of the person who responded to the question and an answer to the question.
32
  I've used this script as a base for my script https://pastebin.com/4DTKWpmY
33
+ TODO