samwit commited on
Commit
c8fecc7
1 Parent(s): 1349ebb

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ This is a fine-tuning of the LLaMa7B model in the style of the Alpaca dataset and setting but using LoRa.
2
+
3
+ For details of the data and hyper params - https://crfm.stanford.edu/2023/03/13/alpaca.html
4
+
5
+ This repo only contains the LoRa weights and not the original LLaMa weights which are research only.