Update README.md

README.md

@@ -18,11 +18,39 @@ This model is a fine-tuned version of [databricks/dolly-v2-3b](https://huggingfa
 
 ## Model description
 
-This is a peft model, hence 
-
+This is a PEFT model, hence the model file and the config files are
+* adapter_model.bin
+* adapter_config.bin
+
+This fined-tuned model was created with the following bitsandbytes config<br>
+
+BitsAndBytesConfig(load_in_8bit = True,
+                             bnb_4bit_quant_type = 'nf4',
+                             bnb_4bit_compute_type = torch.bfloat16,
+                             bnb_4bit_use_double_quant = True)
+
+The peft_config is as follows:
+
+peft_config  = LoraConfig(
+    lora_alpha=16,
+    lora_dropout = 0.1,
+    r = 64,
+    bias = "none",
+    task_type = "CAUSAL_LM",
+    target_modules = [
+        'query_key_value',
+        'dense',
+        'dense_h_to_4h',
+        'dense_4h_to_h'
+    ]
+)
+</br>
 ## Intended uses & limitations
 
-More information needed
+Model is intended for fair use only.
+
+
+
 
 ## Training and evaluation data