Update README.md

README.md

@@ -63,8 +63,13 @@ Example:
 * 1 epoch
 * From chat LLaMA-2-7b
 
-# llama-2-13b-tagalog-v0.3 loras (09/01/2023)
-* Fine tuned on a dataset of ~1k items (Tagalog-focused dataset, based off Tagalog sentences augmented by LLaMA-2-13b base to create a 3-turn dialogue dataset between Human and Assistant)
-* 3/3a fine-tuned for 1 epoch, rank = 16/8
+# llama-2-13b-tagalog-v0.3 loras (09/01-02/2023)
+* Fine tuned on experimental datasets of ~1k items (Tagalog-focused dataset, based off Tagalog sentences augmented by LLaMA-2-13b base to create a 3-turn dialogue dataset between Human and Assistant)
+* 3 fine-tuned for 1 epoch, rank = 16
+* 3a for 1 epoch, rank = 8
+* 3b for 2 epochs
+* 3c for 1 epoch, lr = 1e-4, warmup steps = 0.1
+* 3d for 1 epoch, lr = 2e-4, warmup steps = 0.1, rank = 32, lora alpha = 64
+* 3e for 2 epochs, lr = 2e-4, warmup steps = 0.1, rank = 32, lora alpha = 64
 * From LLaMA-2-13b
 * Trying LLaMA-2-13b chat/other base and curated dataset for next attempts