arielnlee commited on
Commit
9dafde3
1 Parent(s): db8fa2a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -8,6 +8,8 @@ datasets:
8
 
9
  # Platypus2-7B
10
 
 
 
11
  Platypus-7B is an instruction fine-tuned model based on the LLaMA2-7B transformer architecture.
12
 
13
  ![Platty](./Best_Platty_small.jpeg)
 
8
 
9
  # Platypus2-7B
10
 
11
+ **NOTE**: There is some issue with LLaMa-2 7B and it only works if you use `fp16=False` and `bf16=True` in the HF trainer. Working on a fix for this but if you have any thoughts about this or performace, please let us know through an issue :)
12
+
13
  Platypus-7B is an instruction fine-tuned model based on the LLaMA2-7B transformer architecture.
14
 
15
  ![Platty](./Best_Platty_small.jpeg)