homebrewltd
/

llama3-s-v0.1

Text Generation

sound language model

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

jan-hq commited on Jul 22, 2024

Commit

575fe4e

·

verified ·

1 Parent(s): 11b97a1

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -134,7 +134,7 @@ print(generated_text)
 | **Learning Rate**          | 1.5e-4                  |
 | **Learning Scheduler**     | Cosine with warmup      |
 | **Optimizer**              | Adam torch fused        |
-| **Warmup Ratio**           | 0.05                    |
 | **Weight Decay**           | 0.01                    |
 | **beta1**                  | 0.9                     |
 | **beta2**                  | 0.98                    |

 | **Learning Rate**          | 1.5e-4                  |
 | **Learning Scheduler**     | Cosine with warmup      |
 | **Optimizer**              | Adam torch fused        |
+| **Warmup Ratio**           | 0.01                    |
 | **Weight Decay**           | 0.01                    |
 | **beta1**                  | 0.9                     |
 | **beta2**                  | 0.98                    |