Update README.md
Browse files
README.md
CHANGED
|
@@ -6,5 +6,7 @@ datasets:
|
|
| 6 |
---
|
| 7 |
## Training procedure
|
| 8 |
|
|
|
|
|
|
|
| 9 |
### Framework versions
|
| 10 |
- PEFT 0.6.0.dev0
|
|
|
|
| 6 |
---
|
| 7 |
## Training procedure
|
| 8 |
|
| 9 |
+
Fine-tuned version of Falcon-180B using PEFT LoRA + DeepSpeed ZeRO3 + Flash Attention + Activation Checkpointing. Read the blog [Falcon 180B Finetuning using 🤗 PEFT and DeepSpeed]() for more information.
|
| 10 |
+
|
| 11 |
### Framework versions
|
| 12 |
- PEFT 0.6.0.dev0
|