Commit
•
0bb275d
1
Parent(s):
0bc507d
Update README.md
Browse files
README.md
CHANGED
|
@@ -13,7 +13,7 @@ datasets:
|
|
| 13 |
|
| 14 |
This is a version of Cedille's GPT-J (fr-boris) with 6 billion parameters fine-tuned on [COVID-19 French News dataset](https://huggingface.co/datasets/gustavecortal/fr_covid_news) to generate French headlines related to COVID-19.
|
| 15 |
|
| 16 |
-
You can generate the model in colab or equivalent desktop gpu (e.g. single 1080Ti)
|
| 17 |
|
| 18 |
Here's how to run it: [](https://colab.research.google.com/drive/1lMja-CPc0vm5_-gXNXAWU-9c0nom7vZ9)
|
| 19 |
|
|
|
|
| 13 |
|
| 14 |
This is a version of Cedille's GPT-J (fr-boris) with 6 billion parameters fine-tuned on [COVID-19 French News dataset](https://huggingface.co/datasets/gustavecortal/fr_covid_news) to generate French headlines related to COVID-19.
|
| 15 |
|
| 16 |
+
You can generate the model in colab or equivalent desktop gpu (e.g. single 1080Ti) as the model has 8-bit weights. Inspired by [GPT-J 8bit](https://huggingface.co/hivemind/gpt-j-6B-8bit).
|
| 17 |
|
| 18 |
Here's how to run it: [](https://colab.research.google.com/drive/1lMja-CPc0vm5_-gXNXAWU-9c0nom7vZ9)
|
| 19 |
|