Commit
•
5e93670
1
Parent(s):
39dbc92
Update README.md
Browse files
README.md
CHANGED
@@ -9,8 +9,6 @@ widget:
|
|
9 |
|
10 |
This checkpoint is obtained after training `FlaxBigBirdForQuestionAnswering` (with extra pooler head) on [`natural_questions`](https://huggingface.co/datasets/natural_questions) dataset on TPU v3-8. This dataset takes around ~100 GB on disk. But thanks to Cloud TPUs and Jax, each epoch took just 4.5 hours. Script for training can be found here: https://github.com/vasudevgupta7/bigbird
|
11 |
|
12 |
-
![bigbird](bigbird.mov)
|
13 |
-
|
14 |
**Use this model just like any other model from 🤗Transformers**
|
15 |
|
16 |
```python
|
|
|
9 |
|
10 |
This checkpoint is obtained after training `FlaxBigBirdForQuestionAnswering` (with extra pooler head) on [`natural_questions`](https://huggingface.co/datasets/natural_questions) dataset on TPU v3-8. This dataset takes around ~100 GB on disk. But thanks to Cloud TPUs and Jax, each epoch took just 4.5 hours. Script for training can be found here: https://github.com/vasudevgupta7/bigbird
|
11 |
|
|
|
|
|
12 |
**Use this model just like any other model from 🤗Transformers**
|
13 |
|
14 |
```python
|