Hugging Face's logo

flax-community
/
pino-bigbird-roberta-base

Fill-Mask Transformers PyTorch JAX TensorBoard
Dutch big_bird Inference Endpoints
Model card Files Metrics Community
2
dat commited on
Commit
ae03b3f
•
1 Parent(s): 3ac2ab9

update readme

Browse files
Files changed (6) hide show
  1. README.md +1 -1
  2. events.out.tfevents.1626474829.t1v-n-f5c06ea1-w-0.798495.3.v2 +2 -2
  3. wandb/run-20210716_223350-8eukt20m/files/output.log +33 -0
  4. wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json +1 -1
  5. wandb/run-20210716_223350-8eukt20m/logs/debug-internal.log +75 -0
  6. wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb +0 -0
README.md CHANGED
@@ -5,7 +5,7 @@ datasets:
5
  - Dutch_news
6
  ---
7
 
8
- # Pino (BigBird) base model
9
 
10
  Created by [Dat Nguyen](https://www.linkedin.com/in/dat-nguyen-49a641138/) & Yeb Havinga during the [Hugging Face community week](https://discuss.huggingface.co/t/open-to-the-community-community-week-using-jax-flax-for-nlp-cv/7104)
11
 
5
  - Dutch_news
6
  ---
7
 
8
+ # Pino (Dutch BigBird) base model
9
 
10
  Created by [Dat Nguyen](https://www.linkedin.com/in/dat-nguyen-49a641138/) & Yeb Havinga during the [Hugging Face community week](https://discuss.huggingface.co/t/open-to-the-community-community-week-using-jax-flax-for-nlp-cv/7104)
11
 
events.out.tfevents.1626474829.t1v-n-f5c06ea1-w-0.798495.3.v2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:53a6478d810481447758fc0feda2c8c7d6617e6f078c40da3bb43572c4d199fb
3
- size 2158492
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f438f7d8c0e2ed151acb2c86c475a3ade889ec4f0bd03b0e656627086442ae2
3
+ size 2203542
wandb/run-20210716_223350-8eukt20m/files/output.log CHANGED
@@ -2178,3 +2178,36 @@ Training...: 14349it [1:42:06, 5.17it/s]█████████████
2178
 
2179
 
2180
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2178
 
2179
 
2180
 
2181
+ Training...: 14399it [1:42:26, 5.27it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
2182
+
2183
+
2184
+
2185
+
2186
+
2187
+
2188
+ Training...: 14451it [1:42:57, 2.35s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
2189
+
2190
+
2191
+
2192
+
2193
+
2194
+
2195
+ Training...: 14503it [1:43:17, 1.25s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
2196
+
2197
+
2198
+
2199
+
2200
+
2201
+
2202
+ Training...: 14556it [1:43:38, 1.86it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
2203
+
2204
+
2205
+
2206
+
2207
+
2208
+ Training...: 14604it [1:43:58, 1.06it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
2209
+
2210
+
2211
+
2212
+
2213
+
wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"training_step": 344350, "learning_rate": 2.2840797100798227e-05, "train_loss": 1.849149465560913, "_runtime": 6489, "_timestamp": 1626481319, "_step": 287, "eval_step": 340000, "eval_accuracy": 0.6408576965332031, "eval_loss": 1.8213207721710205}
1
+ {"training_step": 344650, "learning_rate": 2.2834374249214306e-05, "train_loss": 1.9190285205841064, "_runtime": 6610, "_timestamp": 1626481440, "_step": 293, "eval_step": 340000, "eval_accuracy": 0.6408576965332031, "eval_loss": 1.8213207721710205}
wandb/run-20210716_223350-8eukt20m/logs/debug-internal.log CHANGED
@@ -4304,3 +4304,78 @@
4304
  2021-07-17 00:22:06,816 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4305
  2021-07-17 00:22:08,817 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4306
  2021-07-17 00:22:10,818 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4304
  2021-07-17 00:22:06,816 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4305
  2021-07-17 00:22:08,817 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4306
  2021-07-17 00:22:10,818 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4307
+ 2021-07-17 00:22:12,496 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
4308
+ 2021-07-17 00:22:12,496 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
4309
+ 2021-07-17 00:22:19,765 DEBUG SenderThread:799749 [sender.py:send():179] send: history
4310
+ 2021-07-17 00:22:19,765 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
4311
+ 2021-07-17 00:22:19,766 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
4312
+ 2021-07-17 00:22:19,822 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
4313
+ 2021-07-17 00:22:21,823 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4314
+ 2021-07-17 00:22:22,823 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4315
+ 2021-07-17 00:22:24,824 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4316
+ 2021-07-17 00:22:26,825 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4317
+ 2021-07-17 00:22:27,721 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
4318
+ 2021-07-17 00:22:27,722 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
4319
+ 2021-07-17 00:22:28,826 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4320
+ 2021-07-17 00:22:30,827 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4321
+ 2021-07-17 00:22:36,840 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
4322
+ 2021-07-17 00:22:39,906 DEBUG SenderThread:799749 [sender.py:send():179] send: history
4323
+ 2021-07-17 00:22:39,907 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
4324
+ 2021-07-17 00:22:39,907 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
4325
+ 2021-07-17 00:22:40,831 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4326
+ 2021-07-17 00:22:40,831 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
4327
+ 2021-07-17 00:22:41,832 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4328
+ 2021-07-17 00:22:42,832 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4329
+ 2021-07-17 00:22:42,987 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
4330
+ 2021-07-17 00:22:42,988 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
4331
+ 2021-07-17 00:22:44,833 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4332
+ 2021-07-17 00:22:46,834 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4333
+ 2021-07-17 00:22:49,835 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4334
+ 2021-07-17 00:22:51,836 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4335
+ 2021-07-17 00:22:58,153 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
4336
+ 2021-07-17 00:22:58,153 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
4337
+ 2021-07-17 00:23:00,009 DEBUG SenderThread:799749 [sender.py:send():179] send: history
4338
+ 2021-07-17 00:23:00,010 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
4339
+ 2021-07-17 00:23:00,010 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
4340
+ 2021-07-17 00:23:00,840 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
4341
+ 2021-07-17 00:23:01,841 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4342
+ 2021-07-17 00:23:03,841 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4343
+ 2021-07-17 00:23:05,842 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4344
+ 2021-07-17 00:23:06,915 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
4345
+ 2021-07-17 00:23:07,843 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4346
+ 2021-07-17 00:23:09,844 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4347
+ 2021-07-17 00:23:11,845 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4348
+ 2021-07-17 00:23:13,286 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
4349
+ 2021-07-17 00:23:13,286 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
4350
+ 2021-07-17 00:23:20,145 DEBUG SenderThread:799749 [sender.py:send():179] send: history
4351
+ 2021-07-17 00:23:20,145 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
4352
+ 2021-07-17 00:23:20,146 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
4353
+ 2021-07-17 00:23:20,849 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
4354
+ 2021-07-17 00:23:21,850 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4355
+ 2021-07-17 00:23:22,850 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4356
+ 2021-07-17 00:23:23,851 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4357
+ 2021-07-17 00:23:25,852 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4358
+ 2021-07-17 00:23:27,853 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4359
+ 2021-07-17 00:23:28,503 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
4360
+ 2021-07-17 00:23:28,503 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
4361
+ 2021-07-17 00:23:29,854 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4362
+ 2021-07-17 00:23:36,992 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
4363
+ 2021-07-17 00:23:40,215 DEBUG SenderThread:799749 [sender.py:send():179] send: history
4364
+ 2021-07-17 00:23:40,215 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
4365
+ 2021-07-17 00:23:40,216 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
4366
+ 2021-07-17 00:23:40,858 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
4367
+ 2021-07-17 00:23:41,859 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4368
+ 2021-07-17 00:23:42,859 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4369
+ 2021-07-17 00:23:43,717 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
4370
+ 2021-07-17 00:23:43,718 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
4371
+ 2021-07-17 00:23:43,860 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4372
+ 2021-07-17 00:23:45,861 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4373
+ 2021-07-17 00:23:47,862 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4374
+ 2021-07-17 00:23:49,863 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4375
+ 2021-07-17 00:23:51,864 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
4376
+ 2021-07-17 00:23:58,851 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
4377
+ 2021-07-17 00:23:58,851 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
4378
+ 2021-07-17 00:24:00,428 DEBUG SenderThread:799749 [sender.py:send():179] send: history
4379
+ 2021-07-17 00:24:00,429 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
4380
+ 2021-07-17 00:24:00,429 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
4381
+ 2021-07-17 00:24:00,868 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb CHANGED
Binary files a/wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb and b/wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb differ