Hugging Face's logo

flax-community
/
pino-bigbird-roberta-base

Fill-Mask
Transformers
PyTorch
JAX
TensorBoard
Dutch
big_bird
Inference Endpoints
Model card Files Metrics Community
2
pino-bigbird-roberta-base
File size: 19,070 Bytes 
f291f93
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
 
2021-07-13 13:06:42,101 INFO    MainThread:359333 [internal.py:wandb_internal():88] W&B internal server running at pid: 359333, started at: 2021-07-13 13:06:42.101080
2021-07-13 13:06:42,103 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: check_version
2021-07-13 13:06:42,103 INFO    WriterThread:359333 [datastore.py:open_for_write():80] open: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/run-2gq51wyk.wandb
2021-07-13 13:06:42,104 DEBUG   SenderThread:359333 [sender.py:send():179] send: header
2021-07-13 13:06:42,104 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: check_version
2021-07-13 13:06:42,140 DEBUG   SenderThread:359333 [sender.py:send():179] send: run
2021-07-13 13:06:42,313 INFO    SenderThread:359333 [dir_watcher.py:__init__():168] watching files in: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files
2021-07-13 13:06:42,313 INFO    SenderThread:359333 [sender.py:_start_run_threads():716] run started: 2gq51wyk with start time 1626181601
2021-07-13 13:06:42,313 DEBUG   SenderThread:359333 [sender.py:send():179] send: summary
2021-07-13 13:06:42,314 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: run_start
2021-07-13 13:06:42,315 INFO    SenderThread:359333 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
2021-07-13 13:06:43,318 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/wandb-summary.json
2021-07-13 13:06:43,366 DEBUG   HandlerThread:359333 [meta.py:__init__():39] meta init
2021-07-13 13:06:43,366 DEBUG   HandlerThread:359333 [meta.py:__init__():53] meta init done
2021-07-13 13:06:43,367 DEBUG   HandlerThread:359333 [meta.py:probe():210] probe
2021-07-13 13:06:43,368 DEBUG   HandlerThread:359333 [meta.py:_setup_git():200] setup git
2021-07-13 13:06:43,393 DEBUG   HandlerThread:359333 [meta.py:_setup_git():207] setup git done
2021-07-13 13:06:43,394 DEBUG   HandlerThread:359333 [meta.py:_save_pip():57] save pip
2021-07-13 13:06:43,394 DEBUG   HandlerThread:359333 [meta.py:_save_pip():71] save pip done
2021-07-13 13:06:43,394 DEBUG   HandlerThread:359333 [meta.py:probe():252] probe done
2021-07-13 13:06:43,397 DEBUG   SenderThread:359333 [sender.py:send():179] send: files
2021-07-13 13:06:43,397 INFO    SenderThread:359333 [sender.py:_save_file():841] saving file wandb-metadata.json with policy now
2021-07-13 13:06:43,405 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:06:43,406 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:06:43,532 DEBUG   SenderThread:359333 [sender.py:send():179] send: config
2021-07-13 13:06:43,533 DEBUG   SenderThread:359333 [sender.py:send():179] send: config
2021-07-13 13:06:43,533 DEBUG   SenderThread:359333 [sender.py:send():179] send: config
2021-07-13 13:06:43,840 INFO    Thread-11 :359333 [upload_job.py:push():137] Uploaded file /tmp/tmpvp99h86hwandb/2nevcblm-wandb-metadata.json
2021-07-13 13:06:44,317 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/output.log
2021-07-13 13:06:44,318 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/requirements.txt
2021-07-13 13:06:44,318 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/wandb-metadata.json
2021-07-13 13:06:58,323 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/output.log
2021-07-13 13:06:58,535 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:06:58,535 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:07:00,324 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/output.log
2021-07-13 13:07:11,447 DEBUG   SenderThread:359333 [sender.py:send():179] send: stats
2021-07-13 13:07:13,330 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/config.yaml
2021-07-13 13:07:13,669 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:07:13,670 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:07:16,332 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/output.log
2021-07-13 13:07:28,816 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:07:28,816 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:07:41,527 DEBUG   SenderThread:359333 [sender.py:send():179] send: stats
2021-07-13 13:07:43,967 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:07:43,968 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:07:59,098 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:07:59,099 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:08:11,610 DEBUG   SenderThread:359333 [sender.py:send():179] send: stats
2021-07-13 13:08:14,230 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:08:14,231 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:08:29,362 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:08:29,362 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:08:41,690 DEBUG   SenderThread:359333 [sender.py:send():179] send: stats
2021-07-13 13:08:44,829 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:08:44,830 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:08:58,373 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/output.log
2021-07-13 13:08:58,754 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:08:58,754 DEBUG   SenderThread:359333 [sender.py:send():179] send: telemetry
2021-07-13 13:08:58,754 DEBUG   SenderThread:359333 [sender.py:send():179] send: exit
2021-07-13 13:08:58,754 INFO    SenderThread:359333 [sender.py:send_exit():287] handling exit code: 1
2021-07-13 13:08:58,755 INFO    SenderThread:359333 [sender.py:send_exit():295] send defer
2021-07-13 13:08:58,755 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:08:58,755 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:08:58,755 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 0
2021-07-13 13:08:58,755 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:08:58,756 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 0
2021-07-13 13:08:58,756 INFO    SenderThread:359333 [sender.py:transition_state():308] send defer: 1
2021-07-13 13:08:58,756 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:08:58,756 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 1
2021-07-13 13:08:58,833 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:08:58,833 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 1
2021-07-13 13:08:58,833 INFO    SenderThread:359333 [sender.py:transition_state():308] send defer: 2
2021-07-13 13:08:58,833 DEBUG   SenderThread:359333 [sender.py:send():179] send: stats
2021-07-13 13:08:58,834 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:08:58,834 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 2
2021-07-13 13:08:58,834 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:08:58,834 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 2
2021-07-13 13:08:58,834 INFO    SenderThread:359333 [sender.py:transition_state():308] send defer: 3
2021-07-13 13:08:58,834 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:08:58,834 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 3
2021-07-13 13:08:58,834 DEBUG   SenderThread:359333 [sender.py:send():179] send: summary
2021-07-13 13:08:58,835 INFO    SenderThread:359333 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
2021-07-13 13:08:58,835 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:08:58,835 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 3
2021-07-13 13:08:58,835 INFO    SenderThread:359333 [sender.py:transition_state():308] send defer: 4
2021-07-13 13:08:58,835 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:08:58,835 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 4
2021-07-13 13:08:58,835 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:08:58,835 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 4
2021-07-13 13:08:58,857 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:08:59,373 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/wandb-summary.json
2021-07-13 13:08:59,373 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/output.log
2021-07-13 13:08:59,806 INFO    SenderThread:359333 [sender.py:transition_state():308] send defer: 5
2021-07-13 13:08:59,806 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:08:59,807 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:08:59,807 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 5
2021-07-13 13:08:59,807 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:08:59,807 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 5
2021-07-13 13:08:59,807 INFO    SenderThread:359333 [dir_watcher.py:finish():282] shutting down directory watcher
2021-07-13 13:08:59,908 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:09:00,374 INFO    Thread-8  :359333 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/config.yaml
2021-07-13 13:09:00,374 INFO    SenderThread:359333 [dir_watcher.py:finish():312] scan: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files
2021-07-13 13:09:00,374 INFO    SenderThread:359333 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/requirements.txt requirements.txt
2021-07-13 13:09:00,375 INFO    SenderThread:359333 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/output.log output.log
2021-07-13 13:09:00,375 INFO    SenderThread:359333 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/wandb-metadata.json wandb-metadata.json
2021-07-13 13:09:00,375 INFO    SenderThread:359333 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/config.yaml config.yaml
2021-07-13 13:09:00,375 INFO    SenderThread:359333 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/wandb-summary.json wandb-summary.json
2021-07-13 13:09:00,375 INFO    SenderThread:359333 [sender.py:transition_state():308] send defer: 6
2021-07-13 13:09:00,375 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:09:00,378 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:09:00,379 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 6
2021-07-13 13:09:00,379 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:09:00,379 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 6
2021-07-13 13:09:00,379 INFO    SenderThread:359333 [file_pusher.py:finish():177] shutting down file pusher
2021-07-13 13:09:00,479 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:09:00,480 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:09:00,581 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:09:00,582 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:09:00,683 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:09:00,683 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:09:00,785 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:09:00,785 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:09:00,837 INFO    Thread-14 :359333 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/config.yaml
2021-07-13 13:09:00,842 INFO    Thread-12 :359333 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/requirements.txt
2021-07-13 13:09:00,849 INFO    Thread-13 :359333 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/output.log
2021-07-13 13:09:00,872 INFO    Thread-15 :359333 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/files/wandb-summary.json
2021-07-13 13:09:00,887 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:09:00,887 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:09:00,989 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:09:00,989 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:09:01,072 INFO    Thread-7  :359333 [sender.py:transition_state():308] send defer: 7
2021-07-13 13:09:01,072 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:09:01,072 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 7
2021-07-13 13:09:01,073 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:09:01,073 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 7
2021-07-13 13:09:01,091 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:09:01,360 INFO    SenderThread:359333 [sender.py:transition_state():308] send defer: 8
2021-07-13 13:09:01,360 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:09:01,361 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:09:01,361 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 8
2021-07-13 13:09:01,361 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:09:01,361 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 8
2021-07-13 13:09:01,361 INFO    SenderThread:359333 [sender.py:transition_state():308] send defer: 9
2021-07-13 13:09:01,362 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:09:01,362 INFO    HandlerThread:359333 [handler.py:handle_request_defer():141] handle defer: 9
2021-07-13 13:09:01,362 DEBUG   SenderThread:359333 [sender.py:send():179] send: final
2021-07-13 13:09:01,363 DEBUG   SenderThread:359333 [sender.py:send():179] send: footer
2021-07-13 13:09:01,363 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: defer
2021-07-13 13:09:01,363 INFO    SenderThread:359333 [sender.py:send_request_defer():304] handle sender defer: 9
2021-07-13 13:09:01,462 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:09:01,462 DEBUG   SenderThread:359333 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:09:01,462 INFO    SenderThread:359333 [file_pusher.py:join():182] waiting for file pusher
2021-07-13 13:09:01,463 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: get_summary
2021-07-13 13:09:01,464 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: sampled_history
2021-07-13 13:09:01,465 DEBUG   HandlerThread:359333 [handler.py:handle_request():124] handle_request: shutdown
2021-07-13 13:09:01,465 INFO    HandlerThread:359333 [handler.py:finish():638] shutting down handler
2021-07-13 13:09:02,363 INFO    WriterThread:359333 [datastore.py:close():288] close: /home/dat/pino-roberta-base/wandb/run-20210713_130641-2gq51wyk/run-2gq51wyk.wandb
2021-07-13 13:09:02,463 INFO    SenderThread:359333 [sender.py:finish():945] shutting down sender
2021-07-13 13:09:02,463 INFO    SenderThread:359333 [file_pusher.py:finish():177] shutting down file pusher
2021-07-13 13:09:02,463 INFO    SenderThread:359333 [file_pusher.py:join():182] waiting for file pusher
2021-07-13 13:09:02,465 INFO    MainThread:359333 [internal.py:handle_exit():78] Internal process exited