Hugging Face's logo

flax-community
/
pino-bigbird-roberta-base

Fill-Mask
Transformers
PyTorch
JAX
TensorBoard
Dutch
big_bird
Inference Endpoints
Model card Files Metrics Community
2
pino-bigbird-roberta-base
File size: 19,110 Bytes 
f291f93
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
 
2021-07-13 12:52:32,293 INFO    MainThread:357371 [internal.py:wandb_internal():88] W&B internal server running at pid: 357371, started at: 2021-07-13 12:52:32.292806
2021-07-13 12:52:32,295 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: check_version
2021-07-13 12:52:32,295 INFO    WriterThread:357371 [datastore.py:open_for_write():80] open: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/run-3e8clw7k.wandb
2021-07-13 12:52:32,296 DEBUG   SenderThread:357371 [sender.py:send():179] send: header
2021-07-13 12:52:32,296 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: check_version
2021-07-13 12:52:32,336 DEBUG   SenderThread:357371 [sender.py:send():179] send: run
2021-07-13 12:52:32,510 INFO    SenderThread:357371 [dir_watcher.py:__init__():168] watching files in: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files
2021-07-13 12:52:32,510 INFO    SenderThread:357371 [sender.py:_start_run_threads():716] run started: 3e8clw7k with start time 1626180751
2021-07-13 12:52:32,510 DEBUG   SenderThread:357371 [sender.py:send():179] send: summary
2021-07-13 12:52:32,510 INFO    SenderThread:357371 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
2021-07-13 12:52:32,511 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: run_start
2021-07-13 12:52:33,512 INFO    Thread-8  :357371 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/wandb-summary.json
2021-07-13 12:52:33,640 DEBUG   HandlerThread:357371 [meta.py:__init__():39] meta init
2021-07-13 12:52:33,640 DEBUG   HandlerThread:357371 [meta.py:__init__():53] meta init done
2021-07-13 12:52:33,640 DEBUG   HandlerThread:357371 [meta.py:probe():210] probe
2021-07-13 12:52:33,641 DEBUG   HandlerThread:357371 [meta.py:_setup_git():200] setup git
2021-07-13 12:52:33,672 DEBUG   HandlerThread:357371 [meta.py:_setup_git():207] setup git done
2021-07-13 12:52:33,673 DEBUG   HandlerThread:357371 [meta.py:_save_pip():57] save pip
2021-07-13 12:52:33,673 DEBUG   HandlerThread:357371 [meta.py:_save_pip():71] save pip done
2021-07-13 12:52:33,673 DEBUG   HandlerThread:357371 [meta.py:probe():252] probe done
2021-07-13 12:52:33,676 DEBUG   SenderThread:357371 [sender.py:send():179] send: files
2021-07-13 12:52:33,677 INFO    SenderThread:357371 [sender.py:_save_file():841] saving file wandb-metadata.json with policy now
2021-07-13 12:52:33,684 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:52:33,684 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:52:33,819 DEBUG   SenderThread:357371 [sender.py:send():179] send: config
2021-07-13 12:52:33,819 DEBUG   SenderThread:357371 [sender.py:send():179] send: config
2021-07-13 12:52:33,819 DEBUG   SenderThread:357371 [sender.py:send():179] send: config
2021-07-13 12:52:34,121 INFO    Thread-11 :357371 [upload_job.py:push():137] Uploaded file /tmp/tmpf08p42k1wandb/2dh5gbl6-wandb-metadata.json
2021-07-13 12:52:34,512 INFO    Thread-8  :357371 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/wandb-metadata.json
2021-07-13 12:52:34,512 INFO    Thread-8  :357371 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/output.log
2021-07-13 12:52:34,512 INFO    Thread-8  :357371 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/requirements.txt
2021-07-13 12:52:48,517 INFO    Thread-8  :357371 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/output.log
2021-07-13 12:52:48,821 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:52:48,822 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:52:50,518 INFO    Thread-8  :357371 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/output.log
2021-07-13 12:53:01,734 DEBUG   SenderThread:357371 [sender.py:send():179] send: stats
2021-07-13 12:53:03,523 INFO    Thread-8  :357371 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/config.yaml
2021-07-13 12:53:03,954 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:53:03,954 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:53:06,524 INFO    Thread-8  :357371 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/output.log
2021-07-13 12:53:19,100 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:53:19,100 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:53:31,817 DEBUG   SenderThread:357371 [sender.py:send():179] send: stats
2021-07-13 12:53:34,247 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:53:34,247 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:53:49,380 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:53:49,380 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:54:01,895 DEBUG   SenderThread:357371 [sender.py:send():179] send: stats
2021-07-13 12:54:04,520 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:54:04,520 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:54:19,658 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:54:19,658 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:54:31,974 DEBUG   SenderThread:357371 [sender.py:send():179] send: stats
2021-07-13 12:54:34,800 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:54:34,800 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:54:49,937 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 12:54:49,938 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: stop_status
2021-07-13 12:54:54,269 DEBUG   SenderThread:357371 [sender.py:send():179] send: telemetry
2021-07-13 12:54:54,269 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:54,269 DEBUG   SenderThread:357371 [sender.py:send():179] send: exit
2021-07-13 12:54:54,270 INFO    SenderThread:357371 [sender.py:send_exit():287] handling exit code: 1
2021-07-13 12:54:54,270 INFO    SenderThread:357371 [sender.py:send_exit():295] send defer
2021-07-13 12:54:54,270 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:54,271 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:54,271 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 0
2021-07-13 12:54:54,271 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:54,271 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 0
2021-07-13 12:54:54,271 INFO    SenderThread:357371 [sender.py:transition_state():308] send defer: 1
2021-07-13 12:54:54,271 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:54,271 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 1
2021-07-13 12:54:54,333 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:54,333 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 1
2021-07-13 12:54:54,333 INFO    SenderThread:357371 [sender.py:transition_state():308] send defer: 2
2021-07-13 12:54:54,333 DEBUG   SenderThread:357371 [sender.py:send():179] send: stats
2021-07-13 12:54:54,334 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:54,334 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 2
2021-07-13 12:54:54,334 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:54,334 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 2
2021-07-13 12:54:54,334 INFO    SenderThread:357371 [sender.py:transition_state():308] send defer: 3
2021-07-13 12:54:54,334 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:54,334 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 3
2021-07-13 12:54:54,334 DEBUG   SenderThread:357371 [sender.py:send():179] send: summary
2021-07-13 12:54:54,335 INFO    SenderThread:357371 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
2021-07-13 12:54:54,335 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:54,335 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 3
2021-07-13 12:54:54,335 INFO    SenderThread:357371 [sender.py:transition_state():308] send defer: 4
2021-07-13 12:54:54,335 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:54,335 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 4
2021-07-13 12:54:54,336 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:54,336 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 4
2021-07-13 12:54:54,372 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:54,508 INFO    SenderThread:357371 [sender.py:transition_state():308] send defer: 5
2021-07-13 12:54:54,508 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:54,509 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:54,509 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 5
2021-07-13 12:54:54,509 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:54,509 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 5
2021-07-13 12:54:54,509 INFO    SenderThread:357371 [dir_watcher.py:finish():282] shutting down directory watcher
2021-07-13 12:54:54,551 INFO    SenderThread:357371 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/wandb-summary.json
2021-07-13 12:54:54,551 INFO    SenderThread:357371 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/config.yaml
2021-07-13 12:54:54,551 INFO    SenderThread:357371 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/output.log
2021-07-13 12:54:54,552 INFO    SenderThread:357371 [dir_watcher.py:finish():312] scan: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files
2021-07-13 12:54:54,552 INFO    SenderThread:357371 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/requirements.txt requirements.txt
2021-07-13 12:54:54,552 INFO    SenderThread:357371 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/output.log output.log
2021-07-13 12:54:54,552 INFO    SenderThread:357371 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/wandb-metadata.json wandb-metadata.json
2021-07-13 12:54:54,552 INFO    SenderThread:357371 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/config.yaml config.yaml
2021-07-13 12:54:54,552 INFO    SenderThread:357371 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/wandb-summary.json wandb-summary.json
2021-07-13 12:54:54,552 INFO    SenderThread:357371 [sender.py:transition_state():308] send defer: 6
2021-07-13 12:54:54,553 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:54,553 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 6
2021-07-13 12:54:54,556 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:54,556 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 6
2021-07-13 12:54:54,556 INFO    SenderThread:357371 [file_pusher.py:finish():177] shutting down file pusher
2021-07-13 12:54:54,610 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:54,611 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:54,713 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:54,713 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:54,815 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:54,815 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:54,917 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:54,917 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:55,002 INFO    Thread-14 :357371 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/config.yaml
2021-07-13 12:54:55,019 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:55,020 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:55,024 INFO    Thread-12 :357371 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/requirements.txt
2021-07-13 12:54:55,026 INFO    Thread-13 :357371 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/output.log
2021-07-13 12:54:55,027 INFO    Thread-15 :357371 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/files/wandb-summary.json
2021-07-13 12:54:55,122 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:55,122 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:55,224 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:55,224 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:55,228 INFO    Thread-7  :357371 [sender.py:transition_state():308] send defer: 7
2021-07-13 12:54:55,229 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:55,229 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 7
2021-07-13 12:54:55,229 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:55,229 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 7
2021-07-13 12:54:55,326 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:55,508 INFO    SenderThread:357371 [sender.py:transition_state():308] send defer: 8
2021-07-13 12:54:55,509 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:55,509 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:55,509 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 8
2021-07-13 12:54:55,509 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:55,509 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 8
2021-07-13 12:54:55,510 INFO    SenderThread:357371 [sender.py:transition_state():308] send defer: 9
2021-07-13 12:54:55,510 DEBUG   SenderThread:357371 [sender.py:send():179] send: final
2021-07-13 12:54:55,510 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: defer
2021-07-13 12:54:55,510 DEBUG   SenderThread:357371 [sender.py:send():179] send: footer
2021-07-13 12:54:55,510 INFO    HandlerThread:357371 [handler.py:handle_request_defer():141] handle defer: 9
2021-07-13 12:54:55,511 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: defer
2021-07-13 12:54:55,511 INFO    SenderThread:357371 [sender.py:send_request_defer():304] handle sender defer: 9
2021-07-13 12:54:55,611 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 12:54:55,611 DEBUG   SenderThread:357371 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 12:54:55,611 INFO    SenderThread:357371 [file_pusher.py:join():182] waiting for file pusher
2021-07-13 12:54:55,612 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: get_summary
2021-07-13 12:54:55,613 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: sampled_history
2021-07-13 12:54:55,614 DEBUG   HandlerThread:357371 [handler.py:handle_request():124] handle_request: shutdown
2021-07-13 12:54:55,614 INFO    HandlerThread:357371 [handler.py:finish():638] shutting down handler
2021-07-13 12:54:56,510 INFO    WriterThread:357371 [datastore.py:close():288] close: /home/dat/pino-roberta-base/wandb/run-20210713_125231-3e8clw7k/run-3e8clw7k.wandb
2021-07-13 12:54:56,611 INFO    SenderThread:357371 [sender.py:finish():945] shutting down sender
2021-07-13 12:54:56,611 INFO    SenderThread:357371 [file_pusher.py:finish():177] shutting down file pusher
2021-07-13 12:54:56,611 INFO    SenderThread:357371 [file_pusher.py:join():182] waiting for file pusher
2021-07-13 12:54:56,614 INFO    MainThread:357371 [internal.py:handle_exit():78] Internal process exited