Hugging Face's logo

flax-community
/
pino-bigbird-roberta-base

Fill-Mask
Transformers
PyTorch
JAX
TensorBoard
Dutch
big_bird
Inference Endpoints
Model card Files Metrics Community
2
pino-bigbird-roberta-base
File size: 19,857 Bytes 
f291f93
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
 
2021-07-13 13:11:31,441 INFO    MainThread:361603 [internal.py:wandb_internal():88] W&B internal server running at pid: 361603, started at: 2021-07-13 13:11:31.440779
2021-07-13 13:11:31,443 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: check_version
2021-07-13 13:11:31,443 INFO    WriterThread:361603 [datastore.py:open_for_write():80] open: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/run-3eewirqy.wandb
2021-07-13 13:11:31,444 DEBUG   SenderThread:361603 [sender.py:send():179] send: header
2021-07-13 13:11:31,444 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: check_version
2021-07-13 13:11:31,480 DEBUG   SenderThread:361603 [sender.py:send():179] send: run
2021-07-13 13:11:31,724 INFO    SenderThread:361603 [dir_watcher.py:__init__():168] watching files in: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files
2021-07-13 13:11:31,724 INFO    SenderThread:361603 [sender.py:_start_run_threads():716] run started: 3eewirqy with start time 1626181890
2021-07-13 13:11:31,724 DEBUG   SenderThread:361603 [sender.py:send():179] send: summary
2021-07-13 13:11:31,724 INFO    SenderThread:361603 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
2021-07-13 13:11:31,725 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: run_start
2021-07-13 13:11:32,727 INFO    Thread-8  :361603 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/wandb-summary.json
2021-07-13 13:11:32,856 DEBUG   HandlerThread:361603 [meta.py:__init__():39] meta init
2021-07-13 13:11:32,856 DEBUG   HandlerThread:361603 [meta.py:__init__():53] meta init done
2021-07-13 13:11:32,856 DEBUG   HandlerThread:361603 [meta.py:probe():210] probe
2021-07-13 13:11:32,858 DEBUG   HandlerThread:361603 [meta.py:_setup_git():200] setup git
2021-07-13 13:11:32,888 DEBUG   HandlerThread:361603 [meta.py:_setup_git():207] setup git done
2021-07-13 13:11:32,888 DEBUG   HandlerThread:361603 [meta.py:_save_pip():57] save pip
2021-07-13 13:11:32,888 DEBUG   HandlerThread:361603 [meta.py:_save_pip():71] save pip done
2021-07-13 13:11:32,888 DEBUG   HandlerThread:361603 [meta.py:probe():252] probe done
2021-07-13 13:11:32,891 DEBUG   SenderThread:361603 [sender.py:send():179] send: files
2021-07-13 13:11:32,891 INFO    SenderThread:361603 [sender.py:_save_file():841] saving file wandb-metadata.json with policy now
2021-07-13 13:11:32,897 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:11:32,897 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:11:33,027 DEBUG   SenderThread:361603 [sender.py:send():179] send: config
2021-07-13 13:11:33,027 DEBUG   SenderThread:361603 [sender.py:send():179] send: config
2021-07-13 13:11:33,027 DEBUG   SenderThread:361603 [sender.py:send():179] send: config
2021-07-13 13:11:33,332 INFO    Thread-11 :361603 [upload_job.py:push():137] Uploaded file /tmp/tmpvsijxkjvwandb/1o2iztmz-wandb-metadata.json
2021-07-13 13:11:33,726 INFO    Thread-8  :361603 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/requirements.txt
2021-07-13 13:11:33,726 INFO    Thread-8  :361603 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/wandb-metadata.json
2021-07-13 13:11:33,726 INFO    Thread-8  :361603 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/output.log
2021-07-13 13:11:48,029 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:11:48,029 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:11:49,731 INFO    Thread-8  :361603 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/output.log
2021-07-13 13:12:00,934 DEBUG   SenderThread:361603 [sender.py:send():179] send: stats
2021-07-13 13:12:02,735 INFO    Thread-8  :361603 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/config.yaml
2021-07-13 13:12:03,162 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:12:03,163 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:12:18,294 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:12:18,294 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:12:31,014 DEBUG   SenderThread:361603 [sender.py:send():179] send: stats
2021-07-13 13:12:33,426 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:12:33,426 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:12:48,558 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:12:48,559 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:13:01,089 DEBUG   SenderThread:361603 [sender.py:send():179] send: stats
2021-07-13 13:13:03,691 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:13:03,691 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:13:18,832 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:13:18,832 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:13:21,761 INFO    Thread-8  :361603 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/output.log
2021-07-13 13:13:31,163 DEBUG   SenderThread:361603 [sender.py:send():179] send: stats
2021-07-13 13:13:33,987 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:13:33,987 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:13:49,124 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:13:49,124 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:14:01,237 DEBUG   SenderThread:361603 [sender.py:send():179] send: stats
2021-07-13 13:14:04,256 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:14:04,256 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:14:19,385 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:14:19,386 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:14:31,314 DEBUG   SenderThread:361603 [sender.py:send():179] send: stats
2021-07-13 13:14:34,523 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:14:34,523 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:14:49,653 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: stop_status
2021-07-13 13:14:49,654 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: stop_status
2021-07-13 13:15:01,389 DEBUG   SenderThread:361603 [sender.py:send():179] send: stats
2021-07-13 13:15:05,548 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:05,549 DEBUG   SenderThread:361603 [sender.py:send():179] send: telemetry
2021-07-13 13:15:05,549 DEBUG   SenderThread:361603 [sender.py:send():179] send: exit
2021-07-13 13:15:05,549 INFO    SenderThread:361603 [sender.py:send_exit():287] handling exit code: 1
2021-07-13 13:15:05,550 INFO    SenderThread:361603 [sender.py:send_exit():295] send defer
2021-07-13 13:15:05,550 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:05,550 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:05,551 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 0
2021-07-13 13:15:05,551 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:05,551 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 0
2021-07-13 13:15:05,551 INFO    SenderThread:361603 [sender.py:transition_state():308] send defer: 1
2021-07-13 13:15:05,551 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:05,551 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 1
2021-07-13 13:15:05,600 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:05,600 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 1
2021-07-13 13:15:05,600 INFO    SenderThread:361603 [sender.py:transition_state():308] send defer: 2
2021-07-13 13:15:05,600 DEBUG   SenderThread:361603 [sender.py:send():179] send: stats
2021-07-13 13:15:05,601 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:05,601 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 2
2021-07-13 13:15:05,601 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:05,601 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 2
2021-07-13 13:15:05,601 INFO    SenderThread:361603 [sender.py:transition_state():308] send defer: 3
2021-07-13 13:15:05,601 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:05,601 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 3
2021-07-13 13:15:05,602 DEBUG   SenderThread:361603 [sender.py:send():179] send: summary
2021-07-13 13:15:05,602 INFO    SenderThread:361603 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
2021-07-13 13:15:05,602 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:05,602 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 3
2021-07-13 13:15:05,602 INFO    SenderThread:361603 [sender.py:transition_state():308] send defer: 4
2021-07-13 13:15:05,602 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:05,602 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 4
2021-07-13 13:15:05,603 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:05,603 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 4
2021-07-13 13:15:05,652 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:05,770 INFO    SenderThread:361603 [sender.py:transition_state():308] send defer: 5
2021-07-13 13:15:05,770 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:05,771 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:05,771 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 5
2021-07-13 13:15:05,771 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:05,771 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 5
2021-07-13 13:15:05,771 INFO    SenderThread:361603 [dir_watcher.py:finish():282] shutting down directory watcher
2021-07-13 13:15:05,785 INFO    SenderThread:361603 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/config.yaml
2021-07-13 13:15:05,785 INFO    SenderThread:361603 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/wandb-summary.json
2021-07-13 13:15:05,786 INFO    SenderThread:361603 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/output.log
2021-07-13 13:15:05,786 INFO    SenderThread:361603 [dir_watcher.py:finish():312] scan: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files
2021-07-13 13:15:05,786 INFO    SenderThread:361603 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/requirements.txt requirements.txt
2021-07-13 13:15:05,786 INFO    SenderThread:361603 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/output.log output.log
2021-07-13 13:15:05,786 INFO    SenderThread:361603 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/wandb-metadata.json wandb-metadata.json
2021-07-13 13:15:05,787 INFO    SenderThread:361603 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/config.yaml config.yaml
2021-07-13 13:15:05,789 INFO    SenderThread:361603 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/wandb-summary.json wandb-summary.json
2021-07-13 13:15:05,789 INFO    SenderThread:361603 [sender.py:transition_state():308] send defer: 6
2021-07-13 13:15:05,792 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:05,792 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 6
2021-07-13 13:15:05,792 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:05,792 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 6
2021-07-13 13:15:05,792 INFO    SenderThread:361603 [file_pusher.py:finish():177] shutting down file pusher
2021-07-13 13:15:05,872 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:05,873 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:05,975 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:05,975 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:06,077 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:06,077 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:06,179 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:06,179 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:06,226 INFO    Thread-12 :361603 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/requirements.txt
2021-07-13 13:15:06,228 INFO    Thread-13 :361603 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/output.log
2021-07-13 13:15:06,244 INFO    Thread-15 :361603 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/wandb-summary.json
2021-07-13 13:15:06,280 INFO    Thread-14 :361603 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/files/config.yaml
2021-07-13 13:15:06,282 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:06,283 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:06,385 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:06,385 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:06,480 INFO    Thread-7  :361603 [sender.py:transition_state():308] send defer: 7
2021-07-13 13:15:06,481 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:06,481 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 7
2021-07-13 13:15:06,481 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:06,481 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 7
2021-07-13 13:15:06,487 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:06,748 INFO    SenderThread:361603 [sender.py:transition_state():308] send defer: 8
2021-07-13 13:15:06,748 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:06,749 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:06,749 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 8
2021-07-13 13:15:06,749 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:06,749 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 8
2021-07-13 13:15:06,749 INFO    SenderThread:361603 [sender.py:transition_state():308] send defer: 9
2021-07-13 13:15:06,749 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: defer
2021-07-13 13:15:06,749 INFO    HandlerThread:361603 [handler.py:handle_request_defer():141] handle defer: 9
2021-07-13 13:15:06,750 DEBUG   SenderThread:361603 [sender.py:send():179] send: final
2021-07-13 13:15:06,750 DEBUG   SenderThread:361603 [sender.py:send():179] send: footer
2021-07-13 13:15:06,750 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: defer
2021-07-13 13:15:06,750 INFO    SenderThread:361603 [sender.py:send_request_defer():304] handle sender defer: 9
2021-07-13 13:15:06,850 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-13 13:15:06,850 DEBUG   SenderThread:361603 [sender.py:send_request():193] send_request: poll_exit
2021-07-13 13:15:06,851 INFO    SenderThread:361603 [file_pusher.py:join():182] waiting for file pusher
2021-07-13 13:15:06,852 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: get_summary
2021-07-13 13:15:06,853 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: sampled_history
2021-07-13 13:15:06,854 DEBUG   HandlerThread:361603 [handler.py:handle_request():124] handle_request: shutdown
2021-07-13 13:15:06,854 INFO    HandlerThread:361603 [handler.py:finish():638] shutting down handler
2021-07-13 13:15:07,750 INFO    WriterThread:361603 [datastore.py:close():288] close: /home/dat/pino-roberta-base/wandb/run-20210713_131130-3eewirqy/run-3eewirqy.wandb
2021-07-13 13:15:07,851 INFO    SenderThread:361603 [sender.py:finish():945] shutting down sender
2021-07-13 13:15:07,851 INFO    SenderThread:361603 [file_pusher.py:finish():177] shutting down file pusher
2021-07-13 13:15:07,851 INFO    SenderThread:361603 [file_pusher.py:join():182] waiting for file pusher
2021-07-13 13:15:07,853 INFO    MainThread:361603 [internal.py:handle_exit():78] Internal process exited