nipunsadvilkar's picture
Saving weights and logs of step 500
74af663
raw
history blame
3.26 kB
2021-07-09 10:34:33,839 INFO MainThread:24042 [wandb_setup.py:_flush():69] setting env: {}
2021-07-09 10:34:33,839 INFO MainThread:24042 [wandb_setup.py:_flush():69] setting login settings: {}
2021-07-09 10:34:33,839 INFO MainThread:24042 [wandb_init.py:_log_setup():337] Logging user logs to /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_103433-d7n9baaw/logs/debug.log
2021-07-09 10:34:33,839 INFO MainThread:24042 [wandb_init.py:_log_setup():338] Logging internal logs to /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_103433-d7n9baaw/logs/debug-internal.log
2021-07-09 10:34:33,839 INFO MainThread:24042 [wandb_init.py:init():370] calling init triggers
2021-07-09 10:34:33,839 INFO MainThread:24042 [wandb_init.py:init():375] wandb.init called with sweep_config: {}
config: {}
2021-07-09 10:34:33,839 INFO MainThread:24042 [wandb_init.py:init():419] starting backend
2021-07-09 10:34:33,839 INFO MainThread:24042 [backend.py:_multiprocessing_setup():70] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2021-07-09 10:34:33,940 INFO MainThread:24042 [backend.py:ensure_launched():135] starting backend process...
2021-07-09 10:34:33,967 INFO MainThread:24042 [backend.py:ensure_launched():139] started backend process with pid: 25100
2021-07-09 10:34:33,969 INFO MainThread:24042 [wandb_init.py:init():424] backend started and connected
2021-07-09 10:34:33,971 INFO MainThread:24042 [wandb_init.py:init():472] updated telemetry
2021-07-09 10:34:33,972 INFO MainThread:24042 [wandb_init.py:init():491] communicating current version
2021-07-09 10:34:34,514 INFO MainThread:24042 [wandb_init.py:init():496] got version response
2021-07-09 10:34:34,514 INFO MainThread:24042 [wandb_init.py:init():504] communicating run to backend with 30 second timeout
2021-07-09 10:34:46,387 WARNING MainThread:24042 [wandb_init.py:init():781] interrupted
Traceback (most recent call last):
File "/home/nipunsadvilkar/roberta_mr_env/lib/python3.8/site-packages/wandb/sdk/wandb_init.py", line 761, in init
run = wi.init()
File "/home/nipunsadvilkar/roberta_mr_env/lib/python3.8/site-packages/wandb/sdk/wandb_init.py", line 505, in init
ret = backend.interface.communicate_run(run, timeout=30)
File "/home/nipunsadvilkar/roberta_mr_env/lib/python3.8/site-packages/wandb/sdk/interface/interface.py", line 667, in communicate_run
return self._communicate_run(run, timeout=timeout)
File "/home/nipunsadvilkar/roberta_mr_env/lib/python3.8/site-packages/wandb/sdk/interface/interface.py", line 655, in _communicate_run
resp = self._communicate(req, timeout=timeout)
File "/home/nipunsadvilkar/roberta_mr_env/lib/python3.8/site-packages/wandb/sdk/interface/interface.py", line 545, in _communicate
return self._communicate_async(rec, local=local).get(timeout=timeout)
File "/home/nipunsadvilkar/roberta_mr_env/lib/python3.8/site-packages/wandb/sdk/interface/interface.py", line 82, in get
is_set = self._object_ready.wait(timeout)
File "/usr/lib/python3.8/threading.py", line 558, in wait
signaled = self._cond.wait(timeout)
File "/usr/lib/python3.8/threading.py", line 306, in wait
gotit = waiter.acquire(True, timeout)
KeyboardInterrupt