marcelovidigal's picture
Training in progress, epoch 1
28e186b verified
raw
history blame
37.6 kB
2024-09-24 17:14:57,836 INFO StreamThr :47857 [internal.py:wandb_internal():85] W&B internal server running at pid: 47857, started at: 2024-09-24 17:14:57.835194
2024-09-24 17:14:57,837 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: status
2024-09-24 17:14:57,849 INFO WriterThread:47857 [datastore.py:open_for_write():87] open: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/run-742grin6.wandb
2024-09-24 17:14:57,850 DEBUG SenderThread:47857 [sender.py:send():379] send: header
2024-09-24 17:14:57,881 DEBUG SenderThread:47857 [sender.py:send():379] send: run
2024-09-24 17:14:58,526 INFO SenderThread:47857 [dir_watcher.py:__init__():211] watching files in: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files
2024-09-24 17:14:58,527 INFO SenderThread:47857 [sender.py:_start_run_threads():1188] run started: 742grin6 with start time 1727208897.836086
2024-09-24 17:14:58,536 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: check_version
2024-09-24 17:14:58,536 DEBUG SenderThread:47857 [sender.py:send_request():406] send_request: check_version
2024-09-24 17:14:58,898 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: run_start
2024-09-24 17:14:58,908 DEBUG HandlerThread:47857 [system_info.py:__init__():26] System info init
2024-09-24 17:14:58,908 DEBUG HandlerThread:47857 [system_info.py:__init__():41] System info init done
2024-09-24 17:14:58,908 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:14:58,908 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:14:58,909 INFO HandlerThread:47857 [system_monitor.py:probe():214] Collecting system info
2024-09-24 17:14:58,910 DEBUG HandlerThread:47857 [system_info.py:probe():152] Probing system
2024-09-24 17:14:58,910 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:14:58,912 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:14:58,913 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:14:58,913 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:14:58,919 DEBUG HandlerThread:47857 [system_info.py:_probe_git():137] Probing git
2024-09-24 17:14:58,949 DEBUG HandlerThread:47857 [system_info.py:_probe_git():145] Probing git done
2024-09-24 17:14:58,949 DEBUG HandlerThread:47857 [system_info.py:probe():200] Probing system done
2024-09-24 17:14:58,949 DEBUG HandlerThread:47857 [system_monitor.py:probe():223] {'os': 'macOS-15.0-x86_64-i386-64bit', 'python': '3.11.9', 'heartbeatAt': '2024-09-24T20:14:58.910409', 'startedAt': '2024-09-24T20:14:57.826008', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': '/Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/doutorado/secoes_contrato_rotulos_classificacao_texto_v1.ipynb', 'codePathLocal': 'secoes_contrato_rotulos_classificacao_texto_v1.ipynb', 'git': {'remote': 'https://github.com/marcelovidigal/retrieval_augmented_generation.git', 'commit': '23db3b3a0427b4dfac5df9b26ac2572134e857c4'}, 'email': 'marcelovidigal@gmail.com', 'root': '/Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation', 'host': 'mace16.local', 'username': 'marcelovidigal', 'executable': '/usr/local/bin/python3', 'cpu_count': 8, 'cpu_count_logical': 16, 'cpu_freq': {'current': 2300, 'min': 2300, 'max': 2300}, 'cpu_freq_per_core': [{'current': 2300, 'min': 2300, 'max': 2300}], 'disk': {'/': {'total': 931.546989440918, 'used': 9.93536376953125}}, 'memory': {'total': 16.0}}
2024-09-24 17:14:58,949 INFO HandlerThread:47857 [system_monitor.py:probe():224] Finished collecting system info
2024-09-24 17:14:58,949 INFO HandlerThread:47857 [system_monitor.py:probe():227] Publishing system info
2024-09-24 17:14:58,950 INFO HandlerThread:47857 [system_monitor.py:probe():229] Finished publishing system info
2024-09-24 17:14:58,953 DEBUG SenderThread:47857 [sender.py:send():379] send: files
2024-09-24 17:14:58,953 INFO SenderThread:47857 [sender.py:_save_file():1454] saving file wandb-metadata.json with policy now
2024-09-24 17:14:59,154 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: python_packages
2024-09-24 17:14:59,155 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: stop_status
2024-09-24 17:14:59,155 DEBUG SenderThread:47857 [sender.py:send_request():406] send_request: python_packages
2024-09-24 17:14:59,156 DEBUG SenderThread:47857 [sender.py:send_request():406] send_request: stop_status
2024-09-24 17:14:59,157 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:14:59,161 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:14:59,161 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:14:59,161 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:14:59,161 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:14:59,162 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:14:59,162 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:14:59,162 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:14:59,162 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:14:59,162 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:14:59,164 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:14:59,179 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:14:59,179 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:14:59,179 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:14:59,179 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:14:59,180 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:14:59,180 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:14:59,182 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:14:59,183 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:14:59,184 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:14:59,184 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:14:59,184 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:14:59,184 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:14:59,184 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:14:59,184 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:14:59,184 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:14:59,185 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:14:59,184 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:14:59,185 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:14:59,189 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:14:59,189 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:14:59,189 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:14:59,189 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:14:59,189 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:14:59,190 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:14:59,190 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:14:59,190 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:14:59,190 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:14:59,192 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:14:59,192 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:14:59,193 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:14:59,193 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:14:59,193 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:14:59,193 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:14:59,193 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:14:59,193 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:14:59,194 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:14:59,242 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:14:59,242 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:14:59,242 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:14:59,244 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:14:59,245 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:14:59,246 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:14:59,246 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:14:59,249 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:14:59,250 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:14:59,250 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:14:59,250 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:14:59,250 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:14:59,250 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:14:59,250 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:14:59,251 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:14:59,251 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:14:59,251 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:14:59,252 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:14:59,256 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:14:59,256 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:14:59,256 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:14:59,256 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:14:59,257 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:14:59,258 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:14:59,258 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:14:59,259 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:14:59,532 INFO Thread-12 :47857 [dir_watcher.py:_on_file_created():271] file/dir created: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/requirements.txt
2024-09-24 17:14:59,532 INFO Thread-12 :47857 [dir_watcher.py:_on_file_created():271] file/dir created: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/wandb-metadata.json
2024-09-24 17:14:59,589 DEBUG SenderThread:47857 [sender.py:send():379] send: telemetry
2024-09-24 17:14:59,589 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:14:59,590 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:14:59,590 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:14:59,590 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:14:59,990 INFO wandb-upload_0:47857 [upload_job.py:push():130] Uploaded file /var/folders/75/ky9nhpn56rg6m0h92jqhqfd80000gn/T/tmpiufpln49wandb/9s0ymvuh-wandb-metadata.json
2024-09-24 17:15:00,160 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:00,531 INFO Thread-12 :47857 [dir_watcher.py:_on_file_created():271] file/dir created: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/output.log
2024-09-24 17:15:01,164 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:02,166 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:02,536 INFO Thread-12 :47857 [dir_watcher.py:_on_file_modified():288] file/dir modified: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/output.log
2024-09-24 17:15:03,169 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:03,424 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:15:03,424 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:15:03,424 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:15:03,424 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:15:03,425 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:15:03,425 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:15:03,425 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:15:03,425 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:15:03,425 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:15:03,425 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:15:03,426 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:15:03,427 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: status_report
2024-09-24 17:15:03,490 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:15:03,490 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:15:03,491 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:15:03,491 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:15:03,491 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:15:03,492 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:15:03,492 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:15:03,494 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:15:03,497 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:15:03,497 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:15:03,497 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:15:03,497 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:15:03,497 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:15:03,497 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:15:03,497 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:15:03,497 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:15:03,498 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:15:03,498 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:15:03,499 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:15:04,175 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:05,177 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:05,906 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:15:05,906 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:15:05,906 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:15:05,906 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:15:05,907 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:15:05,907 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:15:05,907 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:15:05,910 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:15:05,910 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:15:05,910 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:15:05,910 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:15:05,911 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:15:05,911 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:15:05,911 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:15:05,911 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:15:05,911 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:15:05,911 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:15:05,911 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:15:05,912 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:15:05,921 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:15:05,922 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:15:05,922 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:15:05,922 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:15:05,922 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:15:05,922 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:15:05,923 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:15:05,925 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:15:05,926 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:15:05,926 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:15:05,927 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:15:05,927 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:15:05,927 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:15:05,927 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:15:05,927 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:15:05,927 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:15:05,927 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:15:05,928 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:15:05,928 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:15:06,180 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:06,543 INFO Thread-12 :47857 [dir_watcher.py:_on_file_modified():288] file/dir modified: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/output.log
2024-09-24 17:15:07,182 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:08,195 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:08,550 INFO Thread-12 :47857 [dir_watcher.py:_on_file_modified():288] file/dir modified: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/output.log
2024-09-24 17:15:08,935 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: status_report
2024-09-24 17:15:09,186 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:10,189 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:11,192 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:12,194 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:13,196 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:14,156 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: stop_status
2024-09-24 17:15:14,157 DEBUG SenderThread:47857 [sender.py:send_request():406] send_request: stop_status
2024-09-24 17:15:14,198 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:14,437 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: status_report
2024-09-24 17:15:15,204 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:16,207 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:17,209 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:18,211 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:19,217 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:20,170 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: status_report
2024-09-24 17:15:20,219 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:21,221 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:22,223 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:23,226 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:24,230 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:25,041 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:15:25,041 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:15:25,041 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:15:25,041 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:15:25,041 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:15:25,044 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:15:25,044 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:15:25,045 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:15:25,176 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: status_report
2024-09-24 17:15:25,233 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:25,504 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:15:25,504 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:15:25,505 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:15:25,505 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:15:25,505 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:15:25,505 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:15:25,505 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:15:25,505 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:15:25,505 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:15:25,506 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:15:25,506 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:15:26,237 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:27,239 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:27,612 INFO Thread-12 :47857 [dir_watcher.py:_on_file_modified():288] file/dir modified: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/output.log
2024-09-24 17:15:28,244 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:29,161 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: stop_status
2024-09-24 17:15:29,161 DEBUG SenderThread:47857 [sender.py:send_request():406] send_request: stop_status
2024-09-24 17:15:29,244 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:30,250 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:30,448 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: status_report
2024-09-24 17:15:31,254 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:31,624 INFO Thread-12 :47857 [dir_watcher.py:_on_file_modified():288] file/dir modified: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/config.yaml
2024-09-24 17:15:32,256 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:33,260 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:34,264 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:34,852 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:15:34,852 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:15:34,852 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:15:34,852 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:15:34,853 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:15:34,853 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:15:34,853 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:15:34,855 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:15:35,110 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:15:35,110 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:15:35,110 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:15:35,110 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:15:35,111 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:15:35,111 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:15:35,111 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:15:35,111 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:15:35,111 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:15:35,111 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:15:35,112 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:15:35,268 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:36,116 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: status_report
2024-09-24 17:15:36,271 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:36,647 INFO Thread-12 :47857 [dir_watcher.py:_on_file_modified():288] file/dir modified: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/output.log
2024-09-24 17:15:37,211 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: resume
2024-09-24 17:15:37,211 INFO HandlerThread:47857 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-24 17:15:37,212 INFO HandlerThread:47857 [system_monitor.py:start():194] Starting system monitor
2024-09-24 17:15:37,212 INFO SystemMonitor:47857 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-24 17:15:37,212 INFO SystemMonitor:47857 [interfaces.py:start():188] Started cpu monitoring
2024-09-24 17:15:37,213 INFO SystemMonitor:47857 [interfaces.py:start():188] Started disk monitoring
2024-09-24 17:15:37,213 INFO SystemMonitor:47857 [interfaces.py:start():188] Started memory monitoring
2024-09-24 17:15:37,216 INFO SystemMonitor:47857 [interfaces.py:start():188] Started network monitoring
2024-09-24 17:15:37,217 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: pause
2024-09-24 17:15:37,217 INFO HandlerThread:47857 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-24 17:15:37,217 INFO HandlerThread:47857 [system_monitor.py:finish():203] Stopping system monitor
2024-09-24 17:15:37,217 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined cpu monitor
2024-09-24 17:15:37,217 DEBUG SystemMonitor:47857 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-24 17:15:37,217 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined disk monitor
2024-09-24 17:15:37,217 DEBUG SystemMonitor:47857 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-24 17:15:37,218 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined memory monitor
2024-09-24 17:15:37,218 DEBUG SystemMonitor:47857 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-24 17:15:37,218 INFO HandlerThread:47857 [interfaces.py:finish():200] Joined network monitor
2024-09-24 17:15:37,219 DEBUG SenderThread:47857 [sender.py:send():379] send: stats
2024-09-24 17:15:37,276 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:37,650 INFO Thread-12 :47857 [dir_watcher.py:_on_file_modified():288] file/dir modified: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/doutorado/secoes_contrato_rotulos_classificacao_texto_v1/wandb/run-20240924_171457-742grin6/files/output.log
2024-09-24 17:15:38,278 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:39,281 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-24 17:15:40,283 DEBUG HandlerThread:47857 [handler.py:handle_request():158] handle_request: internal_messages