Hugging Face's logo

csujeong
/
Mistral-7B-Finetuning-Insurance-16R

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
csujeong commited on
Commit
ab868af
•
1 Parent(s): b5d36f7

Training in progress, step 60

Browse files
Files changed (5) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Mar21_01-53-07_d72aea89d4b6/events.out.tfevents.1710986084.d72aea89d4b6.3894.0 +2 -2
  3. wandb/debug-internal.log +63 -0
  4. wandb/run-20240321_015458-y11xrjxv/files/wandb-summary.json +1 -1
  5. wandb/run-20240321_015458-y11xrjxv/logs/debug-internal.log +63 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b9c4fc839e87da1f16c00063fe6cf4a639845ee802234e5de5ca066aa54d14fe
3
  size 92317600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c6d3bfb949869face467d41e27d9dbb4602c4e9c8d89ab81b82ad62365df123
3
  size 92317600
runs/Mar21_01-53-07_d72aea89d4b6/events.out.tfevents.1710986084.d72aea89d4b6.3894.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3f067f0fcc624c4bca290425a08ef1c622065d46be44e2f8b14afd6eccdfc926
3
- size 6255
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ec381b1552bae1db95cab9758139f6ee02059d6c158391f4290c4140736f685
3
+ size 6810
wandb/debug-internal.log CHANGED
@@ -405,3 +405,66 @@
405
  2024-03-21 02:09:05,239 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
406
  2024-03-21 02:09:06,071 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
407
  2024-03-21 02:09:10,240 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
405
  2024-03-21 02:09:05,239 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
406
  2024-03-21 02:09:06,071 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
407
  2024-03-21 02:09:10,240 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
408
+ 2024-03-21 02:09:11,072 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
409
+ 2024-03-21 02:09:15,241 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
410
+ 2024-03-21 02:09:16,073 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
411
+ 2024-03-21 02:09:20,241 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
412
+ 2024-03-21 02:09:21,074 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
413
+ 2024-03-21 02:09:25,242 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
414
+ 2024-03-21 02:09:26,075 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
415
+ 2024-03-21 02:09:30,243 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
416
+ 2024-03-21 02:09:31,076 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
417
+ 2024-03-21 02:09:34,241 DEBUG SenderThread:7197 [sender.py:send():378] send: stats
418
+ 2024-03-21 02:09:36,077 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
419
+ 2024-03-21 02:09:36,242 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
420
+ 2024-03-21 02:09:41,078 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
421
+ 2024-03-21 02:09:41,243 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
422
+ 2024-03-21 02:09:46,083 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
423
+ 2024-03-21 02:09:46,244 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
424
+ 2024-03-21 02:09:51,084 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
425
+ 2024-03-21 02:09:51,244 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
426
+ 2024-03-21 02:09:56,085 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
427
+ 2024-03-21 02:09:56,245 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
428
+ 2024-03-21 02:10:01,086 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
429
+ 2024-03-21 02:10:01,246 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
430
+ 2024-03-21 02:10:04,239 DEBUG SenderThread:7197 [sender.py:send():378] send: stats
431
+ 2024-03-21 02:10:06,087 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
432
+ 2024-03-21 02:10:07,241 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
433
+ 2024-03-21 02:10:11,088 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
434
+ 2024-03-21 02:10:12,242 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
435
+ 2024-03-21 02:10:15,267 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: partial_history
436
+ 2024-03-21 02:10:15,269 DEBUG SenderThread:7197 [sender.py:send():378] send: history
437
+ 2024-03-21 02:10:15,269 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
438
+ 2024-03-21 02:10:15,278 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
439
+ 2024-03-21 02:10:15,898 INFO Thread-12 :7197 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240321_015458-y11xrjxv/files/wandb-summary.json
440
+ 2024-03-21 02:10:16,089 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
441
+ 2024-03-21 02:10:17,280 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
442
+ 2024-03-21 02:10:22,281 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
443
+ 2024-03-21 02:10:27,282 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
444
+ 2024-03-21 02:10:27,477 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
445
+ 2024-03-21 02:10:32,283 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
446
+ 2024-03-21 02:10:40,003 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
447
+ 2024-03-21 02:10:40,004 DEBUG SenderThread:7197 [sender.py:send():378] send: stats
448
+ 2024-03-21 02:10:40,011 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
449
+ 2024-03-21 02:10:43,007 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
450
+ 2024-03-21 02:10:44,253 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
451
+ 2024-03-21 02:10:44,255 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: partial_history
452
+ 2024-03-21 02:10:44,271 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
453
+ 2024-03-21 02:10:44,276 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
454
+ 2024-03-21 02:10:44,285 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
455
+ 2024-03-21 02:10:44,287 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
456
+ 2024-03-21 02:10:44,296 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
457
+ 2024-03-21 02:10:44,298 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
458
+ 2024-03-21 02:10:44,307 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
459
+ 2024-03-21 02:10:44,309 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
460
+ 2024-03-21 02:10:44,317 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
461
+ 2024-03-21 02:10:44,319 DEBUG SenderThread:7197 [sender.py:send():378] send: history
462
+ 2024-03-21 02:10:44,319 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
463
+ 2024-03-21 02:10:44,327 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
464
+ 2024-03-21 02:10:45,011 INFO Thread-12 :7197 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240321_015458-y11xrjxv/files/wandb-summary.json
465
+ 2024-03-21 02:10:45,483 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
466
+ 2024-03-21 02:10:45,484 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
467
+ 2024-03-21 02:10:48,330 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
468
+ 2024-03-21 02:10:50,484 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
469
+ 2024-03-21 02:10:53,331 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
470
+ 2024-03-21 02:10:55,485 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
wandb/run-20240321_015458-y11xrjxv/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 1.4773, "train/grad_norm": 2.8023295402526855, "train/learning_rate": 1.4314282383241096e-05, "train/epoch": 0.37, "train/global_step": 50, "_timestamp": 1710986884.1635811, "_runtime": 785.7786040306091, "_step": 4}
 
1
+ {"train/loss": 1.3475, "train/grad_norm": 2.8251266479492188, "train/learning_rate": 0.0, "train/epoch": 0.44, "train/global_step": 60, "_timestamp": 1710987044.254427, "_runtime": 945.8694498538971, "_step": 6, "train_runtime": 959.9448, "train_samples_per_second": 0.25, "train_steps_per_second": 0.063, "total_flos": 1580862829903872.0, "train_loss": 1.4798423608144124}
wandb/run-20240321_015458-y11xrjxv/logs/debug-internal.log CHANGED
@@ -405,3 +405,66 @@
405
  2024-03-21 02:09:05,239 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
406
  2024-03-21 02:09:06,071 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
407
  2024-03-21 02:09:10,240 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
405
  2024-03-21 02:09:05,239 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
406
  2024-03-21 02:09:06,071 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
407
  2024-03-21 02:09:10,240 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
408
+ 2024-03-21 02:09:11,072 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
409
+ 2024-03-21 02:09:15,241 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
410
+ 2024-03-21 02:09:16,073 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
411
+ 2024-03-21 02:09:20,241 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
412
+ 2024-03-21 02:09:21,074 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
413
+ 2024-03-21 02:09:25,242 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
414
+ 2024-03-21 02:09:26,075 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
415
+ 2024-03-21 02:09:30,243 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
416
+ 2024-03-21 02:09:31,076 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
417
+ 2024-03-21 02:09:34,241 DEBUG SenderThread:7197 [sender.py:send():378] send: stats
418
+ 2024-03-21 02:09:36,077 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
419
+ 2024-03-21 02:09:36,242 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
420
+ 2024-03-21 02:09:41,078 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
421
+ 2024-03-21 02:09:41,243 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
422
+ 2024-03-21 02:09:46,083 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
423
+ 2024-03-21 02:09:46,244 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
424
+ 2024-03-21 02:09:51,084 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
425
+ 2024-03-21 02:09:51,244 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
426
+ 2024-03-21 02:09:56,085 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
427
+ 2024-03-21 02:09:56,245 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
428
+ 2024-03-21 02:10:01,086 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
429
+ 2024-03-21 02:10:01,246 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
430
+ 2024-03-21 02:10:04,239 DEBUG SenderThread:7197 [sender.py:send():378] send: stats
431
+ 2024-03-21 02:10:06,087 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
432
+ 2024-03-21 02:10:07,241 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
433
+ 2024-03-21 02:10:11,088 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
434
+ 2024-03-21 02:10:12,242 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
435
+ 2024-03-21 02:10:15,267 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: partial_history
436
+ 2024-03-21 02:10:15,269 DEBUG SenderThread:7197 [sender.py:send():378] send: history
437
+ 2024-03-21 02:10:15,269 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
438
+ 2024-03-21 02:10:15,278 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
439
+ 2024-03-21 02:10:15,898 INFO Thread-12 :7197 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240321_015458-y11xrjxv/files/wandb-summary.json
440
+ 2024-03-21 02:10:16,089 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
441
+ 2024-03-21 02:10:17,280 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
442
+ 2024-03-21 02:10:22,281 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
443
+ 2024-03-21 02:10:27,282 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
444
+ 2024-03-21 02:10:27,477 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
445
+ 2024-03-21 02:10:32,283 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
446
+ 2024-03-21 02:10:40,003 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
447
+ 2024-03-21 02:10:40,004 DEBUG SenderThread:7197 [sender.py:send():378] send: stats
448
+ 2024-03-21 02:10:40,011 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
449
+ 2024-03-21 02:10:43,007 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
450
+ 2024-03-21 02:10:44,253 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
451
+ 2024-03-21 02:10:44,255 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: partial_history
452
+ 2024-03-21 02:10:44,271 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
453
+ 2024-03-21 02:10:44,276 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
454
+ 2024-03-21 02:10:44,285 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
455
+ 2024-03-21 02:10:44,287 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
456
+ 2024-03-21 02:10:44,296 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
457
+ 2024-03-21 02:10:44,298 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
458
+ 2024-03-21 02:10:44,307 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
459
+ 2024-03-21 02:10:44,309 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
460
+ 2024-03-21 02:10:44,317 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
461
+ 2024-03-21 02:10:44,319 DEBUG SenderThread:7197 [sender.py:send():378] send: history
462
+ 2024-03-21 02:10:44,319 DEBUG SenderThread:7197 [sender.py:send_request():405] send_request: summary_record
463
+ 2024-03-21 02:10:44,327 INFO SenderThread:7197 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
464
+ 2024-03-21 02:10:45,011 INFO Thread-12 :7197 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240321_015458-y11xrjxv/files/wandb-summary.json
465
+ 2024-03-21 02:10:45,483 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
466
+ 2024-03-21 02:10:45,484 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
467
+ 2024-03-21 02:10:48,330 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
468
+ 2024-03-21 02:10:50,484 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive
469
+ 2024-03-21 02:10:53,331 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: status_report
470
+ 2024-03-21 02:10:55,485 DEBUG HandlerThread:7197 [handler.py:handle_request():146] handle_request: keepalive