End of training

README.md

@@ -12,7 +12,7 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/noc-lab/PMC_LLAMA2_7B_trainer_lora/runs/326cgjks)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/noc-lab/PMC_LLAMA2_7B_trainer_lora/runs/0svox411)
 # PMC_LLAMA2_7B_trainer_lora
 
 This model is a fine-tuned version of [chaoyi-wu/PMC_LLAMA_7B](https://huggingface.co/chaoyi-wu/PMC_LLAMA_7B) on an unknown dataset.

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ac7c0e2a74f3e011f89fe704618fac2802f699b0096420c9e04e3b5777ca0a8a
+oid sha256:6de47217183878a8a9f061967affb701f9eccc19ffed21be5d7dcca3cf4043d8
 size 16794200

trainer_peft.log

@@ -505,3 +505,67 @@
 2024-06-01 21:09 - Continue  training!!
 2024-06-01 21:09 - Continue  training!!
 2024-06-01 21:19 - Training complete!!!
+2024-06-01 21:19 - Training complete!!!
+2024-06-01 21:20 - Cuda check
+2024-06-01 21:20 - True
+2024-06-01 21:20 - 2
+2024-06-01 21:20 - Configue Model and tokenizer
+2024-06-01 21:20 - Cuda check
+2024-06-01 21:20 - True
+2024-06-01 21:20 - 2
+2024-06-01 21:20 - Configue Model and tokenizer
+2024-06-01 21:20 - Memory usage in   0.00 GB
+2024-06-01 21:20 - Memory usage in   0.00 GB
+2024-06-01 21:20 - Dataset loaded successfully:
+ train-Jingmei/Pandemic_ACDC
+ test -Jingmei/Pandemic
+2024-06-01 21:20 - Tokenize data: DatasetDict({
+    train: Dataset({
+        features: ['input_ids', 'attention_mask'],
+        num_rows: 625
+    })
+    test: Dataset({
+        features: ['input_ids', 'attention_mask'],
+        num_rows: 8264
+    })
+})
+2024-06-01 21:20 - Split data into chunks:DatasetDict({
+    train: Dataset({
+        features: ['input_ids', 'attention_mask'],
+        num_rows: 3938
+    })
+    test: Dataset({
+        features: ['input_ids', 'attention_mask'],
+        num_rows: 198964
+    })
+})
+2024-06-01 21:20 - Setup PEFT
+2024-06-01 21:20 - Dataset loaded successfully:
+ train-Jingmei/Pandemic_ACDC
+ test -Jingmei/Pandemic
+2024-06-01 21:20 - Tokenize data: DatasetDict({
+    train: Dataset({
+        features: ['input_ids', 'attention_mask'],
+        num_rows: 625
+    })
+    test: Dataset({
+        features: ['input_ids', 'attention_mask'],
+        num_rows: 8264
+    })
+})
+2024-06-01 21:20 - Split data into chunks:DatasetDict({
+    train: Dataset({
+        features: ['input_ids', 'attention_mask'],
+        num_rows: 3938
+    })
+    test: Dataset({
+        features: ['input_ids', 'attention_mask'],
+        num_rows: 198964
+    })
+})
+2024-06-01 21:20 - Setup PEFT
+2024-06-01 21:20 - Setup optimizer
+2024-06-01 21:20 - Setup optimizer
+2024-06-01 21:20 - Continue  training!!
+2024-06-01 21:20 - Continue  training!!
+2024-06-01 21:21 - Training complete!!!

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a231d5967b772f8233812684530610afb10acb8fb0bb11265063035356d04fca
-size 5240
+oid sha256:679debbaaad76aea9c6e7042804b230c1810abd3863bab16edb081229855e2aa
+size 5176