Upload 3 files

README.md

@@ -0,0 +1,10 @@
+## TextAttack Model Card
+
+            This `bert` model was fine-tuned using TextAttack. The model was fine-tuned
+            for 3 epochs with a batch size of 8,
+             a maximum sequence length of 512, and an initial learning rate of 3e-05.
+            Since this was a classification task, the model was trained with a cross-entropy loss function.
+            The best score the model achieved on this task was 0.9558333333333333, as measured by the
+            eval set accuracy, found after 3 epochs.
+
+            For more information, check out [TextAttack on Github](https://github.com/QData/TextAttack).

train_log.txt

@@ -0,0 +1,29 @@
+Writing logs to ./outputs/2024-02-27-20-27-33-802873/train_log.txt.
+Wrote original training args to ./outputs/2024-02-27-20-27-33-802873/training_args.json.
+***** Running training *****
+  Num examples = 9600
+  Num epochs = 3
+  Num clean epochs = 3
+  Instantaneous batch size per device = 8
+  Total train batch size (w. parallel, distributed & accumulation) = 8
+  Gradient accumulation steps = 1
+  Total optimization steps = 3600
+==========================================================
+Epoch 1
+Running clean epoch 1/3
+Train accuracy: 88.54%
+Eval accuracy: 92.75%
+Best score found. Saved model to ./outputs/2024-02-27-20-27-33-802873/best_model/
+==========================================================
+Epoch 2
+Running clean epoch 2/3
+Train accuracy: 96.02%
+Eval accuracy: 95.08%
+Best score found. Saved model to ./outputs/2024-02-27-20-27-33-802873/best_model/
+==========================================================
+Epoch 3
+Running clean epoch 3/3
+Train accuracy: 98.58%
+Eval accuracy: 95.58%
+Best score found. Saved model to ./outputs/2024-02-27-20-27-33-802873/best_model/
+Wrote README to ./outputs/2024-02-27-20-27-33-802873/README.md.

training_args.json

@@ -0,0 +1 @@
+{"num_epochs": 3, "num_clean_epochs": 1, "attack_epoch_interval": 1, "early_stopping_epochs": null, "learning_rate": 3e-05, "num_warmup_steps": 500, "weight_decay": 0.01, "per_device_train_batch_size": 8, "per_device_eval_batch_size": 32, "gradient_accumulation_steps": 1, "random_seed": 718, "parallel": false, "load_best_model_at_end": false, "alpha": 1.0, "num_train_adv_examples": -1, "query_budget_train": null, "attack_num_workers_per_device": 1, "output_dir": "./outputs/2024-02-27-20-27-33-802873", "checkpoint_interval_steps": null, "checkpoint_interval_epochs": null, "save_last": true, "log_to_tb": false, "tb_log_dir": null, "log_to_wandb": false, "wandb_project": "textattack", "logging_interval_step": 1}