--- license: apache-2.0 library_name: peft tags: - parquet - text-classification datasets: - ag_news metrics: - accuracy base_model: aXhyra/emotion_trained_31415 model-index: - name: aXhyra_emotion_trained_31415-finetuned-lora-ag_news results: - task: type: text-classification name: Text Classification dataset: name: ag_news type: ag_news config: default split: test args: default metrics: - type: accuracy value: 0.9398684210526316 name: accuracy --- # aXhyra_emotion_trained_31415-finetuned-lora-ag_news This model is a fine-tuned version of [aXhyra/emotion_trained_31415](https://huggingface.co/aXhyra/emotion_trained_31415) on the ag_news dataset. It achieves the following results on the evaluation set: - accuracy: 0.9399 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0004 - train_batch_size: 24 - eval_batch_size: 24 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 4 ### Training results | accuracy | train_loss | epoch | |:--------:|:----------:|:-----:| | 0.3424 | None | 0 | | 0.9224 | 0.2694 | 0 | | 0.9305 | 0.2013 | 1 | | 0.9378 | 0.1776 | 2 | | 0.9399 | 0.1611 | 3 | ### Framework versions - PEFT 0.8.2 - Transformers 4.37.2 - Pytorch 2.2.0 - Datasets 2.16.1 - Tokenizers 0.15.2