---
base_model: google/pegasus-xsum
tags:
- generated_from_trainer
model-index:
- name: food-intent-pegasus-base
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# food-intent-pegasus-base

This model is a fine-tuned version of [google/pegasus-xsum](https://huggingface.co/google/pegasus-xsum) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.3242

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- num_epochs: 4

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| 11.5719       | 0.14  | 20   | 11.5332         |
| 11.293        | 0.28  | 40   | 11.3416         |
| 11.2274       | 0.42  | 60   | 11.0547         |
| 10.6443       | 0.56  | 80   | 10.7222         |
| 10.3589       | 0.69  | 100  | 10.4015         |
| 10.3677       | 0.83  | 120  | 10.1421         |
| 9.7912        | 0.97  | 140  | 9.9393          |
| 10.04         | 1.11  | 160  | 9.7417          |
| 9.4389        | 1.25  | 180  | 9.5561          |
| 9.6224        | 1.39  | 200  | 9.3565          |
| 9.2704        | 1.53  | 220  | 9.1214          |
| 9.1185        | 1.67  | 240  | 8.8230          |
| 8.9214        | 1.81  | 260  | 8.3412          |
| 8.4341        | 1.94  | 280  | 7.6364          |
| 7.3594        | 2.08  | 300  | 6.5617          |
| 6.4947        | 2.22  | 320  | 4.7474          |
| 5.054         | 2.36  | 340  | 2.9092          |
| 3.3489        | 2.5   | 360  | 1.3402          |
| 1.9233        | 2.64  | 380  | 0.7131          |
| 0.9449        | 2.78  | 400  | 0.5563          |
| 0.617         | 2.92  | 420  | 0.4779          |
| 0.4712        | 3.06  | 440  | 0.4228          |
| 0.4508        | 3.19  | 460  | 0.3853          |
| 0.3308        | 3.33  | 480  | 0.3581          |
| 0.2735        | 3.47  | 500  | 0.3422          |
| 0.2793        | 3.61  | 520  | 0.3343          |
| 0.3184        | 3.75  | 540  | 0.3276          |
| 0.2984        | 3.89  | 560  | 0.3242          |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu118
- Datasets 2.15.0
- Tokenizers 0.15.0