---
license: cc-by-4.0
tags:
- generated_from_keras_callback
base_model: allegro/herbert-base-cased
model-index:
- name: constituency-brackets-20
  results: []
---

<!-- This model card has been generated automatically according to the information Keras had access to. You should
probably proofread and complete it, then remove this comment. -->

# constituency-brackets-20

This model is a fine-tuned version of [allegro/herbert-base-cased](https://huggingface.co/allegro/herbert-base-cased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Train Loss: 0.2020
- Train Acc: 0.9356
- Validation Loss: 0.2929
- Validation Acc: 0.9120
- Epoch: 19

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- optimizer: {'name': 'Adam', 'learning_rate': 5e-06, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
- training_precision: float32

### Training results

| Train Loss | Train Acc | Validation Loss | Validation Acc | Epoch |
|:----------:|:---------:|:---------------:|:--------------:|:-----:|
| 2.4703     | 0.3783    | 1.4719          | 0.5858         | 0     |
| 1.2149     | 0.6600    | 0.8922          | 0.7269         | 1     |
| 0.8721     | 0.7343    | 0.6914          | 0.7779         | 2     |
| 0.7186     | 0.7715    | 0.6028          | 0.8037         | 3     |
| 0.6239     | 0.7987    | 0.5427          | 0.8240         | 4     |
| 0.5432     | 0.8342    | 0.4469          | 0.8677         | 5     |
| 0.4521     | 0.8665    | 0.4092          | 0.8760         | 6     |
| 0.4100     | 0.8761    | 0.3867          | 0.8819         | 7     |
| 0.3792     | 0.8855    | 0.3761          | 0.8849         | 8     |
| 0.3526     | 0.8926    | 0.3469          | 0.8938         | 9     |
| 0.3304     | 0.8981    | 0.3433          | 0.8944         | 10    |
| 0.3091     | 0.9049    | 0.3329          | 0.8977         | 11    |
| 0.2935     | 0.9081    | 0.3178          | 0.9028         | 12    |
| 0.2769     | 0.9138    | 0.3140          | 0.9032         | 13    |
| 0.2614     | 0.9173    | 0.2994          | 0.9114         | 14    |
| 0.2472     | 0.9213    | 0.2954          | 0.9128         | 15    |
| 0.2344     | 0.9260    | 0.2899          | 0.9142         | 16    |
| 0.2229     | 0.9292    | 0.2971          | 0.9092         | 17    |
| 0.2136     | 0.9322    | 0.2872          | 0.9143         | 18    |
| 0.2020     | 0.9356    | 0.2929          | 0.9120         | 19    |


### Framework versions

- Transformers 4.26.0
- TensorFlow 2.9.2
- Datasets 2.8.0
- Tokenizers 0.13.2