Electro98/my_awesome_model

This model is a fine-tuned version of distilbert/distilbert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Train Loss: 0.1447
• Validation Loss: 0.1826
• Train F1: 0.1535
• Train Accuracy: 0.2915
• Epoch: 19

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• optimizer: {'name': 'Adam', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 135650, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
• training_precision: float32

Training results

Train Loss	Validation Loss	Train F1	Train Accuracy	Epoch
0.2025	0.1689	0.0051	0.0039	0
0.1938	0.1780	0.0683	0.1028	1
0.2008	0.1897	0.0055	0.0112	2
0.1826	0.1879	0.0754	0.0988	3
0.1740	0.1792	0.0848	0.0989	4
0.1909	0.1799	0.0294	0.1297	5
0.1983	0.1786	0.0675	0.2112	6
0.1905	0.1820	0.0962	0.2360	7
0.2033	0.1628	0.0778	0.2005	8
0.1653	0.1602	0.1280	0.2644	9
0.1656	0.1609	0.0836	0.2042	10
0.1584	0.1572	0.1323	0.2292	11
0.1633	0.1770	0.1140	0.2231	12
0.1588	0.1595	0.1145	0.2097	13
0.1538	0.1798	0.1448	0.3142	14
0.1552	0.1656	0.1531	0.2974	15
0.1514	0.1692	0.1905	0.3193	16
0.1490	0.1675	0.1692	0.2950	17
0.1462	0.1736	0.1522	0.2900	18
0.1447	0.1826	0.1535	0.2915	19

Framework versions

• Transformers 4.27.4
• TensorFlow 2.10.0
• Datasets 2.18.0
• Tokenizers 0.13.3