metadata

license: apache-2.0
tags:
  - generated_from_keras_callback
model-index:
  - name: Rocketknight1/distilbert-base-uncased-finetuned-squad
    results: []

Rocketknight1/distilbert-base-uncased-finetuned-squad

This model is a fine-tuned version of distilbert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 0.9581
Train End Logits Sparse Categorical Accuracy: 0.7344
Train Start Logits Sparse Categorical Accuracy: 0.6948
Validation Loss: 1.1235
Validation End Logits Sparse Categorical Accuracy: 0.7005
Validation Start Logits Sparse Categorical Accuracy: 0.6644
Epoch: 1

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'Adam', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 11064, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
training_precision: float32

Training results

Train Loss	Train End Logits Sparse Categorical Accuracy	Train Start Logits Sparse Categorical Accuracy	Validation Loss	Validation End Logits Sparse Categorical Accuracy	Validation Start Logits Sparse Categorical Accuracy	Epoch
1.4902	0.6126	0.5751	1.1502	0.6844	0.6561	0
0.9581	0.7344	0.6948	1.1235	0.7005	0.6644	1

Framework versions

Transformers 4.19.0.dev0
TensorFlow 2.8.0-rc0
Datasets 2.1.1.dev0
Tokenizers 0.11.0