metadata

license: apache-2.0
tags:
  - generated_from_keras_callback
model-index:
  - name: Rocketknight1/distilbert-base-uncased-finetuned-squad
    results: []

Rocketknight1/distilbert-base-uncased-finetuned-squad

This model is a fine-tuned version of distilbert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 1.4605
Train End Logits Sparse Categorical Accuracy: 0.6170
Train Start Logits Sparse Categorical Accuracy: 0.5768
Validation Loss: 1.1588
Validation End Logits Sparse Categorical Accuracy: 0.6840
Validation Start Logits Sparse Categorical Accuracy: 0.6511
Epoch: 0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'Adam', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 11064, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
training_precision: float32

Training results

Train Loss	Train End Logits Sparse Categorical Accuracy	Train Start Logits Sparse Categorical Accuracy	Validation Loss	Validation End Logits Sparse Categorical Accuracy	Validation Start Logits Sparse Categorical Accuracy	Epoch
1.4605	0.6170	0.5768	1.1588	0.6840	0.6511	0

Framework versions

Transformers 4.19.0.dev0
TensorFlow 2.8.0-rc0
Datasets 2.1.1.dev0
Tokenizers 0.11.0