File size: 1,746 Bytes
850899f
 
4962103
 
 
 
 
850899f
 
4962103
 
850899f
4962103
850899f
4962103
 
0d57954
 
f27f6b4
0d57954
850899f
 
 
4962103
850899f
 
 
4962103
850899f
4962103
850899f
4962103
850899f
4962103
850899f
4962103
850899f
4962103
0f392c4
4962103
850899f
4962103
850899f
4962103
 
f27f6b4
0d57954
850899f
 
4962103
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
---
license: mit
tags:
- generated_from_keras_callback
model-index:
- name: sushruth13/xlnet_base1.0
  results: []
---

<!-- This model card has been generated automatically according to the information Keras had access to. You should
probably proofread and complete it, then remove this comment. -->

# sushruth13/xlnet_base1.0

This model is a fine-tuned version of [xlnet-base-cased](https://huggingface.co/xlnet-base-cased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Train Loss: 0.1216
- Validation Loss: 0.0420
- Train Accuracy: 1.0
- Epoch: 1

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': False, 'is_legacy_optimizer': False, 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 1525, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
- training_precision: float32

### Training results

| Train Loss | Validation Loss | Train Accuracy | Epoch |
|:----------:|:---------------:|:--------------:|:-----:|
| 0.3189     | 0.1669          | 1.0            | 0     |
| 0.1216     | 0.0420          | 1.0            | 1     |


### Framework versions

- Transformers 4.28.1
- TensorFlow 2.12.0
- Datasets 2.11.0
- Tokenizers 0.13.3