ANLP Assignment 1 -- Config C5
Brown Corpus binary cipher -> plaintext Transformer.
Configuration
| Parameter | Value |
|---|---|
| Config | C5 |
| PE type | sinusoidal |
| Attention | mha |
| Norm | layernorm |
| d_model | 256 |
| n_heads | 8 |
| n_layers | 4 |
| ffn_dim | 512 |
| BPE vocab | 2000 |
| Epochs | 40 |
Test Results
| Metric | Value |
|---|---|
| loss | 0.0359 |
| token_acc | 0.0020 |
| bit_acc | 0.5496 |
| seq_acc | 0.0000 |
| levenshtein | 233.5940 |
| bleu | 0.0000 |
| bleu1 | 98.4300 |
| bleu2 | 48.5000 |
| bleu3 | 4.7500 |
| bleu4 | 0.0700 |
| rouge1 | 5.4800 |
| rouge2 | 2.0500 |
| rougeL | 5.3200 |
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support