Fine-tuning Models on the CodeTrans Dataset
We fine-tuned the following models on CodeTrans dataset: - meta-llama/Meta-Llama-3-8B-Instruct
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
| Training Loss | Epoch | Step | Validation Loss | Input Tokens Seen |
|---|---|---|---|---|
| 1.5996 | 0.0075 | 5 | 1.5324 | 10240 |
| 1.6241 | 0.0149 | 10 | 1.4965 | 20480 |
| 1.5399 | 0.0224 | 15 | 1.4884 | 30720 |
Training results
Framework versions
- PEFT 0.10.0
- Transformers 4.40.1
- Pytorch 2.1.2
- Datasets 2.19.1
- Tokenizers 0.19.1
- Downloads last month
- 17
Unable to determine this model’s pipeline type. Check the
docs
.