This is was experinment to update my training method for future finetunes.
This model was trained on the dataset bellow for 5 epochs, at a learning rate of 2e-4, with 20 warm up steps.
https://huggingface.co/datasets/Replete-AI/code_test_dataset_10k
Prompt format: Alpaca
Below is an instruction that describes a task, Write a response that appropriately completes the request.
### Instruction:
### Response:
Join the Replete-Ai discord! We are a great and Loving community!
- Downloads last month
- 1,393