Phi-3-Context-Obedient-RAG / model-00001-of-00002.safetensors

Commit History

Added more instruction ability to the models training data.
cb94d39
verified

TroyDoesAI commited on

Further Tuned for 1 Epoch of 8k context examples (300 in total)
9b80104
verified

TroyDoesAI commited on

Attempt #2 at Context obedient for 128k context model, trained longer at lower LR.
ab78bdb
verified

TroyDoesAI commited on

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template.
bca0a65
verified

TroyDoesAI commited on