Inference template + Sample

#3
by adi-kmt - opened

Was having a look at your model and wondering what would be the exact format to inference the model?
Especially considering this and this (tldr. basically difference between the way axolotl and hf tokenizes the prompts)

Sign up or log in to comment