How to change model in config.yml file?

#12
by ianuvrat - opened

I 'm using following model it works.
MODEL_TYPE: 'llama'
MODEL_BIN_PATH: 'models/llama-2-7b-chat.ggmlv3.q8_0.bin'.

But when I change the model to 13b, it gives error.
MODEL_TYPE: 'llama'
MODEL_BIN_PATH: 'models/llama-2-13b-chat.ggmlv3.q2_K.bin'

Can someone assist?. What's wrong here

Sign up or log in to comment