Quantization Request

#6
by Venkman42 - opened

Hi there,

Sorry for using the wrong channel, but I don't know where else to put this.

Could you please quantize the phi 2 dpo model?
lxuechen/phi-2-dpo

On Alpaca Leaderboard it scores almost as high as ChatGPT, would love to try it in llama.cpp.

Cheers

Have you tried TheBlokes discord? He has areas for new model requests. As well as model discussion where you might get better attention. There has already been a lot of conversation about phi-2 in general on his discord.

Have you tried TheBlokes discord? He has areas for new model requests. As well as model discussion where you might get better attention. There has already been a lot of conversation about phi-2 in general on his discord.

Thanks for the hint :) I wasn't aware that existed

Venkman42 changed discussion status to closed

Sign up or log in to comment