TheBloke

/

Dolphin-Llama2-7B-GPTQ

like 23

Hello TheBloke,
could you consider releasing smaller models like this one for MLC so that they can be run on mobile?

https://mlc.ai/mlc-llm/docs/compilation/compile_models.html