YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
https://huggingface.co/databricks/dolly-v2-12b
converted to mlc_llm format using https://github.com/mlc-ai/mlc-llm
command
python build.py --model dolly-v2-12b --target vulkan --quantization-mode int4 --quantization-sym --max-seq-len 2048
not fully tested because i got "CUDA: out of memory"
- Downloads last month
- 0
Unable to determine this model's library. Check the
docs
.