VPTQ-demo / README.md
OpenSourceRonin's picture
initial commit
d39b1cd verified
|
raw
history blame
409 Bytes
---
title: LLM 2Bit
emoji: 💬
colorFrom: yellow
colorTo: purple
sdk: gradio
sdk_version: 4.36.1
app_file: app.py
pinned: false
license: mit
short_description: 2bit infer for llm
---
An example chatbot using [Gradio](https://gradio.app), [`huggingface_hub`](https://huggingface.co/docs/huggingface_hub/v0.22.2/en/index), and the [Hugging Face Inference API](https://huggingface.co/docs/api-inference/index).