TheBloke
/

Mistral-7B-Instruct-v0.1-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

Update README.md

#7 opened 11 months ago by

Inference Speed Compared to ExLlama?

#6 opened about 1 year ago by

32g Version

#5 opened about 1 year ago by

How to use this AWQ model from Python code gives an error.

#4 opened about 1 year ago by

AWQ models with transformer pipeline

#3 opened about 1 year ago by

Prompt for RAG

#2 opened about 1 year ago by