first_name.last_name
add processing notice
2ff8a40
|
raw
history blame
1.25 kB
metadata
inference: false

Orenguteng/Lexi-Llama-3-8B-Uncensored AWQ

** PROCESSING .... ETA 30mins **

About AWQ

AWQ is an efficient, accurate and blazing-fast low-bit weight quantization method, currently supporting 4-bit quantization. Compared to GPTQ, it offers faster Transformers-based inference with equivalent or better quality compared to the most commonly used GPTQ settings.

AWQ models are currently supported on Linux and Windows, with NVidia GPUs only. macOS users: please use GGUF models instead.

It is supported by: