HF Quantization

community

AI & ML interests

Making AI models smaller, and faster with Quantization

Recent Activity

medmekk updated a Space about 1 month ago

HF-Quantization/bnb-my-repo

medmekk updated a Space about 1 month ago

HF-Quantization/bnb-my-repo

medmekk published a model 3 months ago

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8

View all activity

Collections 1

spaces 3

Running on A10G

BitsAndBytes

Quantize and save models to Hugging Face

TorchAO

Quantize Hugging Face models and save to your profile

TorchAO

Quantize and save Hugging Face models

models 11

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4

HF-Quantization/Llama-3.2-1B-BNB-INT8

Updated Jan 21 • 1

HF-Quantization/Llama-3.2-1B-BNB-NF4

HF-Quantization/Llama-3.2-1B-BNB-FP4

Updated Jan 21 • 28

HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16

Updated Jan 21 • 1

HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16

Updated Jan 21 • 15

HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8

Updated Jan 21 • 1

HF-Quantization/Llama-3.2-1B-TORCHAO-W8

Updated Jan 21 • 1

HF-Quantization/Llama-3.2-1B-TORCHAO-W4

Updated Jan 21 • 1

datasets

None public yet