Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ChenMnZ
's Collections
EfficientQAT
EfficientQAT(w/o E2E-FT)
EfficientQAT(GPTQ format)
EfficientQAT (BitBLAS format)
EfficientQAT (BitBLAS format)
updated
Jul 22
EfficientQAT quantized models with BitBLAS data format.
Upvote
-
ChenMnZ/Llama-2-7b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
15
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
12
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
9
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
7
ChenMnZ/Llama-3-8b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
8
ChenMnZ/Llama-3-8b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
8
ChenMnZ/Llama-3-8b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
5
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
13
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
13
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
8
ChenMnZ/Llama-3-70b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
7
ChenMnZ/Llama-3-70b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
10
ChenMnZ/Llama-3-70b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
13
ChenMnZ/Llama-2-7b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
8
ChenMnZ/Llama-2-7b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
11
ChenMnZ/Llama-2-70b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
10
ChenMnZ/Llama-2-70b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
9
ChenMnZ/Llama-2-13b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
12
ChenMnZ/Llama-2-13b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
7
ChenMnZ/Llama-2-13b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
7
Upvote
-
Share collection
View history
Collection guide
Browse collections