Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mahihossain666
/
llama-2-70b-hf-quantized-3bits-GPTQ
like
0
Text Generation
Transformers
Safetensors
allenai/c4
llama
Inference Endpoints
text-generation-inference
3-bit
gptq
License:
pddl
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
Quantized to 3bit precision using AutoGPTQ.
Downloads last month
24
Safetensors
Model size
7.54B params
Tensor type
I32
·
FP16
·
Dataset used to train
mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ
allenai/c4
Updated
Jan 9
•
218k
•
188