Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mahihossain666
/
llama-2-70b-hf-quantized-3bits-GPTQ
like
0
Text Generation
Transformers
Safetensors
allenai/c4
llama
Inference Endpoints
text-generation-inference
3-bit
License:
pddl
Model card
Files
Files and versions
Community
Train
Deploy
Use in Transformers
Edit model card
Quantized to 3bit precision using AutoGPTQ.
Downloads last month
47
Safetensors
Model size
7.54B params
Tensor type
I32
·
FP16
·
Dataset used to train
mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ
allenai/c4
Updated
Jan 9
•
139k
•
179