Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
kuleshov
/
llama-7b-4bit
like
13
Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card
Files
Files and versions
Community
9
Train
Deploy
Use this model
5eb0eee
llama-7b-4bit
/
quant_config.json
kuleshov
first commit
5eb0eee
12 months ago
raw
Copy download link
history
blame
No virus
179 Bytes
{
"dataset"
:
"c4"
,
"bits"
:
4
,
"nsamples"
:
128
,
"groupsize"
:
64
,
"act_order"
:
true
,
"percdamp"
:
0.01
,
"seed"
:
0
,
"nearest"
:
false
,
"save"
:
"/tmp/llama-out-test"
}