Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
PocketDoc
/
llama-13b-gptq-4bit-128g
like
0
Text Generation
Transformers
llama
text-generation-inference
Inference Endpoints
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
PocketDoc
commited on
May 14, 2023
Commit
99b4170
•
1 Parent(s):
2eee5f0
Create README.md
Browse files
Files changed (1)
hide
show
README.md
+3
-0
README.md
ADDED
Viewed
@@ -0,0 +1,3 @@
1
+
CUDA_VISIBLE_DEVICES=0 python llama.py ~/llama-13b c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors llama13b-4bit-128g.safetensors
2
+
3
+
https://huggingface.co/huggyllama/llama-13b