Hugging Face's logo

TheBlokeAI
/
jackfram_llama-68m-GPTQ

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
TheBloke commited on
Commit
88e73fc
•
1 Parent(s): 7e08ca1

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ A 4-bit, 128g, act_order=True GPTQ quantisation of JackFram/llama-68m, a 68M Llama model created on request for software testing.
2
+
3
+ Not for normal usage!