Hugging Face's logo

ausboss
/
llama-30b-supercot

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
5
ausboss commited on
Commit
87597f6
•
1 Parent(s): 9588461

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ I merged huggyllama/llama-30b + kaiokendev/SuperCOT-LoRA
2
+
3
+ I forgot to increase the shard size thats why there is so many bin files. I am currently quantizing it to 4bit 128g at the time of writing this.