Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Peeepy
/
llama-30b-oasst-4bit-128g
like
5
Text Generation
Transformers
llama
Inference Endpoints
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
6436cd7
llama-30b-oasst-4bit-128g
/
README.md
Peeepy
Create README.md
6436cd7
over 1 year ago
preview
code
|
raw
Copy download link
history
blame
Safe
160 Bytes
huggyllama/llama-30b merged with serpdotai/llama-oasst-lora-30B, quantized to 4bit with 128g groupsize. 16bit and non-groupsize versions are on my repo as well.