Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
coryg89
/
Yi-34B-200K-DARE-merge-v7-5bpw-exl2
like
0
Text Generation
Transformers
English
llama
mergekit
Merge
Yi
exl2
exllamav2
Inference Endpoints
text-generation-inference
5-bit
License:
yi-license (other)
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
Edit model card
Yi-34B-200K-DARE-merge-v7-5bpw-exl2
Yi-34B-200K-DARE-merge-v7-5bpw-exl2
Original model:
brucethemoose/Yi-34B-200K-DARE-megamerge-v7
Available quants:
coryg89/Yi-34B-200K-DARE-merge-v7-4bpw-exl2
coryg89/Yi-34B-200K-DARE-merge-v7-5bpw-exl2
coryg89/Yi-34B-200K-DARE-merge-v7-6bpw-exl2
coryg89/Yi-34B-200K-DARE-merge-v7-8bpw-exl2
Downloads last month
0
Inference API
Text Generation
Examples
Compute
Model is too large to load in Inference API (serverless). To try the model, launch it on
Inference Endpoints (dedicated)
instead.
JSON Output
Maximize
Invalid base_model specified in model card metadata. Needs to be a model id from
hf.co/models
.
