Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

A simple (ie, I don't really know what I'm doing) 8bit quant of

cognitivecomputations/dolphin-2.9.1-yi-1.5-34b

python3 convert.py -i ../models/dolphin-2.9.1-yi-1.5-34b -o dolphin-2.9.1-yi-1.5-34b -cf dolphin-2.9.1-yi-1.5-34b -l 2048 -b 8.0 -hb 8 -ss 8192

Downloads last month
4
Inference API
Input a message to start chatting with bdambrosio/dolphin-2.9.1-yi-1.5-34b-8.0bit-exl2.
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.