YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
A simple (ie, I don't really know what I'm doing) 8bit quant of
cognitivecomputations/dolphin-2.9.1-yi-1.5-34b
python3 convert.py -i ../models/dolphin-2.9.1-yi-1.5-34b -o dolphin-2.9.1-yi-1.5-34b -cf dolphin-2.9.1-yi-1.5-34b -l 2048 -b 8.0 -hb 8 -ss 8192
- Downloads last month
- 5
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.