Hugging Face's logo

voxta
/
ehartford_dolphin-2_2-yi-34b-3bpw-exl2

Text Generation
Transformers
English
llama
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
1
Edit model card

Dolphin 2.2 🐬 https://erichartford.com/dolphin

This model is based on Yi, and is subject to Yi license.

dolphin-2_2-yi-34b

Description

Quantized for Exllamav2 using 3bpw.

Downloads last month
2
Inference API
Text Generation
Examples
Input a message to start chatting with voxta/ehartford_dolphin-2_2-yi-34b-3bpw-exl2.
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.

Datasets used to train voxta/ehartford_dolphin-2_2-yi-34b-3bpw-exl2

Space using voxta/ehartford_dolphin-2_2-yi-34b-3bpw-exl2 1