This is a 4.65bpw quantized version of DrNicefellow/ChatAllInOne-Yi-34B-200K-V1 made with exllamav2.

Model Details

Features

  • Enhanced understanding and generation of conversational language.
  • Improved performance in diverse chat scenarios, including casual, formal, and domain-specific conversations.
  • Fine-tuned to maintain context and coherence over longer dialogues.

Prompt Format

Vicuna 1.1

See the finetuning dataset for examples.

License

This model is open-sourced under the Yi License.

Feeling Generous? 😊

Eager to buy me a cup of 2$ coffe or iced tea?πŸ΅β˜• Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?

Downloads last month
15
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including DrNicefellow/ChatAllInOne-Yi-34B-200K-V1-4.65bpw-exl2