Edit model card

openchat-3.5-0106-11b GGUF

Original model: openchat-3.5-0106-11b Model creator: CallComply

This repo contains GGUF format model files for CallComply’s openchat-3.5-0106-11b.

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 1894 (revision 5c99960)

Prompt template: OpenChat (GPT4 Correct)

GPT4 Correct User: Hello<|end_of_turn|>GPT4 Correct Assistant: Hi<|end_of_turn|>GPT4 Correct User: How are you today?<|end_of_turn|>GPT4 Correct Assistant:

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs.ai

cnvrs is the best app for private, local AI on your device:

  • create & save Characters with custom system prompts & temperature settings
  • download and experiment with any GGUF model you can find on HuggingFace!
  • make it your own with custom Theme colors
  • powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
  • try it out yourself today, on Testflight!
  • follow cnvrs on twitter to stay up to date

Downloads last month
156
GGUF
Model size
10.7B params
Architecture
llama
+1
Inference Examples
Inference API (serverless) has been turned off for this model.

Quantized from