---
title: openchat-3.5-0106-GGUF (Q4_K_M)
colorFrom: purple
colorTo: blue
sdk: docker
models:
  - teknium/OpenHermes-2.5-Mistral-7B
  - TheBloke/openchat-3.5-0106-GGUF
tags:
  - inference api
  - openai-api compatible
  - llama-cpp-python
  - openchat-3.5-0106-GGUF
  - gguf
pinned: false
---

# openchat-3.5-0106-GGUF (Q4_K_M)

Please refer to the [index.html](index.html) for more information.