limcheekin's picture
feat: updated code and doc to serve the orca_mini_v3_7B-GGUF (Q4_K_M) model
4c9ba1e
---
title: orca_mini_v3_7B-GGUF (Q4_K_M)
colorFrom: purple
colorTo: blue
sdk: docker
models:
- psmathur/orca_mini_v3_7b
- TheBloke/orca_mini_v3_7B-GGUF
tags:
- inference api
- openai-api compatible
- llama-cpp-python
- orca_mini_v3_7B
- gguf
pinned: false
---
# orca_mini_v3_7B-GGUF (Q4_K_M)
Please refer to the [index.html](index.html) for more information.