rocket-3B-GGUF / README.md
limcheekin's picture
feat: added chat_format and update Q6_K model
a5c9525
metadata
title: rocket-3B-GGUF (Q6_K)
colorFrom: purple
colorTo: blue
sdk: docker
models:
  - pansophic/rocket-3B
  - TheBloke/rocket-3B-GGUF
tags:
  - inference api
  - openai-api compatible
  - llama-cpp-python
  - rocket-3B-GGUF
  - gguf
pinned: false

rocket-3B-GGUF (Q6_K)

Please refer to the index.html for more information.