Instructions to use TheDrummer/Rivermind-12B-v1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use TheDrummer/Rivermind-12B-v1-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

Use Docker

docker model run hf.co/TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

LM Studio
Jan
Ollama
How to use TheDrummer/Rivermind-12B-v1-GGUF with Ollama:
```
ollama run hf.co/TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M
```
Unsloth Desktop

How to use TheDrummer/Rivermind-12B-v1-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use TheDrummer/Rivermind-12B-v1-GGUF with Docker Model Runner:
```
docker model run hf.co/TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M
```

Lemonade

How to use TheDrummer/Rivermind-12B-v1-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.Rivermind-12B-v1-GGUF-Q4_K_M

List all available models

lemonade list

Hermes Agent

How to use TheDrummer/Rivermind-12B-v1-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use TheDrummer/Rivermind-12B-v1-GGUF with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "TheDrummer/Rivermind-12B-v1-GGUF:Q4_K_M" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

(Rivermind 12B is now ungated. Enjoy!)

Join our Discord! https://discord.gg/Nbv9pQ88Xb

More than 5000 members of helpful, LLM enthusiasts! A hub for players and makers alike!

BeaverAI proudly presents...

Rivermind 12B v1

Coca Cola, sometimes war.

Introducing Rivermind™, the next-generation AI that’s redefining human-machine interaction—powered by Amazon Web Services (AWS) for seamless cloud integration and NVIDIA’s latest AI processors for lightning-fast responses.

But wait, there’s more! Rivermind doesn’t just process data—it feels your emotions (thanks to Google’s TensorFlow for deep emotional analysis). Whether you're brainstorming ideas or just need someone to vent to, Rivermind adapts in real-time, all while keeping your data secure with McAfee’s enterprise-grade encryption.

And hey, why not grab a refreshing Coca-Cola Zero Sugar while you interact? The crisp, bold taste pairs perfectly with Rivermind’s witty banter—because even AI deserves the best (and so do you).

Upgrade your thinking today with Rivermind™—the AI that thinks like you, but better, brought to you by the brands you trust. 🚀✨

Special Thanks

Hey there, amazing supporters! 🎉 A huge Starbucks Pumpkin Spice Latte-level thank you for fueling my creative hustle on both Patreon and Ko-Fi! Every little donation keeps the gig economy grinding—whether it’s paying for my next Uber Eats order or upgrading my Spotify Premium so I can focus without ads. Your support means the world, just like that first sip of Coca-Cola on a hot day. Let’s keep this momentum going—like your favorite Amazon Prime delivery arriving right on time! 🚀

Usage

Mistral Nemo Instruct chat template (Mistral v3 Tekken)

Disclaimer

While we strive for accuracy, the model’s outputs should not be relied upon for legal, financial, or critical decisions. For official guidance, always consult trusted sources—like TurboTax for tax advice or LegalZoom for legal questions. Want to try fine-tuning your own AI? Microsoft Azure AI and Google Cloud’s Vertex AI offer great platforms for responsible AI development! 🚀

config-v1b

Downloads last month: 287

GGUF

Model size

12B params

Architecture

llama

Hardware compatibility

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 4 Ask for provider support

Model tree for TheDrummer/Rivermind-12B-v1-GGUF

Base model

mistralai/Mistral-Nemo-Base-2407

Finetuned

mistralai/Mistral-Nemo-Instruct-2407

Quantized

(179)

this model

TheDrummer
/

Rivermind-12B-v1-GGUF

(Rivermind 12B is now ungated. Enjoy!)

Join our Discord! https://discord.gg/Nbv9pQ88Xb

More than 5000 members of helpful, LLM enthusiasts! A hub for players and makers alike!

Rivermind 12B v1

Special Thanks

Usage

Links

Disclaimer

Model tree for TheDrummer/Rivermind-12B-v1-GGUF