DevQuasar/llama3_8b_chat_brainstorm-v2.1-GGUF

Brainstorm GGUF

Quantized GGUF model files for DevQuasar/llama3_8b_chat_brainstorm-v2.1

Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas. Model can summaryze the discussed ideas in Markdown format.

Usage

LMStudio

With https://lmstudio.ai/ use the brainstorm.preset.json preset

llama.cpp

./main -m llama3_8b_chat_brainstorm-v2.1.Q2_K.gguf -p "### HUMAN: I'd like to build an online marketplace\n ### ASSISTANT:" -n 400 -e -ins -r "### HUMAN:\n" -r "### ASSISTANT: "