Text Generation
GGUF
Inference Endpoints

Brainstorm GGUF

image/png

Quantized GGUF model files for DevQuasar/llama3_8b_chat_brainstorm

Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas.

Usage

LMStudio

With https://lmstudio.ai/ use the brainstorm.preset.json preset

llama.cpp

./main -m llama3_8b_chat_brainstorm.Q2_K.gguf -p "### HUMAN: I'd like to build an online marketplace\n ### ASSISTANT:" -n 400 -e -ins -r "### HUMAN:\n" -r "### ASSISTANT: "

I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.

If you want to support my efforts please visit my ko-fi page: https://ko-fi.com/devquasar

Also feel free to visit my website https://devquasar.com/

Downloads last month
303
GGUF
Model size
8.03B params
Architecture
llama

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples
Unable to determine this model's library. Check the docs .

Dataset used to train DevQuasar/llama3_8b_chat_brainstorm-GGUF

Spaces using DevQuasar/llama3_8b_chat_brainstorm-GGUF 2

Collections including DevQuasar/llama3_8b_chat_brainstorm-GGUF