Hugging Face's logo

DevQuasar
/
llama3_8b_chat_brainstorm-v2.1-GGUF

Text Generation
Transformers
GGUF
llama
text-generation-inference
Inference Endpoints
Model card Files Community
llama3_8b_chat_brainstorm-v2.1-GGUF / README.md
csabakecskemeti's picture
csabakecskemeti
Update README.md
fd7d3b1 verified
preview code
|
raw
history blame contribute delete
No virus
1.01 kB
metadata
license: llama3
datasets:
  - DevQuasar/brainstorm-v2.1_vicuna_1k
pipeline_tag: text-generation

Brainstorm GGUF

image/png

Quantized GGUF model files for DevQuasar/llama3_8b_chat_brainstorm-v2.1

Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas. Model can summaryze the discussed ideas in Markdown format.

Usage

LMStudio

With https://lmstudio.ai/ use the brainstorm.preset.json preset

llama.cpp

./main -m llama3_8b_chat_brainstorm-v2.1.Q2_K.gguf -p "### HUMAN: I'd like to build an online marketplace\n ### ASSISTANT:" -n 400 -e -ins -r "### HUMAN:\n" -r "### ASSISTANT: "