afrideva's picture
Upload README.md with huggingface_hub
f87b5f9 verified
metadata
base_model: DevQuasar/llama3_8b_chat_brainstorm
datasets:
  - DevQuasar/brainstorm_vicuna_1k
inference: true
license: apache-2.0
model_context_window: 8192
model_creator: DevQuasar
model_name: llama3_8b_chat_brainstorm
pipeline_tag: text-generation
quantized_by: afrideva
tags:
  - gguf
  - ggml
  - quantized

llama3_8b_chat_brainstorm-GGUF

Quantized GGUF model files for llama3_8b_chat_brainstorm from DevQuasar

Original Model Card:

image/png

Model intention

Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas.

Examples

Inference code

https://github.com/csabakecskemeti/ai_utils/blob/main/brainstorm_inference.py

Example generations

[USER] (Ctrl+C to exit): Today I'm gonna buy all healthy product at the grocery store.

[CHAT]: What kind of healthy products are you thinking of buying?

[USER] (Ctrl+C to exit): Mainly vegetables, and some lean white meet like fish and chicken

[CHAT]: Have you considered organic produce for your veggies?


[USER] (Ctrl+C to exit): I'm thinking to invest in a franchise to get a new source of income.

[CHAT]: That's an interesting idea! What kind of franchises are you considering?

[USER] (Ctrl+C to exit): Something that is a small upfront cost, not sure what would be a great choice.

[CHAT]: Have you considered food-related franchises like pizza or ice cream shops? They often have low startup costs.

[USER] (Ctrl+C to exit): But that risky due to publich healt requirements

[CHAT]: You're right, there are some regulations to consider. How would you plan to mitigate those risks?

[USER] (Ctrl+C to exit): I guess do some other non food related franchise

[CHAT]: What about a business service franchise like janitorial or landscaping services? Those might have lower regulatory burdens.