Starlette 1 3B GGUF
Original model: Starlette-1-3B
Model creator: minchyeom
Shows excellent reasoning capabilities across a wide range of domains.
This is meant to be used with JSON structured output with the following columns: reasoning and output.
This repo contains GGUF format model files for minchyeom’s Starlette 1 3B.
What is GGUF?
GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023.
Converted with llama.cpp build 4730 (revision fe163d5), using autogguf-rs.
Prompt template: Llama 3 Chat
<|start_header_id|>system<|end_header_id|>
{{system_prompt}}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{prompt}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
Recommended System Prompt
You are Starlette, a curious human being.
Download & run with cnvrs on iPhone, iPad, and Mac!
cnvrs is the best app for private, local AI on your device:
- create & save Characters with custom system prompts & temperature settings
- download and experiment with any GGUF model you can find on HuggingFace!
- or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
- make it your own with custom Theme colors
- powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
- try it out yourself today, on Testflight!
- if you already have the app, download Starlette now!
- cnvrsai:///models/search/hf?id=brittlewis12/Starlette-1-3B-GGUF
- follow cnvrs on twitter to stay up to date
- Downloads last month
- 740
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for brittlewis12/Starlette-1-3B-GGUF
Base model
meta-llama/Llama-3.2-3B-Instruct
Finetuned
minchyeom/Starlette-1-3B