YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
π LocalAI Boost Pack β Free Starter Edition
Turn Generic Local Models into High-Performance Specialty AI Tools
Tailored for Ollama, LM Studio, and Open WebUI.
β‘ Why Local LLMs Underperform Out-of-the-Box
When you download a raw 7B or 8B model (like Llama 3.1 8B or Mistral 7B), you often encounter frustrating bottlenecks:
- Endless "Yap" & Disclaimers: "Certainly! Here is an explanation of what I am about to do..." wasting precious generation tokens and time.
- Uncalibrated Temperatures: High temperatures in coding prompts cause subtle syntax bugs; low temperatures in creative prompts make characters robotic and dull.
- Truncated Contexts: Default 2048 context lengths crash multi-turn conversations and script refactoring.
LocalAI Boost Pack fixes this immediately with battle-tested system prompts featuring strict Negative Constraints, custom inference parameters (temperature, top_p, repeat_penalty), and an expanded 8,192 context window.
π¦ What's Inside the Free Starter Pack
This free starter edition includes 4 essential tuned engines:
| Preset Name | Focus Area | Tuned Behavior & Output Format |
|---|---|---|
β
no-yap-coder |
Dev / Coding | Zero polite talk, zero preamble. Immediately outputs executable, production-grade code blocks with correct syntax tags. |
β
pc-auto-scripter |
Automation | Specializes in Windows Batch (.bat), PowerShell (.ps1), and Bash. Includes safety checks and milestone echoes. |
β
raw-brainstormer |
Creative / Strategy | Cuts through generic corporate platitudes. Delivers 10 punchy, high-impact, provocative concepts in a numbered list. |
β
character-soul-builder |
Creative / Fiction | Builds multidimensional characters with flaws, contradictions, sensory quirks, and high-stakes dialogue samples. |
π οΈ Quick Installation Guide
Option 1: Ollama (1-Click Automated Setup)
Windows
- Make sure Ollama is installed and running.
- Double-click
install_windows.bat. - The script will automatically pull
llama3.1:8b(if needed) and register all 4 custom models. - Open your command prompt / terminal and run:
ollama run no-yap-coder
Mac / Linux
- Open terminal and navigate to this folder.
- Make the script executable and run:
chmod +x install_mac_linux.sh ./install_mac_linux.sh - Run any model:
ollama run raw-brainstormer
Option 2: LM Studio Setup
- Launch LM Studio.
- Load your desired model (e.g.,
Meta-Llama-3.1-8B-InstructorQwen2.5-7B-Instruct). - Open the JSON_Presets folder in this pack.
- Copy the
system_promptfrom the corresponding.jsonfile into LM Studio's System Prompt field. - In LM Studio's right-hand sidebar under Inference Parameters, apply the values from the JSON:
- Temperature:
0.2(for dev) or0.8β0.85(for creative) - Top P:
0.85or0.95 - Repeat Penalty:
1.1or1.2 - Context Length:
8192
- Temperature:
Option 3: Open WebUI Setup
- Go to Workspace > Models in Open WebUI.
- Click Add Model (+).
- Paste the
system_promptand configure parameters fromJSON_Presets/<name>.json. - Click Save & Create.
π How to Change the Base Model
By default, all Modelfiles reference FROM llama3.1:8b. If you prefer using other weights:
- Open any
.Modelfilein a text editor (Notepad, VS Code). - Edit the first line to your preferred local model tag:
# Example: Switch to Qwen 2.5 Coder FROM qwen2.5-coder:7b # Example: Switch to Mistral FROM mistral:7b - Re-run
ollama create <name> -f <path>to update.
π Unlock the Full Arsenal: LocalAI Boost Pack PRO
Love the starter pack? Elevate your entire local AI workflow with the PRO Complete Edition:
π₯ What You Get in PRO:
- All 20 Production-Calibrated Engines across 2 comprehensive categories:
- 10 Dev & Automation Engines:
no-yap-coder,pc-auto-scripter,bug-sniper,cli-command-gen,code-refactor-pro,json-data-converter,api-tool-architect,sql-query-builder,doc-readme-writer,tech-eli5-tutor. - 10 Creative & Ideation Engines:
raw-brainstormer,character-soul-builder,world-lore-architect,plot-twist-engine,dialogue-naturalizer,dark-gritty-writer,devil-advocate-critic,visual-prompt-director,viral-hook-creator,infinite-rp-master.
- 10 Dev & Automation Engines:
- In-Depth Parameter Tuning Cheatsheet (
PARAMETER_CHEATSHEET.md): Learn the exact mathematical sweet spots for temperature, repeat penalties, and VRAM context sizing. - 1-Click Master Installer for both Windows and Mac/Linux.
- Lifetime Updates & Future Preset Additions.
π Get the Pro Complete Pack on Gumroad
(Use code BOOST20 at checkout for an instant 20% launch discount!)
π License & Community
- Free for personal and commercial use on your own local machines.
- Created for the local AI and open-weights developer community.