Instructions to use SL-AI/GRaPE-2.5-Helios with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SL-AI/GRaPE-2.5-Helios with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="SL-AI/GRaPE-2.5-Helios") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("SL-AI/GRaPE-2.5-Helios") model = AutoModelForMultimodalLM.from_pretrained("SL-AI/GRaPE-2.5-Helios", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use SL-AI/GRaPE-2.5-Helios with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SL-AI/GRaPE-2.5-Helios" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SL-AI/GRaPE-2.5-Helios", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/SL-AI/GRaPE-2.5-Helios
- SGLang
How to use SL-AI/GRaPE-2.5-Helios with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SL-AI/GRaPE-2.5-Helios" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SL-AI/GRaPE-2.5-Helios", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SL-AI/GRaPE-2.5-Helios" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SL-AI/GRaPE-2.5-Helios", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use SL-AI/GRaPE-2.5-Helios with Docker Model Runner:
docker model run hf.co/SL-AI/GRaPE-2.5-Helios
The General Reasoning Agent (for) Project Exploration
The GRaPE 2.5 Family
| Model | Size | Modalities | Domain |
|---|---|---|---|
| GRaPE 2.5 Qusar | 27B | Image + Text in, Text out | Astronomically high performance |
| GRaPE 2.5 Helios | 10B | Image + Text in, Text out | Local Environments for generalistic tasks |
GRaPE 2.5 Helios
GRaPE 2.5 Helios is the mid-sized model of the third-generation GRaPE family, it supports multimodal inputs (image + text) and features controllable thinking modes, and work efforts for agentic tasks.
GRaPE 2.5 Helios is the direct successor to GRaPE 2.1 Flash, carrying forward research and reasoning improvements from the second generation while incorporating substantially improved training data, focusing on data quality over quantity.
What's New in GRaPE 2.5
GRaPE 2.5 Helios addresses several shortcomings from the previous generation:
- A Stronger Training Corpus — featuring more diverse data
- A Likable Prose — that escapes traditional LLM-isms
- More Generalization — adapting to more scenarios than previous models
- A More Stern Work Ethic — knows how it's supposed to work
Capabilities
GRaPE 2.5 Helios was post-trained on a curated proprietary dataset including:
- Creative Tasks
- Agentic Coding
- STEAM
GRaPE 2.5 Helios accepts image, video and text as input and produces text as output.
GRaPE 2.5 models were trained to have a less robotic prose, nearly eliminating common AI-isms such as "Honestly?" or the common "It's not just X, it's Y" pattern of phrasing things. Em-dashes have also nearly been eliminated from the model's vocabulary, seeming more natural rather than robotic.
Thinking
GRaPE 2.5 Helios features controllable reasoning depth through the <thinking_mode=xxx> tag. Place it at the end of your prompt. Not in the system prompt.
| Mode | Behavior | Tokens |
|---|---|---|
minimal |
Omits most thinking | 0 - 128 |
low |
Brief reasoning pass | 128 - 1,024 |
medium |
Standard reasoning | 1,024 – 4,096 |
high |
Extended reasoning | 4,096 – 8,192 |
xtra-hi |
Deep extended thought | > 8,192 |
Usage example:
Build a simulation of Prion Disease in the human body, include detailed diagrams for what reactions occur inside of the human body. <thinking_mode=high>
GRaPE 2.5 Models support alternative methods of selecting thinking modes, such as Muse Glimmer's system-prompt-based style.
In addition, if another harness uses
xhighfor the Extra High thinking mode, GRaPE 2.5 Helios will map that toxtra-hi.
Tip: For simple queries,
mediumis recommended. Whereashighandxtra-hishould be used for complex coding tasks, multi-step math, or deep analytical work.
During agentic work, you may notice GRaPE 2.5 Helios use lower levels of thinking than what you defined. The model was trained to optimize token usage for these tasks by not burning tens-of-thousands of tokens every turn. For example, the xtra-hi thinking mode may dip down to medium while the agent is applying fixes it previously thought about.
Like all other GRaPE 2.5 models, Helios was trained to preserve previous thinking blocks in context. This has greatly improved the performance of agentic coding tasks compared to GRaPE 2 models.
Multilingual Thinking
GRaPE 2.5 models were trained to be able to think in languages other than English. You can add to the system prompt Think in <language>, but respond in English.
By default, GRaPE 2.5 Helios will think and respond in whatever language you prompt it in. Allowing for more seamless conversations, without forcing you, or your users, to know English to understand what is going on.
Thought Summaries
GRaPE 2.5 models produce thought summaries during thinking. Both a header, and detailed description of the model's thoughts can be extracted easily.
For every new section the model will output ##, with a one-line summary afterwards. The proceeding paragraph will then be the description of the model's thoughts, from a high-level perspective.
Thought Summaries are not supported in
minimalorlowthinking modes. They skip the summaries as well as sections in favor of quicker response times.
Idea Generation
Instead of the typical process of where a typical reasoning model would go through the thinking process, working linearly, GRaPE 2.5 Helios attempts to scaffold the entire thinking block before proceeding with thinking.
We believe this grounds the model more to stay on-task, and prevent Wait, but what if... loops found commonly in small models trained to think for long sequences. The format follows a TODO-list style, which allows you to see how far along the model is in the thinking trajectory, as well as see future thought segments, all before they are generated.
In most thinking blocks, you may also see a list of 4-8 ideas with entire scopes be generated, and the model weighing each approach to find the best one. Minimizing confusion between the prompt and the expected result. This will be skipped if you are extremely explicit in your prompt about what you want GRaPE to do.
Low mode, and sometimes minimal mode, will only generate ideas, and will skip thinking in TODO lists, all for the sake of brevity.
Work Effort
GRaPE 2.5 Helios features controllable reasoning depth through the <work_effort=xxx> tag. Place it at the end of your prompt. SLAI apps do this automatically.
| Mode | Behavior | Tokens |
|---|---|---|
minimal |
Doesn't use tools, or uses very few tools | 0-2 |
low |
Brief tool usage | < 3-9 |
medium |
Standard Analysis | 10-19 |
high |
Extended Analysis | 20-29 |
xtra-hi |
Large Coding Tasks | 30+ |
Usage example:
Check linkedin for Chad Donnet's account page, and see what he is proficient in, write a report to a markdown file when done. <work_effort=medium>
If the work effort is left blank, GRaPE 2.5 Helios will automatically decide on the work effort required for the task.
Work effort only works when the agent has access to tools. Otherwise, it will use minimal, regardless of the user-defined thinking modes.
Tip: GRaPE 2.5 Helios had a large amount of agent training done in our agent harness, Scribe, we recommend it for best performance.
To learn more about Scribe, and download it, visit the product page Here.
Sampling Parameters
These sampling parameters are a good starting point:
| Parameter | Value |
|---|---|
| Temperature | 0.6 |
| Top K | 20 |
| Repeat Penalty | 1.0 |
| Top P | 0.95 |
| Min P | 0 |
Training Methodology
We believe one of local AI's greatest short comings has been in creativity. Models have proven they can code agentically, some smaller models even getting close to the performance found by large labs. However, they miss out on a key component most people don't think of when using the models: Creative Capability.
When you ask a model, "Make a website for yourself," you likely don't want to see a SaaS app with purple and blue gradients everywhere, that looks like every other AI models' response to the same question. You want something genuinely unique, and special to that model. We took that direction with GRaPE 2.5.
We focused a large sum of the training corpus on the models' ability to construct creative conversations, and write stories. As found from previous Openprose models, GRaPE 2.5 models have the greatest creative capability out of any prior model.
During early experimental testing of GRaPE 2.5 Quasar, we found the model would often be too creative for it's own good. When asked for a Browser OS app, it decided to not go for an web-based app which has a classic desktop environment. It wanted to build a ring, which every app would have an orbit around the center, and the window manager would move the apps around the orbit. The web-based browser OS had a proof-of-concept, but was very unrefined.
Testing community-made prompts, such as Bijan Bowen's "Steve the PC-Repair Man" game, the same experimental version of GRaPE 2.5 Quasar built the game, but kept finding new, and creative features, and most importantly, did not give up.
GRaPE 2.5 models was our first adventure into jointly boosting a model's creative capabilities with programming capabilities, and we hope we can further this development into future models.
Notes
- Training data is closed-source and proprietary.
- Updates and announcements are posted on Skinnertopia
Unless there is strong demand, we will not be releasing any other model sizes for the GRaPE 2.5 family, and instead focus on GRaPE 3 models.
GRaPE 2.5 is likely one of the last models SLAI will produce for simply being a finetune on-top of another model. We will conduct further research and release experimental GRaPE 3 models.
We appreciate you all for the continued support and appreciation for GRaPE models.
GRaPE 2.5 Helios is developed under the SLAI (Skinnertopia Lab for Artificial Intelligence) brand and released under the Apache 2.0 license.
- Downloads last month
- -
