Instructions to use morikomorizz/Step-3.7-Flash-MTP-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use morikomorizz/Step-3.7-Flash-MTP-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="morikomorizz/Step-3.7-Flash-MTP-GGUF", filename="Step-3.7-Flash-IQ3_M.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use morikomorizz/Step-3.7-Flash-MTP-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M # Run inference directly in the terminal: llama cli -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M # Run inference directly in the terminal: llama cli -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M # Run inference directly in the terminal: ./llama-cli -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
Use Docker
docker model run hf.co/morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
- LM Studio
- Jan
- vLLM
How to use morikomorizz/Step-3.7-Flash-MTP-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "morikomorizz/Step-3.7-Flash-MTP-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "morikomorizz/Step-3.7-Flash-MTP-GGUF", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
- Ollama
How to use morikomorizz/Step-3.7-Flash-MTP-GGUF with Ollama:
ollama run hf.co/morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
- Unsloth Studio
How to use morikomorizz/Step-3.7-Flash-MTP-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for morikomorizz/Step-3.7-Flash-MTP-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for morikomorizz/Step-3.7-Flash-MTP-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for morikomorizz/Step-3.7-Flash-MTP-GGUF to start chatting
- Pi
How to use morikomorizz/Step-3.7-Flash-MTP-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use morikomorizz/Step-3.7-Flash-MTP-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
Run Hermes
hermes
- Atomic Chat new
- Docker Model Runner
How to use morikomorizz/Step-3.7-Flash-MTP-GGUF with Docker Model Runner:
docker model run hf.co/morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
- Lemonade
How to use morikomorizz/Step-3.7-Flash-MTP-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull morikomorizz/Step-3.7-Flash-MTP-GGUF:IQ3_M
Run and chat with the model
lemonade run user.Step-3.7-Flash-MTP-GGUF-IQ3_M
List all available models
lemonade list
Overview
This repository contains the GGUF quantized files for stepfun-ai/Step-3.7-Flash.
- Original Model: stepfun-ai/Step-3.7-Flash
- Architecture: Step-3.7-Flash
- License: Apache 2.0
- MTP Support: Yes - From Base Model
| Quant Type | Size | Description |
|---|---|---|
| IQ3_S | 85-91 GB | Mixed Precision for Better Quality |
| IQ3_M | 96-103 GB | Mixed Precision for Better Quality |
| IQ4_XS | 109-117 GB | Mixed Precision for Better Quality |
[ModelPage]: https://static.stepfun.com/blog/step-3.7-flash/
1. Introduction
Step 3.7 Flash is a 198B-parameter sparse Mixture-of-Experts (MoE) vision-language model that combines a 196B-parameter language backbone with a 1.8B-parameter vision encoder for native image understanding. Engineered for high-frequency production workloads, it activates approximately 11B parameters per token and delivers a throughput of up to 400 tokens per second. Step 3.7 Flash supports a 256k context window and offers three selectable reasoning levels (low, medium, and high) so developers can easily balance speed, cost, and cognitive depth.
We built Step 3.7 Flash for developers who need to scale agentic workflows that combine perception, search, and reasoning. It is designed to handle intensive tasks such as parsing massive financial reports in one pass, running multi-step search loops with cross-source verification, or operating concurrent coding agents in high-throughput pipelines.
2. Capabilities & Performance
Multimodal Perception and Verification
The model delivers top-tier visual intelligence, securing first place on SimpleVQA (Search) with a 79.2 and achieving frontier parity on V* (Python) at 95.3. These metrics reflect strong visual grounding and retrieval-augmented reasoning beyond basic image description. The model accurately processes dense visual interfaces, such as UI wireframes, application GUIs, and data charts, to map them into structured code. When it encounters an incomplete visual asset, it can independently identify missing data and execute lookups to verify context before returning a factually verified conclusion.
Workflow Integrity and Tool Orchestration
Execution reliability is critical for autonomous agents. Step 3.7 Flash leads the ClawEval-1.1 benchmark with a score of 67.1, which significantly outperforms the next closest competitor at 59.8. This performance demonstrates high resistance to adversarial traps and strict adherence to system policies during multi-turn orchestration. Backed by scores of 49.5 on Toolathlon and 48.1 on HLE w. Tool, this profile ensures high trajectory integrity. Step 3.7 Flash reliably interacts with external APIs and executes long-horizon workflows without drifting from instructions or violating system constraints.
Code Engineering and Professional Baselines
Step 3.7 Flash is built for live engineering tasks and secured a definitive second-place finish on SWE-Bench PRO with a score of 56.3. It can independently trace multi-file repositories, isolate bugs from raw issue reports, and generate functional patches that pass automated unit tests. While evaluations like Terminal-Bench 2.1 (59.5) and GDPVal-AA (45.8) show clear areas for future optimization compared to the absolute peak of the cohort, they establish a dependable baseline for system interactions and structured professional deliverables.
How to Use
These GGUF files are fully compatible with llama.cpp and popular graphical interfaces like LM Studio.
using llama.cpp CLI:
./llama-cli -m /path/to/model/Step-3.7-Flash-IQ4_XS.gguf \
-p "Hello, how are you?" \
-sys "You are a helpful AI" \
-n 4096 \
-c 8192
using llama-server :
./llama-cli -m /path/to/model/Step-3.7-Flash-IQ4_XS.gguf \
--host 0.0.0.0 \
--port 8080
- Downloads last month
- 82
3-bit
4-bit
Model tree for morikomorizz/Step-3.7-Flash-MTP-GGUF
Base model
stepfun-ai/Step-3.7-Flash