Instructions to use Eyght/eyght-v20 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Eyght/eyght-v20 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Eyght/eyght-v20")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Eyght/eyght-v20", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Eyght/eyght-v20 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Eyght/eyght-v20" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Eyght/eyght-v20", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Eyght/eyght-v20
- SGLang
How to use Eyght/eyght-v20 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Eyght/eyght-v20" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Eyght/eyght-v20", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Eyght/eyght-v20" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Eyght/eyght-v20", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Eyght/eyght-v20 with Docker Model Runner:
docker model run hf.co/Eyght/eyght-v20
Eyght v20
Eyght v20 is a fine-tune of Qwen/Qwen2.5-7B-Instruct β the next step in the Eyght
lineage. Packaged as a Q4_K_M GGUF (~4.7 GB) for Ollama.
Built, trained, and owned by Eyght. Free Hugging Face model repository.
Model details
| Base model | Qwen/Qwen2.5-7B-Instruct |
| Architecture | Qwen2ForCausalLM (decoder-only) |
| Parameters | ~7.66 B |
| Format | GGUF (Q4_K_M, ~4.7 GB) |
| Runtime | Ollama / llama.cpp |
| License | Apache-2.0 (fine-tune) |
How to use
ollama run eyght-v20
llama-cli -m eyght-v20.Q4_K_M.gguf -p "Explain async/await in Python." -n 256
Training
LoRA SFT on the Eyght corpus, trained locally by Eyght on a single RTX 4070 Ti (12 GB) with Unsloth (4-bit + LoRA).
Intended use & limitations
- Intended: general assistance, coding, reasoning.
- Not intended: real-time facts, professional advice, very long contexts.
- A 7B fine-tune β verify outputs; it can hallucinate.
License & attribution
- Fine-tune: Apache-2.0. Built, trained, and owned by Eyght.
Citation
@misc{eyght_v20,
title = {Eyght v20: an Eyght fine-tune of Qwen2.5-7B-Instruct},
author = {Eyght},
year = {2026},
howpublished = {Hugging Face, https://huggingface.co/Eyght}
}
Built by Eyght with the local Eyght Veta studio.
π§ Project Janus β Dual-Loop Cognitive Architecture
This model is designed to operate within Project Janus, a dual-loop cognitive architecture that goes beyond simple prompt-response:
The Core Cognitive Loop
Perceive β Working Memory β Internal Critic β Action β Consolidation
| Phase | Component | Function |
|---|---|---|
| 1. Perceive | Input mapping | Raw data β dense vector space |
| 2. Working Memory | Dynamic scratchpad | Active goal, hypotheses, constraints |
| 3. Internal Critic | Value function | Evaluates outputs before execution (quality + safety) |
| 4. Action | Response delivery | Approved output delivered to the user |
| 5. Consolidation | Durable memory | Successful strategies stored for future retrieval |
Three-Tier Memory
- Episodic Store β append-only memory of past tasks and successes (retrieval-augmented)
- Procedural Skill Library β reusable reasoning patterns compiled into adapters
- Core Value Axioms β frozen safety rules preventing drift as the agent learns
Self-correction + Memory + Safety
The Internal Critic evaluates every draft response against core value axioms before delivery. This enables self-correction, memory-augmented reasoning (RAG), and continuous learning without catastrophic forgetting.
Built by Eyght. Project Janus β a cognitive architecture, not just a model.