thox-cluster-deep

THOX configuration of Llama-3.1-405B-Instruct — a THOX configuration and distribution of Llama 3.1 405B for local research-scale inference and MeshStack deployments: the largest open-weight model in the family, for research-grade analysis a

Live on Ollama

Run it: [Ollama — Thox-ai/thox-cluster-deep](https://ollama.com/Thox-ai/thox-cluster-deep) · Find your model: THOX Model Factory · Collection: MeshStack & MeshMind Models

Your AI. Your Data. Your Rules.™

Status: MODEL CARD PAGE — RUNNABLE BUILD ON OLLAMA. This Hugging Face repository is the model's public model card page and THOX packaging record; the runnable build is served from Ollama (see Run it / How to Use). THOX did not train these weights; THOX's work is the configuration, clustering layer, and documentation.

Summary

A THOX configuration and distribution of Llama 3.1 405B for local research-scale inference and MeshStack deployments: the largest open-weight model in the family, for research-grade analysis and synthesis. Configuration-derived: THOX did not train these weights.

Correction notice. This card previously carried catalog copy quoting grant-success, publication-rate, cost-saving, and concurrency figures for multi-device research deployment; those were inherited catalog copy with no THOX deployment evidence behind them and have been removed. No benchmark, throughput, latency, concurrency, uptime, cost-saving, or compliance figure is claimed for this release. Earlier versions of this card also stated the license as MIT; that was incorrect and has been corrected (see License Terms).

Model ID: Thox-ai/thox-cluster-deep Base model: Llama 3.1 405B by Meta Runnable build: Ollama - ollama run Thox-ai/thox-cluster-deep License: Llama 3.1 Community License Agreement (see License Terms)

Highlights

• A THOX configuration and distribution of Llama 3.1 405B for local research-scale inference and MeshStack deployments: the largest open-weight model in the family, for research-grade analysis and synthesis.

Files

File	Size	Purpose
.gitattributes	1,519 B	Repository file

MeshStack Origin

This model was designed for MeshStack, THOX's device-to-device clustering technology, built for the flagship ThoxNova devices. ThoxNova hardware was designed to magnetically connect and interact, using custom-developed magnetic pogo pins (MagStack) to distribute models and share compute, memory, and workload from device to device. One device is a computer; a stack of them is a cluster.

That physical stack is the foundation of the MeshStack app and the patent-pending over-air mesh technology THOX ships today, which performs the same device-to-device distribution and resource sharing without a physical connection. MeshStack is included in the THOX Kickstarter campaign (thox.ai).

What THOX Did and Did Not Do

These are THOX-configured model distributions, and the THOX work lives in the MeshStack clustering layer, configuration, documentation, and the origin program, never in the weights. The weight layers in this model's Ollama distribution are byte-identical to the upstream provider's Ollama distribution (SHA-256 verified in the 2026-10-31 release review), and the weights remain governed by the upstream license terms recorded on this card. What THOX built is the layer around them: the MagStack and MeshStack clustering design these configurations were made for, the runtime configuration, and this documentation.

Specifications

Specification	Details
Base model	Llama 3.1 405B (Meta)
Parameters	405B
Size	243 GB (Ollama listing)
Deployment	Local inference via Ollama; distributed orchestration via MeshStack (separate from this download)
Context window	128K tokens
Quantization	Q4_K_M (GGUF)

Intended Use

• University and laboratory literature review, meta-analysis, and hypothesis work
• Consulting, finance, legal, and policy research on private data
• Long-horizon strategic analysis under complete local control

How to Use

ollama pull Thox-ai/thox-cluster-deep
ollama run Thox-ai/thox-cluster-deep

This Hugging Face repository is the model's public model card page. The runnable build is served from Ollama at https://ollama.com/Thox-ai/thox-cluster-deep - the original card this page is based on lives there in full.

Platforms

Platform / device	Run path
Ollama (laptop / desktop)	`ollama run Thox-ai/thox-cluster-deep``
Hugging Face	Download the builds listed under Files from this repo (see Run it)

Training Data and Procedure

This is a THOX distribution of the base model named above, packaged and documented by THOX.ai for local and MeshStack/MagStack deployment. The original THOX release materials for this model claim no separate THOX fine-tuning run, training dataset, or training procedure, and none is claimed here. Base-model training data and procedure are those of the base model's provider; see the base model card for that record.

Datasets added by THOX for this release: none.

Evaluation

Benchmark and performance figures quoted in this card were reported by Meta for the base model and are reproduced from the model's original Ollama model card (catalog-reported at original publication). They were not re-run for this Hugging Face publication.

Independent THOX evaluation of this model on this page: pending. This section will be updated with method and results when a THOX-run evaluation lands; until then, treat quoted figures as the original catalog's claims, not as independently verified measurements.

Catalog notes for this model: No benchmark scores were published on the original card beyond the base model's published characteristics (405B parameters, 15T+ training tokens, per Meta's base model record).

Limitations

• Largest model in the family: 243 GB of model data; local deployment only in this distribution, and behavior and speed depend entirely on the operator's hardware and configuration

• Base model weights are governed by the Llama 3.1 Community License, not MIT (see License Terms)

• Research outputs require expert review; the model supports, and does not replace, researcher judgment

• All processing is local by design; the model has no access to online information or external services unless the operator wires them in.

• Outputs can be wrong. Professional, medical, legal, financial, and security-relevant outputs require qualified human review.

Hardware Reference (from the original card)

Per device: minimum 96 GB RAM, 100 GB storage, NVIDIA Jetson Orin AGX (64GB VRAM), 10 Gbps network. Recommended 128 GB RAM, 150 GB NVMe SSD.

License Terms

The model weights are distributed under the Llama 3.1 Community License Agreement (Meta, release date July 23, 2024), per the license layer in this model's Ollama manifest (from the upstream llama3.1:405b distribution). Use and redistribution are governed by the Llama 3.1 terms, including their acceptable-use conditions. Earlier versions of this card stated MIT; that was incorrect and has been corrected. THOX claims no license over the weights beyond the upstream terms. MagStack and MeshStack technology is proprietary to Thox.ai LLC; publication of this model card does not license THOX mesh technology, patents, or trademarks beyond the THOX name used to identify the model.

Provenance

• First listed on Ollama under Thox-ai in 2025 and held private.
• Publicly released 2026-10-31 by order of Tommy Xaypanya, CTO and Co-Founder of THOX.ai, as part of the MeshStack model family release.
• Runnable build: Ollama, ollama run Thox-ai/thox-cluster-deep and https://ollama.com/Thox-ai/thox-cluster-deep
• This Hugging Face repository was created 2026-10-31 as the model's public model card page. It contains this card; the runnable model build is served from Ollama.
• Announcement: the MeshStack model family public release announcement (thox.ai).

Citation

@software{thoxai_thox_cluster_deep_2025,
  title = {Thox.ai Cluster Deep - Maximum Reasoning MagStack Distributed AI},
  author = {Thox.ai LLC},
  year = {2025},
  url = {https://huggingface.co/Thox-ai/thox-cluster-deep},
  note = {Runnable build: https://ollama.com/Thox-ai/thox-cluster-deep}
}

Thox.ai LLC - Frontier AI. Complete Privacy. Your Infrastructure. Your AI. Your Data. Your Rules.™