Lattice Mistral 7B Private

Privacy Tier: wrapped | Parameters: 7.3B | Context: 32,768 tokens | VRAM: ~14GB

Mistral 7B Instruct v0.3 with Lattice privacy layer. Excellent instruction following with zero data leakage. Apache 2.0 licensed β€” fully permissive for commercial use.

Privacy Guarantees

Feature Status
Sandboxed inference (no network egress) βœ… Yes
PII output guardrails (email, SSN, CC, etc.) βœ… Yes
Encrypted inference logs βœ… Yes
Zero telemetry βœ… Yes
Differential privacy (DP-SGD) ❌ Wrapped only

Quick Start

pip install ltce
ltce pull lattice-ai/mistral-7b-private
ltce serve lattice-ai/mistral-7b-private --port 8080 --sandbox
from ltce import Lattice

lt = Lattice()
lt.serve("lattice-ai/mistral-7b-private", port=8080, sandbox=True)

The model serves an OpenAI-compatible API at http://localhost:8080/v1/chat/completions.

What Does "Wrapped" Mean?

This model uses the original mistralai/Mistral-7B-Instruct-v0.3 weights β€” no additional training has been done.

What Lattice adds is the privacy serve layer:

  • πŸ”’ Sandbox mode β€” all outbound network connections are blocked during inference
  • πŸ›‘οΈ PII guardrails β€” model output is scanned for emails, phone numbers, SSNs, credit card numbers, API keys
  • πŸ“ Encrypted logs β€” inference logs are AES-256-GCM encrypted at rest
  • 🚫 Zero telemetry β€” HuggingFace telemetry, W&B, MLflow all disabled

For models with mathematical privacy guarantees (DP-SGD training), see our hardened tier models.

Capabilities

general, instruct

Base Model

mistralai/Mistral-7B-Instruct-v0.3

License

Apache 2.0


Built with Lattice β€” privacy-first local AI.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for lattice-ai/mistral-7b-private

Finetuned
(484)
this model