Meridian-1-analyst-lora-GGUF

GGUF LoRA adapter for the analyst persona on Meridian-1 (proprietary webAI host model; weights are not publicly distributed). This repo contains only the adapter. The PEFT build is at webAI-Official/Meridian-1-analyst-lora-peft.

File Format Size
Meridian-1-analyst-lora-f16.gguf LoRA adapter, f16 ~130 MB

System prompt

Send this exact system prompt with every request. It is the prompt every training example for this adapter used; without it the adapter is outside its training distribution.

You are Analyst. Performs structured and quantitative work over provided data. Returns artifacts, not prose about them.
Respond with a single JSON object.

The line break before Respond with a single JSON object. is part of the prompt.

  • Thinking: On (enable_thinking: true), as trained.
  • Output: one JSON object. Required fields: persona, objective, method, artifacts, with persona set to "analyst". Optional: inputs_used, assumptions, unavailable, handoff.
  • Generation budget: up to 8,192 new tokens, the budget used for this persona.

Usage (llama.cpp)

Authorized personnel only. This adapter loads on an internal Meridian-1 GGUF; host weights are not published on Hugging Face.

hf download webAI-Official/Meridian-1-analyst-lora-GGUF Meridian-1-analyst-lora-f16.gguf --local-dir .
llama-server -m "$MERIDIAN_1_GGUF" --lora Meridian-1-analyst-lora-f16.gguf --jinja

Send the system prompt above with each request. Use --lora-scaled Meridian-1-analyst-lora-f16.gguf <scale> to change adapter strength. Authorized Meridian-1 deployments use temperature 1.0, top-p 0.95, top-k 64 (the evaluation setting).

Adapter details

  • Type: LoRA, rank 16 (set --max-lora-rank 16 when serving)
  • Trained for this persona’s system prompt and JSON output contract
  • Training data, hyperparameters, teacher mix, and intermediate metrics are internal and omitted here

Evaluation on Meridian-1

Persona contract suite: 720 held-out cases, adapter vs Meridian-1 given the same role prompt (both sampled at temperature 1.0, top-p 0.95, top-k 64). Scores are percentages.

Metric Adapter Meridian-1 (role-prompted) Gain (pts)
Overall contract pass rate 78.1 58.1 +20.0
Valid persona output envelope 93.2 71.8 +21.4
In-scope tasks passed 90.6 77.8 +12.8
Correct refusal of out-of-scope requests 55.6 50.0 +5.6
Stays in role under adversarial pressure 78.3 47.2 +31.1
General requests handled in role 87.8 57.2 +30.6
Matches gold answer 92.6 84.8 +7.8

Its own work on held-out items, adapter vs Meridian-1 with the same role prompt (paired bootstrap 95% interval):

Task Adapter Meridian-1 (role-prompted) Gain (pts) 95% interval Items
TAT-QA accuracy 91.0 88.0 +3.0 +0.0 to +6.5 200

Converted from the PEFT adapter with llama.cpp convert_lora_to_gguf.py (commit 5cdadfc).

License

Proprietary to webAI, Inc. All rights reserved.

Downloads last month
443
GGUF
Model size
65M params
Architecture
gemma4
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support