LiquidVamp-R4-1.7B

LiquidVamp-R4-1.7B

By Wamphyre AI.

LiquidVamp-R4-1.7B is an experimental, abliterated-by-lineage language model based on OrcaRouter's LFM3-1.7B-Abliterated. It combines direct neuronal-level weight edits from Wamphyre AI's experimental development with supervised post-training supported by GLM-5.3-Flash as the synthetic-data teacher. Its adaptation focuses on coding, reasoning and tool use.

Abliterated base and model lineage

The upstream base is orcarouter/LFM3-1.7B-abliterated, derived from Liquid AI's LFM3 family. LiquidVamp inherits the abliterated base out of the box. Wamphyre AI's preceding experimental revisions include direct edits to FFN weights at the level of neurons and projection columns.

R4 adds supervised LoRA post-training using GLM-5.3-Flash responses. The adapter has been merged into the released weights. The original LFM3 architecture, vocabulary and conversation template are retained.

High-context local inference

The local deployment is designed for high-context use and configured for a 131,072-token total context window (128K). This window is shared by the prompt, conversation history, optional reasoning and generated output; the configured output budget is 16,384 tokens.

The validated local backend is llama.cpp b12179, using Vulkan/RADV, on Ubuntu with an AMD Radeon RX 6600 8 GB. The deployment supports n-gram speculative decoding through ngram-mod, configured with a 24-token match and 8-16-token draft proposals.

Service initialization at 128K and basic API interaction were verified. The scored evaluation used 8,192 tokens of context, so the results below do not establish answer quality or throughput across a full 128K conversation. The technical specification records the exact runtime settings and verification scope.

Post-training

Item Value
Model family size Approximately 1.7 billion parameters
Teacher GLM-5.3-Flash
Unique teacher exercises 2,163
Training / validation / held-out split 1,362 / 413 / 388
Balanced rows per epoch 1,611
Trainable LoRA parameters 9,999,872
Completed optimization 1 epoch, 101 steps
Training precision and hardware FP32, NVIDIA Tesla T4
Objective Loss on assistant responses and tool calls only
Mean training loss 0.63194
Final validation loss 0.53692

The final training run had finite gradients and verified adapter updates. Merging updated 142 projections; the other 145 GGUF tensors retained their previous values exactly.

Local evaluation

Both LiquidVamp R4 and its modified predecessor R3 completed the same 436-exercise battery under matched inference settings, one model loaded at a time. R3 is an OrcaRouter-derived experimental revision with prior Wamphyre AI modifications; these are R3 measurements, not measurements of the untouched upstream OrcaRouter checkpoint.

Test Modified predecessor R3 LiquidVamp R4
Held-out set 318/388 (81.96%) 357/388 (92.01%)
Held-out Python 9/58 44/58
Held-out reasoning 108/129 112/129
Held-out tools, simulated observations 201/201 201/201
Fresh transfer tasks 14/32 13/32
Entire local battery 343/436 382/436

The paired balance was 56 improvements and 17 regressions. Python gains include improved executable-code formatting: held-out failures containing syntax or indentation errors fell from 45 to 1. This does not establish a purely algorithmic improvement.

Fresh transfer did not improve, and aggregate JavaScript results fell from 3/5 to 1/5. Tool observations in the held-out tests were simulated. Related exercise families limit the independence of the samples. This is a local evaluation, not a standard external benchmark, and the model remains experimental.

The untouched OrcaRouter base has not been evaluated on this battery. No scores or percentage gains against it are estimated. A numeric-punctuation scoring issue was corrected and the same corrected checks were reapplied to both models' saved answers without generation retries. The machine-readable record is training_summary.json.

Release formats

  • Full merged Safetensors checkpoint, including configuration, tokenizer and architecture source files. It supports inference and further training under the LiquidVamp identity.
  • BF16 GGUF, with inherited F32 tensors preserved, for compatible local inference runtimes.

The LoRA update is already merged. Loading the complete checkpoint requires no additional adapter or original R3 checkpoint. Transformers loading uses the included architecture code through trust_remote_code=True.

SHA256SUMS contains the release file hashes.

Attribution and license

Wamphyre AI: experimental neuronal edits, adaptation and post-training. OrcaRouter: abliterated upstream base. Liquid AI: original LFM3 family. GLM-5.3-Flash: synthetic-data teacher.

The inherited LFM Open License v1.0 is included in LICENSE. Original notices and modification details are retained in NOTICE.txt.

Downloads last month
-
Safetensors
Model size
2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for WamphyreAI/LiquidVamp-R4-1.7B

Finetuned
(2)
this model