geolip-aleph-diffusion

Testable aleph adapters for the geolip diffusion variants — the certified components of the geolip-aleph-qwen text line (frozen-trunk relay adapters with closed-form aleph addressing, zero-init out weight+bias, near-zero gates, bit-exact toggle contract) ported to diffusion trunks. Runner-2 line of the geolip program.

Substrates

variant trunk trainer path
SD1.5 core (epred) — primary stable-diffusion-v1-5/stable-diffusion-v1-5, epsilon objective, natural 77-token prompting custom beds (this repo, substrate/)
SDXL core (epred) — primary stabilityai/stable-diffusion-xl-base-1.0 after SD1.5-core certifies; plus the geolip-sdxl-aleph read-only capacity battery
SD15-Lune rectified flow (undertrained exemplar; cheap flow testbed) AbstractPhil/sd15-flow-lune-json-prompt ckpt-2500 (+ base lune, json-vit) custom beds (this repo, substrate/)
Anima / Cosmos-Predict2 2B DiT circlestone-labs/Anima (NC weights — all derived checkpoints NC) AbstractEyes/diffusion-pipe branch feat/aleph-adapter
Krea 2 Turbo — expansion krea/Krea-2-Turbo (distilled from krea/Krea-2-Raw, the trainable base; Krea license — check before derived ships) fork krea2 path; roster entry, beds TBD

Prompting congruency: judged work carries BOTH the json-225 chunked encoding and standard 77-token plain-English prompting (congruency to the natural paradigm).

Sampler of record (Lune family): rectified flow, v = noise − x0, Euler on the SHIFT=2.5-warped sigma grid σ = 2.5u/(1+1.5u), VAE_SCALE 0.18215. Text conditioning is the trainer's 225-token 3-chunk CLIP encoding (encode_clip_225, 227 positions) — never a bare 77-token encode.

Standing rules of the line

  • Adapter dtype matches the trunk dtype (fp32 adapters on a low-precision trunk inject fp32 noise; judged gauges still run fp32).
  • Pure Adam, weight-decay 0 on adapter paths — never AdamW.
  • No comparative selectors (argmax/softmax routing/VQ) anywhere near the aleph; the addresser is the closed-form sinh/cosh read.
  • All-adapters-off ≡ frozen trunk bit-exact (code-path-skip toggles), gated before and after every training run.
  • Every result reads against the exp000 zero-shot baseline wall below; paired designs with derangement (no-fixed-point) controls; judges self-test on known answers before scoring; 1-seed results ship as candidates.

Baseline wall (exp000)

CLIP-L image↔image cosine, original vs regenerated from the row's own json_prompt (vit_json_prompt for json-vit), conditional vs shuffled-JSON (derangement), n=24 held-out rows of synthetic-object-relations-json, paired seeds, 30 steps, guidance 6.0, fp32 judge features:

model cond shuffled cond − shuffled
json_vit (latest ckpt) 0.8072 0.5568 +0.2504
json_ckpt2500 0.7536 0.5437 +0.2099
base_lune (18765) 0.6347 0.5272 +0.1075

Reading: the json-prompt finetunes carry 2× the base UNet's scene information from structured-JSON conditioning. Caveats: n=24, single seed bank; CLIP-L image-image cosine has a high floor (0.988 for pure-noise pairs on identical resolution) so gaps live in a narrow band — the paired design is load-bearing.

Experiments

exp question status
exp000_baselines zero-shot baseline wall (above) shipped
exp000b_natural natural-paradigm wall: format specialization is a double dissociation; SDXL core tops the NL wall shipped (candidate, s0)
exp001_sd15_relay relay-all16 vs matched LoRA-r32 vs frozen: relay beats both; LoRA lands below frozen; post-train toggle bit-exact shipped (candidate, s0)
exp002_sd15_addrcond addr-cond 4-arm causal: GUIDEPOST with a pulse — inert beside full text (real≈deranged), but the address ALONE steers (+0.029); redesign = complementarity shipped (candidate, s0)
exp003_sigma_registers register probe: sigma is the ONLY live axis — caption/type/cond all compress to ≤0; ordering prereg MISS with design consequences shipped (candidate, s0)
exp004_anima_relay relays on the 2B DiT via diffusion-pipe (bf16 per dtype law) staged
exp005_sdxl_tree4a the SDXL capacity battery (guidepost/scaffold/skeleton) designed
exp013_blob_flow CONDITIONING HYPOTHESIS CONFIRMED: same blob coupling, ~200x the eps effect on the flow substrate (−5.9% vs +0.03%); blob supervision belongs on flow/v-pred trunks shipped (candidate, s0; s1 running)
exp011a_fused_multiband multiband on REAL fused data: adapters pay 2-3x more; structural story replicates (3/3 surgical, monolith edge persists); blob targets built 100% after a schema lesson shipped (candidate, s0; s1 running)
exp010_controller StepGatedSampler ships: controller lifts grounding +0.089 over frozen; monotonic lesion ladder; HIGH lesion 14x LP-dominant (coarse-to-fine confirmed in image space); eps-trained HIGH band concentrates (diversity = open training goal) shipped (candidate)
exp009_bandroles role objectives: directional hit 4/4 but noise-adjacent — frequency reweighting too collinear; needs qualitatively different supervision + generation-side gauges (exp010) shipped (2 seeds + rejudge)
exp008_multiband band-ASSIGNED experts: mechanism certifies — 3/3 surgical band lesions (50-200x), HIGH-noise band expert wins its band (label-corrected); uniform objective doesn't pay (roles enter exp009) shipped (candidate, s0; s1 running)
exp006_sd15core_relay CORE EPRED certification: relay beats frozen (−2.5%) and matched LoRA 2-for-2; grounding gained (+0.036) where LoRA traded it; gates GROW on the core shipped (candidate, s0)
exp007_amoe_lora AMoE v1 vs monolith falsifier: falsifier fires — uniform pressure ⇒ flat usage, dispatch pays nothing (Tree-1b law on diffusion); machinery green; next = structural band assignment shipped (candidate, s0)

Code for each experiment ships in its folder with results.json from the run ledger. Substrate modules in substrate/.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support