INR-DiT Video

A from-scratch generative video pipeline that diffuses a neural representation, not pixels.

generated faces from pure noise

Faces generated from pure noise โ€” only a grid of neural-network codes was diffused.

Pipeline: noise โ†’ DiT (generates a latent grid) โ†’ INR decoder (renders patches) โ†’ video

1,000 steps 6,000 steps 12,000 steps

Structure emerging over training.

file what it is
bet2_grid.pt shared INR decoder + 337 latent grids (8ร—8ร—8 ร— 32-dim)
dit_012000.pt diffusion transformer over the grid cells

Code & full write-up: https://github.com/BOB-THE-BUILDER-in/inr-dit-video Trained on HDTF (not redistributed): https://github.com/MRzzm/HDTF

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support