comfyui

Approximating VAE? (Or video preview in general)

#20
by inflatebot - opened

I don't assume there'll be an approximating VAE checkpoint out for it already, but does anybody know of somebody working on one? Or any other way to get video preview with motion? That kinda thing is really nice for iterating on prompts. Cheers in advance, and thanks for getting this in day 1, it really is something special ❀️

The tae model, node, etc. all need to be made up. The best you can do for the time being is use the latent2rgb preview for your sampler node.

The tae model, node, etc. all need to be made up. The best you can do for the time being is use the latent2rgb preview for your sampler node.

Understandable have a nice day πŸ₯³

I might have something that could help.

I'm the developer of Slimy CueTimer, a custom ComfyUI node that enhances the KSampler preview.

One feature is that it lets you monitor the KSampler preview from the top-level workflow, even when the KSampler is running inside nested subgraphs.

Another feature is a looping animation of the latest 8 preview frames, which makes it easy to inspect motion while sampling instead of looking at only a single preview frame.

It doesn't replace a proper TAE or VAE approximation, but if your workflow already provides sampler previews (such as latent2rgb), it can make prompt iteration much easier.

https://github.com/Slimy-Comfy/Slimy_CueTimer

I dont understand, using custom advanced samplers i get a in sample preview...

I dont understand, using custom advanced samplers i get a in sample preview...

I see a preview, but it's only the first frame, it doesn't show any motion like LTX2.3 does. That may just be because the workflow I was using had a feature for it? But ideally I want something like that.

I might have something that could help.

I'm the developer of Slimy CueTimer, a custom ComfyUI node that enhances the KSampler preview.

One feature is that it lets you monitor the KSampler preview from the top-level workflow, even when the KSampler is running inside nested subgraphs.

Another feature is a looping animation of the latest 8 preview frames, which makes it easy to inspect motion while sampling instead of looking at only a single preview frame.

It doesn't replace a proper TAE or VAE approximation, but if your workflow already provides sampler previews (such as latent2rgb), it can make prompt iteration much easier.

https://github.com/Slimy-Comfy/Slimy_CueTimer

I'll look into that thank you!! If nothing else, the preview-in-top-level feature is something I could also use.

I might have something that could help.

I'm the developer of Slimy CueTimer, a custom ComfyUI node that enhances the KSampler preview.

One feature is that it lets you monitor the KSampler preview from the top-level workflow, even when the KSampler is running inside nested subgraphs.

Another feature is a looping animation of the latest 8 preview frames, which makes it easy to inspect motion while sampling instead of looking at only a single preview frame.

It doesn't replace a proper TAE or VAE approximation, but if your workflow already provides sampler previews (such as latent2rgb), it can make prompt iteration much easier.

https://github.com/Slimy-Comfy/Slimy_CueTimer

Oh yeah this'll do just fine until a proper TAE/aVAE comes out, thank you!

Again, i get a video animated preview with the custom advanced samplers with no additional nodes to provide it.

Again, i get a video animated preview with the custom advanced samplers with no additional nodes to provide it.

Well I didn't so IDK what you want me to say here? I was on the latest nightly when I opened the thread

Sign up or log in to comment