File size: 1,277 Bytes
3d5ddf5 a9bdff6 3d5ddf5 a9bdff6 3d5ddf5 63c1aee 3d5ddf5 170b079 3d5ddf5 170b079 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 |
---
license: openrail++
base_model: stabilityai/stable-diffusion-xl-base-1.0
tags:
- stable-diffusion-xl
- stable-diffusion-xl-diffusers
- text-to-image
- diffusers
- controlnet
inference: true
---
# TemporalNetXL
This is TemporalNet1XL, it is a retrain of the controlnet TemporalNet1 with Stable Diffusion XL.
This does not use the control mechanism of TemporalNet2 as it would require some additional work to adapt the diffusers pipeline to work with a 6 channel input.
In order to run, simply use the script "runtemporalnetxl.py" after installing the normal diffusers requirements and specify the following command line arguments:
--prompt does what it says on the tin
--video_path the path to your input video, this will split the frames out if the frames are not already there, if you want a different resolution or frame rate, you'll want to preprocess them and put them into the ./frames folder
--frames_dir (optional) if you want a different path for the frames input
--output_frames_dir (optional) the output directory
--init_image_path (optional) it is recommended you get the first frame, modify it to a good starting look with stable diffusion, and use that as the first generated frame, if unspecified it will use the first video frame (not reccomened)
|