Spaces:
Runtime error
Runtime error
formatting
Browse files
app.py
CHANGED
@@ -126,8 +126,8 @@ with gr.Blocks(title = 'Make-A-Video Stable Diffusion JAX', analytics_enabled =
|
|
126 |
We take advantage of the extra 5 input channels of the inpaint model to guide the video generation with a hint image and mask.
|
127 |
The hint image can be given by the users, otherwise it is generated by an generative image model.
|
128 |
|
129 |
-
The temporal convolution and attention is a port of [Make-A-Video Pytorch](https://github.com/lucidrains/make-a-video-pytorch/blob/main/make_a_video_pytorch)
|
130 |
-
|
131 |
Temporal attention is purely self attention and also separately attends to time and space.
|
132 |
|
133 |
Only the new temporal layers have been fine tuned on a dataset of videos themed around dance.
|
|
|
126 |
We take advantage of the extra 5 input channels of the inpaint model to guide the video generation with a hint image and mask.
|
127 |
The hint image can be given by the users, otherwise it is generated by an generative image model.
|
128 |
|
129 |
+
The temporal convolution and attention is a port of [Make-A-Video Pytorch](https://github.com/lucidrains/make-a-video-pytorch/blob/main/make_a_video_pytorch) to FLAX.
|
130 |
+
It is a pseudo 3D convolution that seperately convolves accross the spatial dimension in 2D and over the temporal dimension in 1D.
|
131 |
Temporal attention is purely self attention and also separately attends to time and space.
|
132 |
|
133 |
Only the new temporal layers have been fine tuned on a dataset of videos themed around dance.
|