Instructions to use ali-vilab/i2vgen-xl with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use ali-vilab/i2vgen-xl with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("ali-vilab/i2vgen-xl", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -29,6 +29,7 @@ VGen can produce high-quality videos from the input text, images, desired motion
|
|
| 29 |
|
| 30 |
|
| 31 |
## 🔥News!!!
|
|
|
|
| 32 |
- __[2023.12]__ We release the high-efficiency video generation method [VideoLCM](https://arxiv.org/abs/2312.09109)
|
| 33 |
- __[2023.12]__ We release the code and model of I2VGen-XL and the ModelScope T2V
|
| 34 |
- __[2023.12]__ We release the T2V method [HiGen](https://higen-t2v.github.io) and customizing T2V method [DreamVideo](https://dreamvideo-t2v.github.io).
|
|
@@ -250,7 +251,7 @@ from diffusers.utils import load_image, export_to_gif
|
|
| 250 |
repo_id = "ali-vilab/i2vgen-xl"
|
| 251 |
pipeline = I2VGenXLPipeline.from_pretrained(repo_id, torch_dtype=torch.float16, variant="fp16").to("cuda")
|
| 252 |
|
| 253 |
-
image_url = "https://
|
| 254 |
image = load_image(image_url).convert("RGB")
|
| 255 |
prompt = "Papers were floating in the air on a table in the library"
|
| 256 |
|
|
|
|
| 29 |
|
| 30 |
|
| 31 |
## 🔥News!!!
|
| 32 |
+
- __[2024.02]__ [I2VGen-XL](doc/i2vgen-xl.md) is now supported in 🧨 diffusers
|
| 33 |
- __[2023.12]__ We release the high-efficiency video generation method [VideoLCM](https://arxiv.org/abs/2312.09109)
|
| 34 |
- __[2023.12]__ We release the code and model of I2VGen-XL and the ModelScope T2V
|
| 35 |
- __[2023.12]__ We release the T2V method [HiGen](https://higen-t2v.github.io) and customizing T2V method [DreamVideo](https://dreamvideo-t2v.github.io).
|
|
|
|
| 251 |
repo_id = "ali-vilab/i2vgen-xl"
|
| 252 |
pipeline = I2VGenXLPipeline.from_pretrained(repo_id, torch_dtype=torch.float16, variant="fp16").to("cuda")
|
| 253 |
|
| 254 |
+
image_url = "https://huggingface.co/datasets/diffusers/docs-images/resolve/main/i2vgen_xl_images/img_0009.png"
|
| 255 |
image = load_image(image_url).convert("RGB")
|
| 256 |
prompt = "Papers were floating in the air on a table in the library"
|
| 257 |
|