mochi-lora-vhs / README.md
lucataco's picture
Update README.md
aaf44ad verified
|
raw
history blame
1.38 kB
metadata
base_model: mochi-1-preview
library_name: diffusers
license: apache-2.0
instance_prompt: >-
  a parrot flying in the blue skies, a grainy or noisy video effect in the
  background
widget:
  - text: >-
      a parrot flying in the blue skies, a grainy or noisy video effect in the
      background
    output:
      url: replicate-parrot-vhs.mp4
tags:
  - text-to-video
  - diffusers-training
  - diffusers
  - lora
  - replicate
  - mochi-1-preview

Mochi-1 Preview LoRA Finetune

This is a LoRA fine-tune of the Mochi-1 preview model. The model was trained using custom training data.

Prompt
a parrot flying in the blue skies, a grainy or noisy video effect in the background

Usage

from diffusers import MochiPipeline
from diffusers.utils import export_to_video
import torch

pipe = MochiPipeline.from_pretrained("genmo/mochi-1-preview")
pipe.load_lora_weights("lucataco/mochi-lora-vhs")
pipe.enable_model_cpu_offload()

video = pipe(
    prompt="your prompt here",
    guidance_scale=6.0,
    num_inference_steps=64,
    height=480,
    width=848,
    max_sequence_length=256,
).frames[0]

export_to_video(video, "output.mp4", fps=30)

Training details

Trained on Replicate using: lucataco/mochi-1-lora-trainer