AD_Motion_LORAs / README.md
Cseti's picture
Update README.md
1ca3352 verified
|
raw
history blame
3.7 kB
metadata
tags:
  - stable diffusion
  - animatediff
  - motion lora
language:
  - en

Animatediff V3 motion LORAs

File summary

Name Compatible Motion Model Resolution (w/h) Frames Comments
250_cseti_Drone-Rotating_3D_footage_fr16 v3 384x384 (1:1) 16 Drone 3d rotation
400_cseti_9222750_drone-rot_w576_h384_fr32_r64 v3 576x384 (3:2) 32 Drone 3d rotation
200_3723723_cseti_ballerina-spin_w512_h768_r64 v3 512x768 (2:3) 16 Ballerina spin
250_3723723_cseti_ballerina-spin_w512_h768_r64 v3 512x768 (2:3) 16 Ballerina spin
400_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 v3 576x384 (3:2) 32 Walking back view
450_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 v3 576x384 (3:2) 32 Walking back view

General recommendations

  • These are finetuned on v3 model. Does not work with v2 or animateLCM motion models
  • Animatediff v3 adapter lora is recommended
  • If you want more motion try incrasing the scale multival (e.g. to 1.2)
  • I recommend using the above resolutions and upscale the animation or keep at least the aspect ratios

Drone LORAs

  • For more motion, try incrasing the LORA strength or try adding the below trigger words to your prompt
  • Try trigger words: dronearound, flying around

Ballerina spin LORAs

  • Sometimes a white veil / skirt appears during rotation. Unfortunately, this is from the original video. In such cases, try a new generation or reduce the LORA strength.
  • I recommend using LORA strength of 0.8-0.9

Walking back-view LORAs

  • I recommend using LORA strength of 0.8-0.9
  • Recommended prompts:
    • "back view"
    • "drone shot" - for an upper view

Animatediff V2 motion LORAs

File summary

Name Compatible Motion Model Resolution (w/h) Frames Comments
280_cseti_2906282_drone-orbitright-mv2_r64_w576_h384_fr16.safetensors all v2, animateLCM 576x384 (3:2) 16 Drone 3d rotation
400_cseti_9222750_drone-rot_w576_h384_fr32_r64 all v2, animateLCM 576x384 (3:2) 16 Drone 3d rotation

General recommendation

  • These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
  • Animatediff v3 adapter lora is recommended regardless they are v2 models
  • If you want more motion try incrasing the scale multival (e.g. to 1.2)
  • I recommend using the above resolutions and upscale the animation or keep at least the aspect ratios

Drone orbit right