File size: 4,103 Bytes
72f4497 57ab61c 7912fa9 72f4497 fd88134 52e9ccd 7ec6aa4 355ce0f 608c1f6 245bedb 52e9ccd e18191b 52e9ccd 138b22a bb23e7e 4bd3244 ceb64e4 52e9ccd 1e29f81 240feb6 52e9ccd 240feb6 185bb55 52e9ccd 766bc82 52e9ccd 76eee2e 52e9ccd e8ada34 76eee2e 20f32fb 8e53e19 e8ada34 7caa7c0 e8ada34 8e53e19 e8ada34 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 |
---
tags:
- stable diffusion
- animatediff
- motion lora
language:
- en
---
- [Animatediff V3 motion LORAs](#animatediff-v3-motion-loras)
- [File summary](#file-summary)
- [General recommendations](#general-recommendations)
- [Drone LORAs](#drone-loras)
- [Ballerina spin LORAs](#ballerina-spin-loras)
- [Walking back-view LORAs](#walking-back-view-loras)
- [Animatediff V2 motion LORAs](#animatediff-v2-motion-loras)
- [File summary](#file-summary-1)
- [General recommendation](#general-recommendation)
- [v2 Drone orbit right example](#v2-drone-orbit-right-example)
- [v2 Drone orbit left example](#v2-drone-orbit-left-example)
# Animatediff V3 motion LORAs
## File summary
| Name | Compatible Motion Model | Resolution (w/h) | Frames | Comments |
| ---------------------------------------------------- | ----------------------- | ---------------- | ------ | ----------------- |
| 250_cseti_Drone-Rotating_3D_footage_fr16 | v3 | 384x384 (1:1) | 16 | Drone 3d rotation |
| 400_cseti_9222750_drone-rot_w576_h384_fr32_r64 | v3 | 576x384 (3:2) | 32 | Drone 3d rotation |
| 200_3723723_cseti_ballerina-spin_w512_h768_r64 | v3 | 512x768 (2:3) | 16 | Ballerina spin |
| 250_3723723_cseti_ballerina-spin_w512_h768_r64 | v3 | 512x768 (2:3) | 16 | Ballerina spin |
| 400_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 | v3 | 576x384 (3:2) | 32 | Walking back view |
| 450_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 | v3 | 576x384 (3:2) | 32 | Walking back view |
## <b>General recommendations</b>
- These are finetuned on v3 model. Does not work with v2 or animateLCM motion models
- Animatediff v3 adapter lora is recommended
- If you want more motion try incrasing the scale multival (e.g. to 1.2)
- I recommend using the above resolutions and upscale the animation or keep at least the aspect ratios
## <b>Drone LORAs</b>
- For more motion, try incrasing the LORA strength or try adding the below trigger words to your prompt
- Try trigger words: dronearound, flying around
## <b>Ballerina spin LORAs</b>
- Sometimes a white veil / skirt appears during rotation. Unfortunately, this is from the original video. In such cases, try a new generation or reduce the LORA strength.
- I recommend using LORA strength of 0.8-0.9
## <b>Walking back-view LORAs</b>
- I recommend using LORA strength of 0.8-0.9
- Recommended prompts:
- "back view"
- "drone shot" - for an upper view
# Animatediff V2 motion LORAs
## File summary
| Name | Compatible Motion Model | Resolution (w/h) | Frames | Comments |
| --------------------------------------------------------------------- | ----------------------- | ---------------- | ------ | ----------------- |
| 280_cseti_2906282_drone-orbitright-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone 3d rotation |
| 280_cseti_6933991_drone-orbitleft-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone 3d rotation |
## General recommendation
- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
- Animatediff v3 adapter lora is recommended regardless they are v2 models
- If you want more motion try incrasing the scale multival (e.g. to 1.2)
- I recommend using the above resolutions and upscale the animation or keep at least the aspect ratios
## v2 Drone orbit right example
This has been made with AnimateLCM.
<video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/nolora-candidate_00001.mp4" title="Orbit right"></video>
## v2 Drone orbit left example
This has been made with AnimateLCM.
<video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/orbitleft-candidate_00004.mp4" title="Orbit left"></video> |