File size: 3,702 Bytes
72f4497 57ab61c 7912fa9 72f4497 fd88134 52e9ccd 608c1f6 245bedb 52e9ccd e18191b 52e9ccd 138b22a bb23e7e 4bd3244 ceb64e4 52e9ccd 1e29f81 240feb6 52e9ccd 240feb6 185bb55 52e9ccd 766bc82 52e9ccd 1ca3352 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 |
---
tags:
- stable diffusion
- animatediff
- motion lora
language:
- en
---
- [Animatediff V3 motion LORAs](#animatediff-v3-motion-loras)
- [File summary](#file-summary)
- [General recommendations](#general-recommendations)
- [Drone LORAs](#drone-loras)
- [Ballerina spin LORAs](#ballerina-spin-loras)
- [Walking back-view LORAs](#walking-back-view-loras)
- [Animatediff V2 motion LORAs](#animatediff-v2-motion-loras)
- [File summary](#file-summary-1)
- [General recommendation](#general-recommendation)
- [Drone orbit right](#drone-orbit-right)
# Animatediff V3 motion LORAs
## File summary
| Name | Compatible Motion Model | Resolution (w/h) | Frames | Comments |
| ---------------------------------------------------- | ----------------------- | ---------------- | ------ | ----------------- |
| 250_cseti_Drone-Rotating_3D_footage_fr16 | v3 | 384x384 (1:1) | 16 | Drone 3d rotation |
| 400_cseti_9222750_drone-rot_w576_h384_fr32_r64 | v3 | 576x384 (3:2) | 32 | Drone 3d rotation |
| 200_3723723_cseti_ballerina-spin_w512_h768_r64 | v3 | 512x768 (2:3) | 16 | Ballerina spin |
| 250_3723723_cseti_ballerina-spin_w512_h768_r64 | v3 | 512x768 (2:3) | 16 | Ballerina spin |
| 400_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 | v3 | 576x384 (3:2) | 32 | Walking back view |
| 450_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 | v3 | 576x384 (3:2) | 32 | Walking back view |
## <b>General recommendations</b>
- These are finetuned on v3 model. Does not work with v2 or animateLCM motion models
- Animatediff v3 adapter lora is recommended
- If you want more motion try incrasing the scale multival (e.g. to 1.2)
- I recommend using the above resolutions and upscale the animation or keep at least the aspect ratios
## <b>Drone LORAs</b>
- For more motion, try incrasing the LORA strength or try adding the below trigger words to your prompt
- Try trigger words: dronearound, flying around
## <b>Ballerina spin LORAs</b>
- Sometimes a white veil / skirt appears during rotation. Unfortunately, this is from the original video. In such cases, try a new generation or reduce the LORA strength.
- I recommend using LORA strength of 0.8-0.9
## <b>Walking back-view LORAs</b>
- I recommend using LORA strength of 0.8-0.9
- Recommended prompts:
- "back view"
- "drone shot" - for an upper view
# Animatediff V2 motion LORAs
## File summary
| Name | Compatible Motion Model | Resolution (w/h) | Frames | Comments |
| --------------------------------------------------------------------- | ----------------------- | ---------------- | ------ | ----------------- |
| 280_cseti_2906282_drone-orbitright-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone 3d rotation |
| 400_cseti_9222750_drone-rot_w576_h384_fr32_r64 | all v2, animateLCM | 576x384 (3:2) | 16 | Drone 3d rotation |
## General recommendation
- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
- Animatediff v3 adapter lora is recommended regardless they are v2 models
- If you want more motion try incrasing the scale multival (e.g. to 1.2)
- I recommend using the above resolutions and upscale the animation or keep at least the aspect ratios
## Drone orbit right
<video controls src="nolora-candidate_00001.mp4" title="Orbit right"></video> |