Instructions to use Jojocodex/minimax-h3-spatial-physics-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Inference
- Notebooks
- Google Colab
- Kaggle
空间物理 LoRA · Spatial & Physics LoRA (MiniMax-H3)
空间思维与物理逻辑 LoRA,基于 MiniMax-H3(Comfy-Org/MiniMax-H3)训练,让模型学会纯物体的空间关系与物理运动(碰撞、堆叠、掉落、遮挡等)。
本 LoRA 专注物体物理。
目前还是训练和测试阶段,一些素材片段以及打标问题导致LORA还不是特别稳定。下一阶段准备修复后重新训练。目前LORA也是可以使用,强度建议0.3 ~ 0.5。纯属是在原模型基础上稍微增强一点物理反馈。 最新是重新训练到了wushu_spatial_physics_clean_3000_pruned.safetensors 版本。
视频对比
实测用了这个LORA,视频整体提升真实感物理的逻辑,比如物体碰撞的真实反馈。也可以用于一些打斗场景,人物真实碰撞的效果。
用了空间物理LORA的武打片段(强度 0.3)
没有用空间物理LORA的武打片段(同样提示词)
其他测试视频 (wushu_spatial_physics_v2_3000.safetensors)
使用方法(ComfyUI)
- 下载
*.safetensors,放入 ComfyUImodels/loras/ - LoraLoader 加载,strength 建议 0.8~1.0
- 用空间/物理语言 prompt 描述物体运动
关键词库(从训练数据提炼)
① 主体/场景
several colored objects多个彩色物体(CLEVRER 风格)rigid objects刚体 /elastic objects弹性物体metal objects金属物体a ball/balls球billiard balls台球objects通用物体on a table桌面上(PhyCo 台球场景)in a synthetic scene合成场景(CLEVRER 风格)
② 物理行为
collision/colliding碰撞a single collision between objects单次碰撞bouncing/rebound弹跳/回弹with visible impact and bounce可见撞击与反弹with minimal bounce小幅度回弹rolling into a wall滚向墙scattering散射 / 四散momentum transfer动量传递in motion运动中的
③ 空间一致性短语(关键!)
clear spatial layout清晰的空间布局visible depth可见的纵深consistent trajectories一致的轨迹gravity-consistent/gravity-consistent movement重力一致的运动gravity-consistent rebound trajectories重力一致的回弹轨迹objects maintaining spatial relationships物体保持空间关系realistic restitution真实的恢复系数(回弹性)rigid collision with momentum transfer带动量传递的刚性碰撞
负面提示词建议
训练时 neg 为空(模型未学负向),建议只加画质/物理负向,不要加与物理矛盾的内容:
blurry, distorted, low quality, jittery motion, objects passing through each other, objects floating without gravity, morphing shapes, inconsistent lighting, flickering
提示词示例(可直接使用)
碰撞类
several colored objects, a single collision between objects, metal objects with rigid, elastic collisions, clear spatial layout, visible depth, objects maintaining spatial relationships in a synthetic sceneseveral colored objects, objects colliding with visible impact and bounce, clear spatial layout, gravity-consistent trajectoriesobjects colliding with visible impact and bounce, clear spatial layout, gravity-consistent trajectories
弹跳/回弹类
4. Elastic objects bouncing with realistic restitution, clear spatial layout, gravity-consistent rebound trajectories
5. objects bouncing with realistic restitution, clear spatial layout, gravity-consistent rebound
6. a ball rolling into a wall and rebounding with minimal bounce, clear spatial layout, visible depth, rigid collision with momentum transfer
多物体散射/台球类
7. billiard balls colliding and scattering on a table, momentum transfer between balls, clear spatial layout, visible depth
8. several balls on a table, a ball striking the group, momentum transfer, balls scattering with realistic collision, clear spatial layout, gravity-consistent
轨迹/无碰撞类
9. Rigid objects in motion with clear spatial layout, consistent trajectories, gravity-consistent movement and visible depth
10. several colored objects, objects moving with consistent trajectories, no collision, clear spatial layout, visible depth, objects maintaining spatial relationships in a synthetic scene
自由发挥模板(替换行为词)
11. a ball thrown across the scene, [parabolic arc / gravity-consistent trajectory], clear spatial layout, visible depth
12. two balls colliding in mid-air, clear spatial layout, consistent trajectories, gravity-consistent rebound, visible depth
## 加速适配
与 MiniMax-H3 Turbo 加速 LoRA 兼容,可叠加使用。
## 训练信息
- 框架:ai-toolkit · Rank 16 · 分辨率 512 · 90 帧 @ 24fps
- Downloads last month
- 1,858