Instructions to use SyFeee/LTX-2.3-SyFe-ID-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LTX.io
How to use SyFeee/LTX-2.3-SyFe-ID-LoRA with LTX.io:
# Install the LTX-2 pipelines git clone https://github.com/Lightricks/LTX-2.git cd LTX-2 uv sync --frozen
# Download the weights from this repo, plus the Gemma text encoder hf download SyFeee/LTX-2.3-SyFe-ID-LoRA --local-dir models/LTX-2.3-SyFe-ID-LoRA hf download google/gemma-3-12b-it-qat-q4_0-unquantized --local-dir models/gemma-3-12b
# Text/image-to-video with the LoRA on the HQ two-stage base pipeline uv run python -m ltx_pipelines.ti2vid_two_stages_hq \ --checkpoint-path path/to/checkpoint.safetensors \ --distilled-lora path/to/distilled_lora.safetensors 0.8 \ --spatial-upsampler-path path/to/spatial_upsampler.safetensors \ --gemma-root models/gemma-3-12b \ --lora models/LTX-2.3-SyFe-ID-LoRA/<weights>.safetensors 1.0 \ --prompt "your prompt here" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8 - Notebooks
- Google Colab
- Kaggle
SyFe LTX-2.3 ID-LoRA Checkpoints
Identity-driven audio-video LoRAs trained by SyFe on LTX-2.3 22B-dev. These checkpoints condition generation on a portrait and reference audio to preserve visual identity, vocal identity, and speaking motion in one pass.
Checkpoints
| Run | Training data | Resolution / frames | Rank | Steps | Status |
|---|---|---|---|---|---|
id_lora_ours_768 |
3,376 talking clips from one show | 768x320 / 121 | 128 | 3,000 | Experimental; cloned voice and mouth motion validated |
id_lora_ours_704 |
9,700 clips, 501 speakers, 20 shows | 1280x704 / 121 | 128 | 6,000 | Higher-resolution production candidate |
Each run folder contains the final LoRA and its training configuration. The adapters use the ID-LoRA audio_ref_only_ic contract with negative-time reference-audio conditioning. They require an LTX-2.3 ID-LoRA-compatible pipeline; they are not standalone models.
Limitations
Lip synchronization is functional but not phoneme-perfect, and speech may truncate when the requested line does not fit the video duration. Identity quality depends strongly on portrait framing and face size.
Use is subject to the LTX-2 community license and the applicable rights for all reference media and generated identities.
- Downloads last month
- 20
Model tree for SyFeee/LTX-2.3-SyFe-ID-LoRA
Base model
Lightricks/LTX-2.3