Instructions to use SuhZhang/CorrAdapter-Model-on-MVAdapter with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SuhZhang/CorrAdapter-Model-on-MVAdapter with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SuhZhang/CorrAdapter-Model-on-MVAdapter", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
CorrAdapter-Model-on-MVAdapter
This model repository contains the trained MVAdapter + CorrAdapter* checkpoint for image-conditioned static multi-view generation from the CorrAdapter project.
CorrAdapter* is the trained variant of CorrAdapter on top of MV-Adapter image-to-multiview SDXL. The checkpoint is saved in Hugging Face sharded PyTorch format:
pytorch_model.bin.index.json
pytorch_model-00001-of-00004.bin
pytorch_model-00002-of-00004.bin
pytorch_model-00003-of-00004.bin
pytorch_model-00004-of-00004.bin
This is not a standalone Diffusers pipeline. Use it with the CorrAdapter MVAdapter subproject.
Usage
From the CorrAdapter MVAdapter directory:
python -m scripts.inference_i2mv_sdxl \
--adapter_path SuhZhang/CorrAdapter-Model-on-MVAdapter \
--adapter_weight_name pytorch_model.bin.index.json \
--image assets/demo/i2mv/A_decorative_figurine_of_a_young_anime-style_girl.png \
--text "A decorative figurine of a young anime-style girl" \
--seed 21 \
--output outputs/demo_i2mv_trained/output.png \
--remove_bg
For local loading, replace --adapter_path with the local model directory path.
Expected Code
The loader in mvadapter/loaders/custom_adapter.py supports pytorch_model.bin.index.json and loads only the keys needed by the MVAdapter CorrAdapter pipeline. The inference script also accepts:
--adapter_weight_name auto
when the directory contains pytorch_model.bin.index.json.
Citation
@InProceedings{Zhang_2026_CVPR,
author = {Zhang, Shihua and Shen, Qiuhong and Wang, Xinchao},
title = {Align Images Before You Generate},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2026},
pages = {30521-30531}
}
Please also cite MV-Adapter when using this checkpoint.
- Downloads last month
- 103
Model tree for SuhZhang/CorrAdapter-Model-on-MVAdapter
Base model
stabilityai/stable-diffusion-xl-base-1.0