|
--- |
|
license: apache-2.0 |
|
--- |
|
|
|
# TokenFlow🚀: Unified Image Tokenizer for Multimodal Understanding and Generation |
|
|
|
<div align="center"> |
|
|
|
[](https://github.com/ByteFlow-AI/TokenFlow) |
|
|
|
</div> |
|
|
|
## 🌿 Introduction |
|
|
|
We present TokenFlow, a unified image tokenizer that bridges the long-standing gap between multimodal understanding and generation. |
|
TokenFlow introduce an innovative dual-codebook architecture that decouples semantic and pixel-level feature learning while maintaining their alignment through a shared mapping mechanism. |
|
|
|
TokenFlow excels in both multimodal understanding and image generation. For multimodal understanding, we surpass the flagship models such as LLaVA-1.5 and EMU3 by a large margin. For text-to-image generation, we also achieve comparable performance to SDXL in 256×256 resolution. |
|
|
|
|
|
## ⚙️ Getting Started |
|
This repo contains the model for text-to-image in TokenFlow. |
|
See [GETTING_STARTED.md](https://github.com/ByteFlow-AI/TokenFlow/blob/main/GETTING_STARTED.md) for detailed instructions of ***training*** and ***evaluation*** of TokenFlow multimodal understanding. |
