Libra-Base

Libra: Building Decoupled Vision System on Large Language Models

This model was trained on image-text pairs for basic multi-modal understanding ability.

!!! NOTE !!!

In addition to the pretrained weights in this repo, please download the pretrained CLIP model in huggingface and merge it into the path, as:

libra-base/
├── ...
└── openai-clip-vit-large-patch14-336/
    └── ...

The CLIP model can be downloaded here.

Downloads last month: 11

Safetensors

Model size

11B params

Tensor type

BF16

Inference Examples

Image-to-Text

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including YifanXu/libra-11b-base

Libra

Collection

The official repo for the ICML2024 paper: Libra: Building Decoupled Vision System on Large Language Models • 3 items • Updated May 16