lucylyn/MSD-LLaVA1.6-7B

MSD draft checkpoint for LLaVA-1.6-7B

This repository contains the MSD draft-model weights and configuration. Use it with the corresponding target model and the MSD implementation.

• Target model: llava-hf/llava-v1.6-vicuna-7b-hf
• Evaluation adapter: llava_hf_msd
• Draft visual compression: KMeans, retaining 32 visual tokens by default. The target model retains the complete visual input.

Usage

Install the packages from the MSD repository, then run:

accelerate launch --num_processes=1 -m lmms_eval \
    --model llava_hf_msd \
    --model_args pretrained=llava-hf/llava-v1.6-vicuna-7b-hf \
    --msd_model_path lucylyn/MSD-LLaVA1.6-7B \
    --tasks chartqa --batch_size 1 --limit 100 \
    --gen_kwargs temperature=0,max_new_tokens=512 \
    --use_msd

Files: config.json and pytorch_model.bin. This is a draft checkpoint to pair with the target model.