Edit model card

Repo:

Model Config:

  • LLM: Vicuna_13b_v0
  • Vision Encoder: CLIP ViT-L-14
  • lora_r: 32
  • lora_alpha: 32
  • lora_dropout: 0.1
  • lora_target_modules: ['q_proj', 'k_proj', 'v_proj', 'o_proj']

Train Config:

  • Epochs: 2
  • train_batch_size: 64
Downloads last month
13
Inference API
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train openlamm/lamm_13b_lora32_186k