| datasets: | |
| - openlamm/LAMM_Dataset | |
| language: | |
| - en | |
| Repo: | |
| - https://github.com/OpenLAMM/LAMM | |
| - Commit ID: 6b98b26b3340378bb5bed330cca86305759d8d22 | |
| Model Config: | |
| - LLM: Vicuna_13b_v0 | |
| - Vision Encoder: CLIP ViT-L-14 | |
| - lora_r: 32 | |
| - lora_alpha: 32 | |
| - lora_dropout: 0.1 | |
| - lora_target_modules: ['q_proj', 'k_proj', 'v_proj', 'o_proj'] | |
| Train Config: | |
| - Epochs: 2 | |
| - train_batch_size: 64 |