datasets: | |
- openlamm/LAMM_Dataset | |
language: | |
- en | |
Repo: | |
- https://github.com/OpenLAMM/LAMM | |
- Commit ID: 6b98b26b3340378bb5bed330cca86305759d8d22 | |
Model Config: | |
- LLM: Vicuna_13b_v0 | |
- Vision Encoder: CLIP ViT-L-14 | |
- lora_r: 32 | |
- lora_alpha: 32 | |
- lora_dropout: 0.1 | |
- lora_target_modules: ['q_proj', 'k_proj', 'v_proj', 'o_proj'] | |
Train Config: | |
- Epochs: 2 | |
- train_batch_size: 64 |