Script and modeling used to split W_pack into q_proj, k_proj, v_proj for correct lora module injection.
Unable to determine this model's library. Check the
docs
.
Script and modeling used to split W_pack into q_proj, k_proj, v_proj for correct lora module injection.