adamix-gpt2 (pypi): PyTorch implementation of low-rank adaptation (LoRA) and Adamix, a parameter-efficient approach to adapt a large pre-trained deep learning model which obtains performance better than full fine-tuning.
Keywords: python|adamix|peft|adapter|bert|dart|glue|gpt-2|nlg|nlp|nlu|parameter-efficient|pytorch|roberta|webnlg