microsoft/lora: Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
Category: llm
Language: Python
Topics: adaptation, deberta, deep-learning, gpt-2, gpt-3, language-model, lora, low-rank, pytorch, roberta
Homepage: https://arxiv.org/abs/2106.09685