GitHub repository: Haodong-Yang/loretta
Primary language: Python
Description: [NAACL 24 Oral] LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models