Unleashing the Power of Pre-trained Language Models for Offline Reinforcement Learning
Paper
•
2310.20587
•
Published
•
15
Papers - Fine-tuning
-
-
SELF: Language-Driven Self-Evolution for Large Language Model
Paper • 2310.00533 • Published • 2 -
QLoRA: Efficient Finetuning of Quantized LLMs
Paper • 2305.14314 • Published • 39 -
QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
Paper • 2309.14717 • Published • 43 -
Table-GPT: Table-tuned GPT for Diverse Table Tasks
Paper • 2310.09263 • Published • 36 -
Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models
Paper • 2401.01335 • Published • 61 -
LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
Paper • 2403.15042 • Published • 24 -
Toolformer: Language Models Can Teach Themselves to Use Tools
Paper • 2302.04761 • Published • 10 -
The Unreasonable Ineffectiveness of the Deeper Layers
Paper • 2403.17887 • Published • 74 -
InternLM2 Technical Report
Paper • 2403.17297 • Published • 25 -
LIMA: Less Is More for Alignment
Paper • 2305.11206 • Published • 17 -
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 37 -
sDPO: Don't Use Your Data All at Once
Paper • 2403.19270 • Published • 31 -
Deep reinforcement learning from human preferences
Paper • 1706.03741 • Published • 3 -
Fine-tuning Language Models for Factuality
Paper • 2311.08401 • Published • 26 -
An Emulator for Fine-Tuning Large Language Models using Small Language Models
Paper • 2310.12962 • Published • 13 -
Gecko: Versatile Text Embeddings Distilled from Large Language Models
Paper • 2403.20327 • Published • 41 -
Model Stock: All we need is just a few fine-tuned models
Paper • 2403.19522 • Published • 9 -
ReFT: Representation Finetuning for Language Models
Paper • 2404.03592 • Published • 70 -
UltraFeedback: Boosting Language Models with High-quality Feedback
Paper • 2310.01377 • Published • 4 -
RL for Consistency Models: Faster Reward Guided Text-to-Image Generation
Paper • 2404.03673 • Published • 14 -
Stream of Search (SoS): Learning to Search in Language
Paper • 2404.03683 • Published • 21 -
CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues
Paper • 2404.03820 • Published • 20 -
ORPO: Monolithic Preference Optimization without Reference Model
Paper • 2403.07691 • Published • 54 -
Learn Your Reference Model for Real Good Alignment
Paper • 2404.09656 • Published • 79 -
Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking
Paper • 2402.14811 • Published • 4 -
Comprehensive Survey of Model Compression and Speed up for Vision Transformers
Paper • 2404.10407 • Published • 1 -
OpenBezoar: Small, Cost-Effective and Open Models Trained on Mixes of Instruction Data
Paper • 2404.12195 • Published • 11 -
Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning
Paper • 2303.15647 • Published • 5 -
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer
Paper • 2205.12148 • Published • 2