OpenBezoar: Small, Cost-Effective and Open Models Trained on Mixes of Instruction Data
Paper
•
2404.12195
•
Published
•
11
Motoki Wu
tokestermw
AI & ML interests
None yet
Organizations
tokestermw's activity
upvoted
a
paper
26 days ago
upvoted
a
collection
26 days ago
upvoted
a
paper
about 1 month ago
upvoted
a
paper
about 2 months ago
upvoted
a
paper
2 months ago
upvoted
a
collection
2 months ago
upvoted
7
papers
2 months ago
PERL: Parameter Efficient Reinforcement Learning from Human Feedback
Paper
•
2403.10704
•
Published
•
55
RAFT: Adapting Language Model to Domain Specific RAG
Paper
•
2403.10131
•
Published
•
61
ORPO: Monolithic Preference Optimization without Reference Model
Paper
•
2403.07691
•
Published
•
56
A Rank Stabilization Scaling Factor for Fine-Tuning with LoRA
Paper
•
2312.03732
•
Published
•
4
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
172
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Paper
•
2403.07816
•
Published
•
37
SaulLM-7B: A pioneering Large Language Model for Law
Paper
•
2403.03883
•
Published
•
66
upvoted
9
papers
3 months ago
ResLoRA: Identity Residual Mapping in Low-Rank Adaption
Paper
•
2402.18039
•
Published
•
10
User-LLM: Efficient LLM Contextualization with User Embeddings
Paper
•
2402.13598
•
Published
•
17
Instruction-tuned Language Models are Better Knowledge Learners
Paper
•
2402.12847
•
Published
•
25
Speculative Streaming: Fast LLM Inference without Auxiliary Models
Paper
•
2402.11131
•
Published
•
41
OS-Copilot: Towards Generalist Computer Agents with Self-Improvement
Paper
•
2402.07456
•
Published
•
39
Direct Language Model Alignment from Online AI Feedback
Paper
•
2402.04792
•
Published
•
25
ScreenAI: A Vision-Language Model for UI and Infographics Understanding
Paper
•
2402.04615
•
Published
•
31
Rethinking Interpretability in the Era of Large Language Models
Paper
•
2402.01761
•
Published
•
18
Nomic Embed: Training a Reproducible Long Context Text Embedder
Paper
•
2402.01613
•
Published
•
13
upvoted
7
papers
4 months ago
MoE-LLaVA: Mixture of Experts for Large Vision-Language Models
Paper
•
2401.15947
•
Published
•
46
InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation
Paper
•
2307.06942
•
Published
•
20
Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling
Paper
•
2401.16380
•
Published
•
45
Patchscope: A Unifying Framework for Inspecting Hidden Representations of Language Models
Paper
•
2401.06102
•
Published
•
18
Blending Is All You Need: Cheaper, Better Alternative to Trillion-Parameters LLM
Paper
•
2401.02994
•
Published
•
44
MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
Paper
•
2401.04081
•
Published
•
68
LLM Augmented LLMs: Expanding Capabilities through Composition
Paper
•
2401.02412
•
Published
•
35
upvoted
8
papers
5 months ago
Understanding LLMs: A Comprehensive Overview from Training to Inference
Paper
•
2401.02038
•
Published
•
59
DocLLM: A layout-aware generative language model for multimodal document understanding
Paper
•
2401.00908
•
Published
•
173
Improving Text Embeddings with Large Language Models
Paper
•
2401.00368
•
Published
•
72
WaveCoder: Widespread And Versatile Enhanced Instruction Tuning with Refined Data Generation
Paper
•
2312.14187
•
Published
•
49
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Paper
•
2312.11514
•
Published
•
253
CoLT5: Faster Long-Range Transformers with Conditional Computation
Paper
•
2303.09752
•
Published
•
2
LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models
Paper
•
2310.08659
•
Published
•
20
QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models
Paper
•
2310.16795
•
Published
•
26
upvoted
6
papers
6 months ago
The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning
Paper
•
2312.01552
•
Published
•
26
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper
•
2312.00752
•
Published
•
131
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper
•
2308.12966
•
Published
•
6
System 2 Attention (is something you might need too)
Paper
•
2311.11829
•
Published
•
38
FlashDecoding++: Faster Large Language Model Inference on GPUs
Paper
•
2311.01282
•
Published
•
30
GPT4All: An Ecosystem of Open Source Compressed Language Models
Paper
•
2311.04931
•
Published
•
20
upvoted
4
papers
7 months ago
Zephyr: Direct Distillation of LM Alignment
Paper
•
2310.16944
•
Published
•
116
Controlled Decoding from Language Models
Paper
•
2310.17022
•
Published
•
12
Contrastive Prefence Learning: Learning from Human Feedback without RL
Paper
•
2310.13639
•
Published
•
21
BitNet: Scaling 1-bit Transformers for Large Language Models
Paper
•
2310.11453
•
Published
•
94
upvoted
a
collection
7 months ago
upvoted
a
paper
7 months ago
upvoted
4
papers
8 months ago
DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
Paper
•
2310.03714
•
Published
•
27
Enable Language Models to Implicitly Learn Self-Improvement From Data
Paper
•
2310.00898
•
Published
•
21
Compositional Foundation Models for Hierarchical Planning
Paper
•
2309.08587
•
Published
•
9
Statistical Rejection Sampling Improves Preference Optimization
Paper
•
2309.06657
•
Published
•
13
upvoted
a
paper
9 months ago
upvoted
6
papers
10 months ago
DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
Paper
•
2308.01320
•
Published
•
42
Skeleton-of-Thought: Large Language Models Can Do Parallel Decoding
Paper
•
2307.15337
•
Published
•
34
Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback
Paper
•
2307.15217
•
Published
•
34
LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
Paper
•
2307.13269
•
Published
•
29
Llama 2: Open Foundation and Fine-Tuned Chat Models
Paper
•
2307.09288
•
Published
•
235
Learning to Retrieve In-Context Examples for Large Language Models
Paper
•
2307.07164
•
Published
•
20