KAN: Kolmogorov-Arnold Networks
Paper
•
2404.19756
•
Published
•
88
Edoardo Federici
efederici
AI & ML interests
llms, ir, graphs & co
Organizations
efederici's activity
upvoted
3
papers
15 days ago
upvoted
5
papers
about 1 month ago
Compression Represents Intelligence Linearly
Paper
•
2404.09937
•
Published
•
27
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
Paper
•
2404.08801
•
Published
•
61
Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences
Paper
•
2404.03715
•
Published
•
57
Jamba: A Hybrid Transformer-Mamba Language Model
Paper
•
2403.19887
•
Published
•
98
ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline
Paper
•
2404.02893
•
Published
•
19
upvoted
3
papers
about 2 months ago
The Unreasonable Ineffectiveness of the Deeper Layers
Paper
•
2403.17887
•
Published
•
75
Evolutionary Optimization of Model Merging Recipes
Paper
•
2403.13187
•
Published
•
44
LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression
Paper
•
2403.12968
•
Published
•
20
upvoted
6
papers
2 months ago
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking
Paper
•
2403.09629
•
Published
•
54
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Paper
•
2403.07816
•
Published
•
37
Stealing Part of a Production Language Model
Paper
•
2403.06634
•
Published
•
85
Common 7B Language Models Already Possess Strong Math Capabilities
Paper
•
2403.04706
•
Published
•
16
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
172
A Critical Evaluation of AI Feedback for Aligning Large Language Models
Paper
•
2402.12366
•
Published
•
3
upvoted
9
papers
3 months ago
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper
•
2402.17764
•
Published
•
566
Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models
Paper
•
2402.17177
•
Published
•
87
Orca-Math: Unlocking the potential of SLMs in Grade School Math
Paper
•
2402.14830
•
Published
•
23
GPTVQ: The Blessing of Dimensionality for LLM Quantization
Paper
•
2402.15319
•
Published
•
19
Neural Network Diffusion
Paper
•
2402.13144
•
Published
•
92
Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning
Paper
•
2402.04833
•
Published
•
6
Generative Representational Instruction Tuning
Paper
•
2402.09906
•
Published
•
50
Grandmaster-Level Chess Without Search
Paper
•
2402.04494
•
Published
•
62
Self-Discover: Large Language Models Self-Compose Reasoning Structures
Paper
•
2402.03620
•
Published
•
102
upvoted
4
papers
4 months ago
The False Promise of Imitating Proprietary LLMs
Paper
•
2305.15717
•
Published
•
4
Learning Universal Predictors
Paper
•
2401.14953
•
Published
•
18
Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling
Paper
•
2401.16380
•
Published
•
45
Self-Rewarding Language Models
Paper
•
2401.10020
•
Published
•
135
upvoted
3
papers
5 months ago
Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Paper
•
2312.06585
•
Published
•
26
Large Language Model Guided Tree-of-Thought
Paper
•
2305.08291
•
Published
•
2
Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model Responses
Paper
•
2312.00763
•
Published
•
18
upvoted
14
papers
6 months ago
System 2 Attention (is something you might need too)
Paper
•
2311.11829
•
Published
•
38
GAIA: a benchmark for General AI Assistants
Paper
•
2311.12983
•
Published
•
171
YUAN 2.0: A Large Language Model with Localized Filtering-based Attention
Paper
•
2311.15786
•
Published
•
7
Fine-tuning Language Models for Factuality
Paper
•
2311.08401
•
Published
•
26
Memory Augmented Language Models through Mixture of Word Experts
Paper
•
2311.10768
•
Published
•
16
Exponentially Faster Language Modelling
Paper
•
2311.10770
•
Published
•
117
Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers
Paper
•
2311.10642
•
Published
•
23
Prompt Engineering a Prompt Engineer
Paper
•
2311.05661
•
Published
•
18
LoRAShear: Efficient Large Language Model Structured Pruning and Knowledge Recovery
Paper
•
2310.18356
•
Published
•
22
A Simple and Effective Pruning Approach for Large Language Models
Paper
•
2306.11695
•
Published
•
2
NEFTune: Noisy Embeddings Improve Instruction Finetuning
Paper
•
2310.05914
•
Published
•
13
Sparse Finetuning for Inference Acceleration of Large Language Models
Paper
•
2310.06927
•
Published
•
14
FlashDecoding++: Faster Large Language Model Inference on GPUs
Paper
•
2311.01282
•
Published
•
30
Idempotent Generative Network
Paper
•
2311.01462
•
Published
•
22
upvoted
a
paper
7 months ago
upvoted
5
papers
8 months ago
Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attacks
Paper
•
2309.17410
•
Published
•
4
Representation Engineering: A Top-Down Approach to AI Transparency
Paper
•
2310.01405
•
Published
•
4
Efficient Streaming Language Models with Attention Sinks
Paper
•
2309.17453
•
Published
•
13
Finite Scalar Quantization: VQ-VAE Made Simple
Paper
•
2309.15505
•
Published
•
21
Language Modeling Is Compression
Paper
•
2309.10668
•
Published
•
79