EPFL Machine Learning and Optimization Laboratory

university

https://www.epfl.ch/labs/mlo/

epfml

Activity Feed Request to join this org

AI & ML interests

None defined yet.

epfml's activity

MatPag

authored 4 papers 5 months ago

Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features

Paper • 1703.02507 • Published Mar 7, 2017

DoGE: Domain Reweighting with Generalization Estimation

Paper • 2310.15393 • Published Oct 23, 2023 • 1

The AdEMAMix Optimizer: Better, Faster, Older

Paper • 2409.03137 • Published Sep 5, 2024 • 5

DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging

Paper • 2402.02622 • Published Feb 4, 2024 • 3

haeggee

authored a paper 8 months ago

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28, 2024 • 12

Olivia-umich

authored 2 papers 11 months ago

MEDITRON-70B: Scaling Medical Pretraining for Large Language Models

Paper • 2311.16079 • Published Nov 27, 2023 • 20

DoGE: Domain Reweighting with Generalization Estimation

Paper • 2310.15393 • Published Oct 23, 2023 • 1

MatPag

authored a paper over 1 year ago

Faster Causal Attention Over Large Sequences Through Sparse Flash Attention

Paper • 2306.01160 • Published Jun 1, 2023 • 1

akmohtashami

updated a model over 1 year ago

epfml/landmark-attention-llama7b-wdiff

Text Generation • Updated Jun 1, 2023 • 9 • 19