Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ pinned: false
|
|
| 11 |
|
| 12 |
π€ **LLM-Drop** hosts research artifacts for efficient foundation models, with a focus on large language models and unified multimodal models.
|
| 13 |
|
| 14 |
-
Our work studies how modern foundation models can be made more efficient while preserving their core capabilities. This page collects model weights, code links, and related resources from our research projects.
|
| 15 |
|
| 16 |
## π Projects
|
| 17 |
|
|
@@ -28,6 +28,7 @@ TMLR 2026
|
|
| 28 |
|
| 29 |
**Demystifying When Pruning Works via Representation Hierarchies**
|
| 30 |
|
|
|
|
| 31 |
- π Paper: https://arxiv.org/abs/2603.24652
|
| 32 |
- π» Code: https://github.com/CASE-Lab-UMD/Pruning-on-Representations
|
| 33 |
|
|
@@ -35,8 +36,12 @@ TMLR 2026
|
|
| 35 |
|
| 36 |
**Understanding and Harnessing Sparsity in Unified Multimodal Models**
|
| 37 |
|
|
|
|
| 38 |
- π Paper: https://huggingface.co/papers/2512.02351
|
| 39 |
- π» Code: https://github.com/Shwai-He/SparseUnifiedModel
|
|
|
|
|
|
|
|
|
|
| 40 |
|
| 41 |
## π¬ Contact
|
| 42 |
|
|
@@ -44,4 +49,3 @@ For questions or collaborations, please contact:
|
|
| 44 |
|
| 45 |
- Shwai He: shwaihe@umd.edu
|
| 46 |
- Guoheng Sun: ghsun@umd.edu
|
| 47 |
-
|
|
|
|
| 11 |
|
| 12 |
π€ **LLM-Drop** hosts research artifacts for efficient foundation models, with a focus on large language models and unified multimodal models.
|
| 13 |
|
| 14 |
+
Our work studies how modern foundation models can be made more efficient while preserving their core capabilities. This page collects model weights, code links, project pages, and related resources from our research projects.
|
| 15 |
|
| 16 |
## π Projects
|
| 17 |
|
|
|
|
| 28 |
|
| 29 |
**Demystifying When Pruning Works via Representation Hierarchies**
|
| 30 |
|
| 31 |
+
- π Project Page: https://case-lab-umd.github.io/Pruning-on-Representations/
|
| 32 |
- π Paper: https://arxiv.org/abs/2603.24652
|
| 33 |
- π» Code: https://github.com/CASE-Lab-UMD/Pruning-on-Representations
|
| 34 |
|
|
|
|
| 36 |
|
| 37 |
**Understanding and Harnessing Sparsity in Unified Multimodal Models**
|
| 38 |
|
| 39 |
+
- π Project Page: https://shwai-he.github.io/SparseUnifiedModel/
|
| 40 |
- π Paper: https://huggingface.co/papers/2512.02351
|
| 41 |
- π» Code: https://github.com/Shwai-He/SparseUnifiedModel
|
| 42 |
+
- π€ Models:
|
| 43 |
+
- https://huggingface.co/LLM-Drop/BAGEL-MoE-7B-GEN-16to8
|
| 44 |
+
- https://huggingface.co/LLM-Drop/BAGEL-MoE-7B-GEN-32to16
|
| 45 |
|
| 46 |
## π¬ Contact
|
| 47 |
|
|
|
|
| 49 |
|
| 50 |
- Shwai He: shwaihe@umd.edu
|
| 51 |
- Guoheng Sun: ghsun@umd.edu
|
|
|