Adaptive Layer-skipping in Pre-trained LLMs
Paper
•
2503.23798
•
Published
DataComp
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
dclm's activity
weizhiwang
authored
2
papers
1 day ago
Post
2736
The new DeepSite space is really insane for vibe-coders
enzostvs/deepsite
With the wave of vibe-coding-optimized LLMs like the latest open-source DeepSeek model (version V3-0324), you can basically prompt out-of-the-box and create any app and game in one-shot.
It feels so powerful to me, no more complex framework or under-the-hood prompt engineering to have a working text-to-app tool.
AI is eating the world and *open-source* AI is eating AI itself!
PS: and even more meta is that the DeepSite app and DeepSeek model are both fully open-source code => time to start recursively improve?
PPS: you still need some inference hosting unless you're running the 600B param model at home, so check the very nice list of HF Inference Providers for this model: deepseek-ai/DeepSeek-V3-0324
enzostvs/deepsite
With the wave of vibe-coding-optimized LLMs like the latest open-source DeepSeek model (version V3-0324), you can basically prompt out-of-the-box and create any app and game in one-shot.
It feels so powerful to me, no more complex framework or under-the-hood prompt engineering to have a working text-to-app tool.
AI is eating the world and *open-source* AI is eating AI itself!
PS: and even more meta is that the DeepSite app and DeepSeek model are both fully open-source code => time to start recursively improve?
PPS: you still need some inference hosting unless you're running the 600B param model at home, so check the very nice list of HF Inference Providers for this model: deepseek-ai/DeepSeek-V3-0324
- 1 reply
richardaecn
authored
13
papers
11 days ago
Unified Visual Relationship Detection with Vision and Language Models
Paper
•
2303.08998
•
Published
The iNaturalist Species Classification and Detection Dataset
Paper
•
1707.06642
•
Published
Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception
Paper
•
2305.06324
•
Published
•
1
Fashionpedia: Ontology, Segmentation, and an Attribute Localization Dataset
Paper
•
2004.12276
•
Published
•
1
Spatiotemporal Contrastive Video Representation Learning
Paper
•
2008.03800
•
Published
Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation
Paper
•
2012.07177
•
Published
DaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Model
Paper
•
2306.01736
•
Published
•
1
Open-vocabulary Object Detection via Vision and Language Knowledge Distillation
Paper
•
2104.13921
•
Published
VideoGLUE: Video General Understanding Evaluation of Foundation Models
Paper
•
2307.03166
•
Published
•
5
A Simple Zero-shot Prompt Weighting Technique to Improve Prompt Ensembling in Text-Image Models
Paper
•
2302.06235
•
Published
Edify Image: High-Quality Image Generation with Pixel Space Laplacian Diffusion Models
Paper
•
2411.07126
•
Published
•
30
Edify 3D: Scalable High-Quality 3D Asset Generation
Paper
•
2411.07135
•
Published
Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning
Paper
•
2503.15558
•
Published
•
44
Post
2721
We've kept pushing our Open-R1 project, an open initiative to replicate and extend the techniques behind DeepSeek-R1.
And even we were mind-blown by the results we got with this latest model we're releasing: ⚡️OlympicCoder ( open-r1/OlympicCoder-7B and open-r1/OlympicCoder-32B)
It's beating Claude 3.7 on (competitive) programming –a domain Anthropic has been historically really strong at– and it's getting close to o1-mini/R1 on olympiad level coding with just 7B parameters!
And the best part is that we're open-sourcing all about its training dataset, the new IOI benchmark, and more in our Open-R1 progress report #3: https://huggingface.co/blog/open-r1/update-3
Datasets are are releasing:
- open-r1/codeforces
- open-r1/codeforces-cots
- open-r1/ioi
- open-r1/ioi-test-cases
- open-r1/ioi-sample-solutions
- open-r1/ioi-cots
- open-r1/ioi-2024-model-solutions
And even we were mind-blown by the results we got with this latest model we're releasing: ⚡️OlympicCoder ( open-r1/OlympicCoder-7B and open-r1/OlympicCoder-32B)
It's beating Claude 3.7 on (competitive) programming –a domain Anthropic has been historically really strong at– and it's getting close to o1-mini/R1 on olympiad level coding with just 7B parameters!
And the best part is that we're open-sourcing all about its training dataset, the new IOI benchmark, and more in our Open-R1 progress report #3: https://huggingface.co/blog/open-r1/update-3
Datasets are are releasing:
- open-r1/codeforces
- open-r1/codeforces-cots
- open-r1/ioi
- open-r1/ioi-test-cases
- open-r1/ioi-sample-solutions
- open-r1/ioi-cots
- open-r1/ioi-2024-model-solutions
orionweller
authored
a
paper
23 days ago
Wanfq
authored
a
paper
28 days ago
AmeyaPrabhu
authored
a
paper
about 1 month ago