Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuning
Paper
•
2503.07572
•
Published
•
17
Simulation Environments Tests and Builds
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
simulate-tests's activity
edbeeching
authored
a
paper
about 3 hours ago
Post
370
We've kept pushing our Open-R1 project, an open initiative to replicate and extend the techniques behind DeepSeek-R1.
And even we were mind-blown by the results we got with this latest model we're releasing: ⚡️OlympicCoder ( open-r1/OlympicCoder-7B and open-r1/OlympicCoder-32B)
It's beating Claude 3.7 on (competitive) programming –a domain Anthropic has been historically really strong at– and it's getting close to o1-mini/R1 on olympiad level coding with just 7B parameters!
And the best part is that we're open-sourcing all about its training dataset, the new IOI benchmark, and more in our Open-R1 progress report #3: https://huggingface.co/blog/open-r1/update-3
Datasets are are releasing:
- open-r1/codeforces
- open-r1/codeforces-cots
- open-r1/ioi
- open-r1/ioi-test-cases
- open-r1/ioi-sample-solutions
- open-r1/ioi-cots
- open-r1/ioi-2024-model-solutions
And even we were mind-blown by the results we got with this latest model we're releasing: ⚡️OlympicCoder ( open-r1/OlympicCoder-7B and open-r1/OlympicCoder-32B)
It's beating Claude 3.7 on (competitive) programming –a domain Anthropic has been historically really strong at– and it's getting close to o1-mini/R1 on olympiad level coding with just 7B parameters!
And the best part is that we're open-sourcing all about its training dataset, the new IOI benchmark, and more in our Open-R1 progress report #3: https://huggingface.co/blog/open-r1/update-3
Datasets are are releasing:
- open-r1/codeforces
- open-r1/codeforces-cots
- open-r1/ioi
- open-r1/ioi-test-cases
- open-r1/ioi-sample-solutions
- open-r1/ioi-cots
- open-r1/ioi-2024-model-solutions
dylanebert
posted
an
update
13 days ago
Post
1096
📢 New #1 in Generative 3D
CSM/Cube from Common Sense Machines is now the top ranked image-to-3d model
check out the results in dylanebert/3d-arena
CSM/Cube from Common Sense Machines is now the top ranked image-to-3d model
check out the results in dylanebert/3d-arena
thomwolf
authored
a
paper
about 1 month ago
dylanebert
posted
an
update
about 1 month ago
Post
3308
I made a 1 minute video explaining the DeepSeek situation
R1: deepseek-ai/DeepSeek-R1
Janus Pro: deepseek-ai/Janus-Pro-7B
R1: deepseek-ai/DeepSeek-R1
Janus Pro: deepseek-ai/Janus-Pro-7B
- 3 replies
dylanebert
posted
an
update
about 2 months ago
Post
686
⚙️ Convert
i've created a simple space to convert .ply gaussian splat files to .splat format
dylanebert/ply-to-splat
.ply to .splati've created a simple space to convert .ply gaussian splat files to .splat format
dylanebert/ply-to-splat
thomwolf
authored
a
paper
about 2 months ago
dylanebert
posted
an
update
2 months ago
Post
2017
🟦 New Image-to-3D model from Stability AI
stabilityai/stable-point-aware-3d
here's how it looks, with TRELLIS for comparison
stabilityai/stable-point-aware-3d
here's how it looks, with TRELLIS for comparison
natolambert
authored
9
papers
2 months ago
Objective Mismatch in Model-based Reinforcement Learning
Paper
•
2002.04523
•
Published
Confidence-Building Measures for Artificial Intelligence: Workshop Proceedings
Paper
•
2308.00862
•
Published
A Survey on Data Selection for Language Models
Paper
•
2402.16827
•
Published
•
4
D2PO: Discriminator-Guided DPO with Response Evaluation Models
Paper
•
2405.01511
•
Published
Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback
Paper
•
2406.09279
•
Published
•
2
WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
Paper
•
2406.18495
•
Published
•
13
Towards a Framework for Openness in Foundation Models: Proceedings from the Columbia Convening on Openness in Artificial Intelligence
Paper
•
2405.15802
•
Published
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper
•
2409.17146
•
Published
•
108
2 OLMo 2 Furious
Paper
•
2501.00656
•
Published
•
16
dylanebert
posted
an
update
3 months ago
Post
2312
TRELLIS is now the highest ranked open-source model in the 3D Arena Leaderboard, surpassing InstantMesh
dylanebert/3d-arena
dylanebert/3d-arena
- 1 reply
Post
6074
We are proud to announce
HuggingFaceFW/fineweb-2: A sparkling update to
HuggingFaceFW/fineweb with 1000s of 🗣️languages.
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
In the mean time come ask us question on our chat place: HuggingFaceFW/discussion
H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
In the mean time come ask us question on our chat place: HuggingFaceFW/discussion
H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
- 2 replies
dylanebert
posted
an
update
3 months ago
Post
2923
blender has AI now