Felix Fischer's picture

Felix Fischer

FlipTip

·

AI & ML interests

None yet

Recent Activity

reacted to m-ric's post with 🔥 about 1 month ago

Introducing 𝗼𝗽𝗲𝗻 𝗗𝗲𝗲𝗽-𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 by Hugging Face! 💥 OpenAI's latest agentic app Deep Research seems really good... But it's closed, as usual. ⏱️ So with a team of cracked colleagues, we set ourselves a 24hours deadline to replicate and open-source Deep Research! ⏱️ ➡️ We built open-Deep-Research, an entirely open agent that can: navigate the web autonomously, scroll and search through pages, download and manipulate files, run calculation on data... We aimed for the best performance: are the agent's answers really rigorous? On GAIA benchmark, Deep Research had 67% accuracy on the validation set. ➡️ open Deep Research is at 55% (powered by o1), it is: - the best pass@1 solution submitted - the best open solution 💪💪 And it's only getting started ! Please jump in, drop PRs, and let's bring it to the top ! Read the blog post 👉 https://huggingface.co/blog/open-deep-research

reacted to m-ric's post with 🔥 about 1 month ago

Less is More for Reasoning (LIMO): a 32B model fine-tuned with 817 examples can beat o1-preview on math reasoning! 🤯 Do we really need o1's huge RL procedure to see reasoning emerge? It seems not. Researchers from Shanghai Jiaotong University just demonstrated that carefully selected examples can boost math performance in large language models using SFT —no huge datasets or RL procedures needed. Their procedure allows Qwen2.5-32B-Instruct to jump from 6.5% to 57% on AIME and from 59% to 95% on MATH, while using only 1% of the data in previous approaches. ⚡ The Less-is-More Reasoning Hypothesis: ‣ Minimal but precise examples that showcase optimal reasoning patterns matter more than sheer quantity ‣ Pre-training knowledge plus sufficient computational resources at inference levels up math skills ➡️ Core techniques: ‣ High-quality reasoning chains with self-verification steps ‣ 817 handpicked problems that encourage deeper reasoning ‣ Enough inference-time computation to allow extended reasoning 💪 Efficiency gains: ‣ Only 817 examples instead of 100k+ ‣ 40.5% absolute improvement across 10 diverse benchmarks, outperforming models trained on 100x more data This really challenges the notion that SFT leads to memorization rather than generalization! And opens up reasoning to GPU-poor researchers 🚀 Read the full paper here 👉 https://huggingface.co/papers/2502.03387

reacted to m-ric's post with 👍 about 1 month ago

Less is More for Reasoning (LIMO): a 32B model fine-tuned with 817 examples can beat o1-preview on math reasoning! 🤯 Do we really need o1's huge RL procedure to see reasoning emerge? It seems not. Researchers from Shanghai Jiaotong University just demonstrated that carefully selected examples can boost math performance in large language models using SFT —no huge datasets or RL procedures needed. Their procedure allows Qwen2.5-32B-Instruct to jump from 6.5% to 57% on AIME and from 59% to 95% on MATH, while using only 1% of the data in previous approaches. ⚡ The Less-is-More Reasoning Hypothesis: ‣ Minimal but precise examples that showcase optimal reasoning patterns matter more than sheer quantity ‣ Pre-training knowledge plus sufficient computational resources at inference levels up math skills ➡️ Core techniques: ‣ High-quality reasoning chains with self-verification steps ‣ 817 handpicked problems that encourage deeper reasoning ‣ Enough inference-time computation to allow extended reasoning 💪 Efficiency gains: ‣ Only 817 examples instead of 100k+ ‣ 40.5% absolute improvement across 10 diverse benchmarks, outperforming models trained on 100x more data This really challenges the notion that SFT leads to memorization rather than generalization! And opens up reasoning to GPU-poor researchers 🚀 Read the full paper here 👉 https://huggingface.co/papers/2502.03387

View all activity

Organizations

None yet

FlipTip's activity

New activity in Nexusflow/Athene-70B 8 months ago

Training Data?

#8 opened 8 months ago by

New activity in LiteLLMs/Phi-3-small-8k-instruct-GGUF 8 months ago

🚩 Report: Spam

#3 opened 8 months ago by

New activity in huggingchat/chat-ui 11 months ago

[TOOLS] Community Discussion

#455 opened 11 months ago by

Add vision capabilities.

#443 opened 11 months ago by

Llama 3 120B?

#439 opened 11 months ago by

New activity in huggingchat/chat-ui about 1 year ago

Add MPT-7B-Chat to the models to chose from

#180 opened almost 2 years ago by

System prompts that can be saved to a list (custom characters)

#316 opened over 1 year ago by

New activity in google/sdxl over 1 year ago

A tamale food cart in front of a Japanese Castle

#1025 opened over 1 year ago by

New activity in stabilityai/stable-diffusion over 2 years ago

santa claus on motorcycle in art painting style

#7693 opened over 2 years ago by

santa claus on motorcycle in art painting style

#7689 opened over 2 years ago by