How we leveraged distilabel to create an Argilla 2.0 Chatbot
β’
32
Gabriel MartΓn BlΓ‘zquez
gabrielmbmb
AI & ML interests
ML Engineer
Recent Activity
updated
a dataset
6 days ago
gabrielmbmb/gsm8k-reasoning-paths-combined
upvoted
a
paper
6 days ago
Qwen2.5 Technical Report
Articles
Organizations
gabrielmbmb's activity
reacted to
anton-l's
post with π
5 days ago
Post
1974
Introducing ππ
π’π§πππππ‘: the best public math pre-training dataset with 50B+ tokens!
HuggingFaceTB/finemath
Math remains challenging for LLMs and by training on FineMath we see considerable gains over other math datasets, especially on GSM8K and MATH.
We build the dataset by:
π οΈ carefully extracting math data from Common Crawl;
π iteratively filtering and recalling high quality math pages using a classifier trained on synthetic annotations to identify math reasoning and deduction.
We conducted a series of ablations comparing the performance of Llama-3.2-3B-Base after continued pre-training on FineMath and observe notable gains compared to the baseline model and other public math datasets.
We hope this helps advance the performance of LLMs on math and reasoning! π
Weβre also releasing all the ablation models as well as the evaluation code.
HuggingFaceTB/finemath-6763fb8f71b6439b653482c2
HuggingFaceTB/finemath
Math remains challenging for LLMs and by training on FineMath we see considerable gains over other math datasets, especially on GSM8K and MATH.
We build the dataset by:
π οΈ carefully extracting math data from Common Crawl;
π iteratively filtering and recalling high quality math pages using a classifier trained on synthetic annotations to identify math reasoning and deduction.
We conducted a series of ablations comparing the performance of Llama-3.2-3B-Base after continued pre-training on FineMath and observe notable gains compared to the baseline model and other public math datasets.
We hope this helps advance the performance of LLMs on math and reasoning! π
Weβre also releasing all the ablation models as well as the evaluation code.
HuggingFaceTB/finemath-6763fb8f71b6439b653482c2
updated
a
dataset
6 days ago
upvoted
a
paper
6 days ago
liked
a
Space
6 days ago
liked
a
model
7 days ago
upvoted
a
paper
7 days ago
reacted to
burtenshaw's
post with π€β€οΈ
7 days ago
Post
2547
People are flexing their end of year stats, so I made this app to show hub stats in a tidy design!
Thanks @Ameeeee and @jfcalvo for the feature from Argilla!
burtenshaw/recap
Thanks @Ameeeee and @jfcalvo for the feature from Argilla!
burtenshaw/recap
- 1 reply
liked
a
dataset
7 days ago
updated
2
datasets
9 days ago
liked
a
Space
9 days ago
updated
2
datasets
10 days ago
upvoted
a
paper
10 days ago
updated
a
Space
10 days ago
updated
2
datasets
16 days ago