HPLT/HPLT2.0_cleaned
Viewer
•
Updated
•
2.17B
•
102k
•
17
AI & ML interests
Web as a corpus, Large Language Models, Machine Translation, Language Technologies, Natural Language Processing
Recent Activity
HPLT's activity
vmkhlv
updated
a
dataset
2 days ago
davanstrien
posted
an
update
4 days ago
Post
1415
I've created a v1 dataset (
davanstrien/reasoning-required) and model (
davanstrien/ModernBERT-based-Reasoning-Required) to help curate "wild text" data for generating reasoning examples beyond the usual code/math/science domains.
- I developed a "Reasoning Required" dataset with a 0-4 scoring system for reasoning complexity
- I used educational content from HuggingFaceFW/fineweb-edu, adding annotations for domains, reasoning types, and example questions
My approach enables a more efficient workflow: filter text with small models first, then use LLMs only on high-value content.
This significantly reduces computation costs while expanding reasoning dataset domain coverage.
- I developed a "Reasoning Required" dataset with a 0-4 scoring system for reasoning complexity
- I used educational content from HuggingFaceFW/fineweb-edu, adding annotations for domains, reasoning types, and example questions
My approach enables a more efficient workflow: filter text with small models first, then use LLMs only on high-value content.
This significantly reduces computation costs while expanding reasoning dataset domain coverage.
pinzhenchen
updated
a
collection
5 days ago
pinzhenchen
updated
a
model
5 days ago
pinzhenchen
published
a
model
5 days ago
pinzhenchen
updated
a
collection
5 days ago
pinzhenchen
updated
a
model
5 days ago
pinzhenchen
published
a
model
5 days ago
pinzhenchen
updated
a
collection
5 days ago
pinzhenchen
updated
a
model
5 days ago
pinzhenchen
published
a
model
5 days ago
pinzhenchen
updated
a
collection
5 days ago
pinzhenchen
updated
a
model
5 days ago
pinzhenchen
published
a
model
5 days ago
pinzhenchen
updated
a
collection
5 days ago
pinzhenchen
updated
a
model
5 days ago
pinzhenchen
published
a
model
5 days ago
pinzhenchen
updated
a
collection
5 days ago
pinzhenchen
updated
a
model
5 days ago