Richelriko
RichterDS
·
AI & ML interests
None yet
Recent Activity
reacted
to
Fizzarolli's
post
with 👍
18 days ago
Is anyone looking into some sort of decentralized/federated dataset generation or classification by humans instead of synthetically?
From my experience with trying models, a *lot* of modern finetunes are trained on what amounts to, in essence, GPT-4 generated slop that makes everything sound like a rip-off GPT-4 (refer to i.e. the Dolphin finetunes). I have a feeling that this is a lot of the reason people haven't been quite as successful as Meta's instruct tunes of Llama 3.
Organizations
None yet
models
None public yet
datasets
None public yet