BroCodeR/pic2x3D_CAD
0 Bytes
Just1n Tinter
BroCodeR
·
AI & ML interests
None yet
Recent Activity
published a bucket 6 days ago
BroCodeR/pic2x3D_CAD published a bucket 6 days ago
BroCodeR/stable-fast-3d-bucket liked a model over 2 years ago
epfl-llm/meditron-70bOrganizations
published 2
buckets 6 days ago
liked a
model over 2 years ago
liked a
Space over 2 years ago
upvoted a paper over 2 years ago
liked a
model over 2 years ago
reacted to vladbogo's post with ❤️ over 2 years ago
Post
Web Rephrase Augmented Pre-training (WRAP) enhances language model training efficiency by transforming documents into structured formats.
Key aspects:
* Utilizes an instruction-tuned model to rephrase web content into styles such as Wikipedia or Q/A, creating a blend of synthetic and real data for training.
* Demonstrated improvements of over 10% better perplexity, alongside more than 2% increase in zero-shot question-answering accuracy.
Congrats to the authors for their work!
Paper: Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling (2401.16380)
Key aspects:
* Utilizes an instruction-tuned model to rephrase web content into styles such as Wikipedia or Q/A, creating a blend of synthetic and real data for training.
* Demonstrated improvements of over 10% better perplexity, alongside more than 2% increase in zero-shot question-answering accuracy.
Congrats to the authors for their work!
Paper: Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling (2401.16380)
- 1 reply
commented a
paper over 2 years ago
upvoted a paper over 2 years ago
liked a
Space almost 3 years ago
upvoted a paper almost 3 years ago
liked 2
models over 3 years ago
liked a
Space over 3 years ago