Synthetic dataset generation techniques: generating custom sentence similarity data
•
11
Daniel van Strien PRO
davanstrien
AI & ML interests
Machine Learning Librarian
Articles
Organizations
Posts
16
Post
1600
How can we use open LLMs to create data for training sentence similarity models?
One of the most exciting use cases for LLMs is generating synthetic datasets that can be used to train non-LLM models. In the past, gathering enough data was one of the most significant barriers to training task-specific models. LLMs can potentially help in this area.
I've just written a new blog post on using meta-llama/Meta-Llama-3-70B-Instruct to generate synthetic similarity data based on the approach from Retrieving Texts based on Abstract Descriptions (2305.12517).
https://huggingface.co/blog/davanstrien/synthetic-similarity-datasets
One of the most exciting use cases for LLMs is generating synthetic datasets that can be used to train non-LLM models. In the past, gathering enough data was one of the most significant barriers to training task-specific models. LLMs can potentially help in this area.
I've just written a new blog post on using meta-llama/Meta-Llama-3-70B-Instruct to generate synthetic similarity data based on the approach from Retrieving Texts based on Abstract Descriptions (2305.12517).
https://huggingface.co/blog/davanstrien/synthetic-similarity-datasets
Post
1775
I've begun adding valuable blog posts on using/creating synthetic datasets to my curated list.
I am starting with a great post by @MoritzLaurer on utilizing an open LLM to generate data for training a specialized Roberta model.
Read the blog post: https://huggingface.co/blog/synthetic-data-save-costs
See the rest of the list: https://github.com/davanstrien/awesome-synthetic-datasets
I am starting with a great post by @MoritzLaurer on utilizing an open LLM to generate data for training a specialized Roberta model.
Read the blog post: https://huggingface.co/blog/synthetic-data-save-costs
See the rest of the list: https://github.com/davanstrien/awesome-synthetic-datasets
Collections
12
spaces
37
models
112
davanstrien/query-gen
Updated
•
6
davanstrien/LLama-3-dataset-tldr
Text Generation
•
Updated
•
6
davanstrien/LLama-3-dataset-tldr-gguf
Updated
•
129
davanstrien/dataset-tldr
Text Generation
•
Updated
•
4
davanstrien/testdpo
Text Generation
•
Updated
•
1
davanstrien/prompt_rater
Text Classification
•
Updated
•
1
davanstrien/prompt_ranker
Text Classification
•
Updated
•
2
davanstrien/faketransformer
Text Classification
•
Updated
davanstrien/flair
Updated
•
1
davanstrien/HaikuHermes-0.1-7B
Text Generation
•
Updated
•
9
•
4
datasets
222
davanstrien/similarity-dataset-sc2-8b
Viewer
•
Updated
•
1
davanstrien/similarity-dataset-test-code2
Viewer
•
Updated
davanstrien/similarity-dataset-test-code
Viewer
•
Updated
•
1
davanstrien/self-oss-instruct-sc2-exec-filter-50k-short
Viewer
•
Updated
•
36
davanstrien/similarity-dataset-test-sql
Viewer
•
Updated
davanstrien/similarity-dataset-test
Preview
•
Updated
davanstrien/query-gen
Viewer
•
Updated
•
2
davanstrien/dataset-tldr-preference
Viewer
•
Updated
•
3
davanstrien/notebooks_by_repo_type
Viewer
•
Updated
•
103
•
1
davanstrien/notebooks_by_user
Viewer
•
Updated
•
1
•
2