title: Synthetic Data Generator
short_description: Build datasets using natural language
emoji: 🧬
colorFrom: yellow
colorTo: pink
sdk: gradio
sdk_version: 4.44.1
app_file: app.py
pinned: true
license: apache-2.0
hf_oauth: true
hf_oauth_scopes:
- read-repos
- write-repos
- manage-repos
- inference-api
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
🧬 Synthetic Data Generator
Build datasets using natural language
This repository contains the code for the free Synthetic Data Generator app, which is hosted on the Hugging Face Hub.
How it works?
Distilabel Synthetic Data Generator is a tool that allows you to easily create high-quality datasets for training and fine-tuning language models. It leverages the power of distilabel and advanced language models to generate synthetic data tailored to your specific needs.
This tool simplifies the process of creating custom datasets, enabling you to:
- Define the characteristics of your desired application
- Generate system prompts and tasks automatically
- Create sample datasets for quick iteration
- Produce full-scale datasets with customizable parameters
- Push your generated datasets directly to the Hugging Face Hub
By using Distilabel Synthetic Data Generator, you can rapidly prototype and create datasets for, accelerating your AI development process.
Do you want to run this locally?
You can simply clone the repository and run it locally with:
pip install -r requirements.txt
python app.py
Note that you do need to have an HF_TOKEN that can make calls to the free serverless Hugging Face Inference Endpoints. You can get one here.
Do you need more control?
Each pipeline is based on a distilabel component, so you can easily run it locally or with other LLMs.
Check out the distilabel library for more information.