Package: dasy-ml
dasy-mlDaSy DataSynthesizer - Create synthetic data with desired statistical properties for machine learning research.Quick-Startpip install dasy-mlSimple Usagedasy for Classificationimportnumpyasnpimportmatplotlib.pyplotaspltfromdasy.synthesizers.gaussianimportGaussianSynthfromdasy.labelers.classification.centroidsimportCentroidsLabelerplt.clf()# 1. Define the problemdim=2# dimension of each inputclasses=2# number of classesn=100# number of data points# 2. Create synthetic input data Xsynth=GaussianSynth(dim=dim)X=synth.sample(n=n)# sample n dim-dimensional data points from Gaussian# 3. Assign labels ylabeler=CentroidsLabeler(classes=classes,dim=dim)# for 2 classes, this creates linearly separable labelsy=labeler.assign(X)# 4. Plotplt.scatter(X.T[0],X.T[1],c=y)plt.title('Synthetic Classification Problem')plt.tight_layout()plt.show()dasy for Regressionfromdasy.synthesizers.uniformimportUniformSynthfromdasy.labelers.regression.linearimportLinearRegressionLabelerplt.clf()# 1. Define the problemdim=1# dimension of each inputn=50# number of data points# 2. Create synthetic input data Xsynth=UniformSynth(dim=dim)X=synth.sample(n=n)# sample n dim-dimensional data points from Uniform distribution# 3. Assign continuous targets ylabeler=LinearRegressionLabeler(dim=dim)y=labeler.assign(X)# 4. Plotplt.scatter(X.T[0],y)plt.axline((0,labeler.b),slope=labeler.w,color='r')# plot the underlying line which generated the targetsplt.title('Synthetic Regression Problem')plt.tight_layout()plt.show()Developersgit clone https://github.com/bkestelman/dasy-ml
cd dasy-ml
pip install -e .
python -m unittestIntroductionWhen researching machine learning algorithms, we often want to know how they behave on data with specific properties. For example: linearly separable, correlated, isotropic, etc. This library aims to provide functionality to construct synthetic datasets with any desired statistical properties, so researchers can easily study how algorithms respond to different types of data.Why is this useful for machine learning research compared to using existing datasets?Existing datasets may lack certain statistical properties you want to test your algorithm against.You may not have enough information about where an existing dataset comes from. For example, is it IID?You may want to test against many different types of data.You may want to arbitrarily adjust the size of the dataset.Note: this is not a library for adding synthetic data to an existing dataset - there are already many other libraries that do this.ExamplesAbove, the input X data is simply sampled from a Gaussian centered at the origin. Then, the data is labeled by creating random centroids and labeling each point according to its nearest centroid (similar to the first step in k-means). On the left with only 2 classes, the classes are linearly separable. With 3 or more classes, they are no longer linearly separable and the boundaries essentially form a Voronoi diagram.DataSynthesizers and LabelersThe core of synthetic-data are DataSynthesizers and Labelers.DataSynthesizers sample inputs X from the feature-space.Labelers take inputs X and assign labels y to them.These are very general classes. The procedure for creating X typically involves sampling from some probability distribution. Assigning labels may be a deterministic or probabilistic function. Each x or y may be sampled independently or it may not be, for example if created by a Markov process.A DataSynthesizer may also assign labels directly to its own data if you want to couple the label distribution with the input distribution.Discussion of Kinds of DataIndependent vs. Non-Independent DataTime-Series DataData for Classification ProblemsDeterministic vs. Probabilistic LabelsIf for any given input x, the label must always be a specific value, then the labels are deterministic. In other words, the label y=f(x), where f is a pure function. Typically, y is encoded as a one-hot vector.On the other hand, if a given input x may be assigned different labels, then labels are probabilistic. Here, y is drawn from the possible classes according to some probability distribution p(x), representing the probability of each class for the given input.Theoretically, it is possible to achieve 100% accuracy on a deterministic classification problem. This is impossible in a probabilistic classification problem.Noisy LabelsLinearly Separable DataData for Regression Problems