Package: prelim-eda-helper
prelim_eda_helperThis package is a preliminary exploratory data analysis (EDA) tool to make useful feature EDA plots and provide relevant information to simplify an otherwise tedious EDA step of any data science project. Specifically this package allows users to target any two features, whether they are numeric or categorical, and create visualization plots supplemented with useful summary and test statistics.This package provides a streamlined and easy to use solution for basic EDA tasks that would otherwise require significant amount of coding to achieve. Similar packages can be found published onPyPisuch as the following:eda-vizQuickDAprelim_eda_helperenables user to write quick visualization queries. At the same time, as we understand visually strong effects on graphs are not necessarily statistically meaningful,prelim_eda_helperis designed to combine graphic visualizations with preliminary statistical test results. We aim to create a helper package to really help researchers to get a quick sense of how our data look like, without making charts and doing tests separately in earlier stages of projects. We believe the combination of graphical and statistical output is what makesprelim_eda_helpera unique yet handy helper package.To achive this goal,prelim_eda_helpercreates charts with the visualization libraryaltairand conducts statistical tests with'scipy'.UsageInstallation$pipinstallprelim_eda_helperinitialize_helperEnables plotting data sets with more than 5000 rows.initialize_helper()num_dist_by_catCreates a pair of plots showing the distribution of the numeric variable when grouped by the categorical variable. Output includes a histogram and boxplot. In addition, basic test statistics will be provided for user reference.fromprelim_eda_helperimportnum_dist_by_catnum_dist_by_cat(num='x',cat='group',data=data,title_hist='Distribution of X',title_boxplot='X Seperated by Group',lab_num='X',lab_cat='Group',num_on_x=True,stat=True)num_dist_scatterCreates a scatter plot given two numerical variables. The plot can provide regression trendline and include confidence interval bands. Spearman and Pearson's correlation will also be returned to aid the user to determining feature relationship.fromprelim_eda_helperimportnum_dist_scatternum_dist_scatter(num1='x',num2='y',data=data,title='Scatter plot with X and Y',stat=False,trend=None)cat_dist_heatmapCreates concatenated charts showing the heatmap of two categorical variables and a barchart for occurrance of these variables.fromprelim_eda_helperimportcat_dist_heatmapcat_dist_heatmap(cat_1='group1',cat_2='group2',data=data,title='How are Group1 and Group2 distributed?',lab_1='group1',lab_2='group2',heatmap=True,barchart=True)num_dist_summaryCreates a distribution plot of the given numeric variable and provides a statistical summary of the feature. In addition, the correlation values of the variable with other numeric features will be provided based on a given threshold.fromprelim_eda_helperimportnum_dist_summarynum_dist_summary(num='x',data=data,title='Distribution of X',lab='X',thresh_corr=0.0,stat=True)ContributingInterested in contributing? Check out the contributing guidelines. Please note that this project is released with a Code of Conduct. By contributing to this project, you agree to abide by its terms.Licenseprelim_eda_helperwas created by Mehwish Nabi, Morris Chan, Xinry LU, Austin Shih. It is licensed under the terms of the MIT license.Creditsprelim_eda_helperwas created withcookiecutterand thepy-pkgs-cookiecuttertemplate.