Package: edahelper
EDAhelperTools to make EDA easier!AboutThis package is aimed at making the EDA process more effective. Basically, we found there were tons of repetitive work when getting a glimpse of the data set. To stop wasting time in repeating procedures, our team came up with the idea to develop a toolkit that includes the following functions:Clean the data and replace missing values by using the method preferred.Provide the description of the data such as the distribution of each column of the data.Give the correlation plot between different numeric columns automatically.Combine the plots and make them suitable for the report.ContributorsRowan SivanandamSteven LeungVera CuiJennifer HoangFeature specificationspreprocess(path, method=None, fill_value=None, read_func=pd.read_csv, **kwarg):The function is to preprocess data in txt or csv by dealing with missing values. There are 5 imputation methods provided (None, 'most_frequent', 'mean', 'median', 'constant'). Finally, it will return the processed data as pandas.DataFrame.column_stats(data, column1, column2 = None, column3 = None, column4 = None):The function is to obtain summary statistics of column(s) including count, mean, median, mode, Q1, Q3, variance, standard deviation, correlation. Finally, it will return summary table detailing all statistics and correlations between chosen columns.plot_histogram(data, columns=["all"], num_bins=30): :The function is to create histograms for numerical features within a dataframe using Altair. Finally, it will return an Altair plot for each specified continuous feature.numeric_plots(df):The function takes a dataframes and plot the possible pairs of the numeric columns using Altair, creating a matrix of correlation plots.Related projectsSurely, EDA is not a new topic to data scientists. There are quite a few packages doing similar work on PyPI. However, most of them only include limited functions like just providing descriptive statistics. Our proposal is more of a one-in-all toolkit for EDA. Below is a list of sister-projects.auto-eda: It is an automatic script that generating information in the dataset.easy-eda: Exploratory Data Analysis.quick-eda: Important dataframe statistics with a single command.eda-report: A simple program to automate exploratory data analysis and reporting.InstallationYou can also use Git to clone the repository from GitHub to install the latest development version:$gitclonehttps://github.com/UBC-MDS/EDAhelper.git
$cddist
$pipinstallEDAhelper-3.0.0-py3-none-any.whlor install fromPyPI:$pipinstalledahelperUsageExample usage:fromEDAhelperimportEDAhelperEDAhelper.preprocess('file_path')EDAhelper.column_stats(df,columns=('Date',PctPopulation', 'CrimeRatePerPop'))EDAhelper.plot_histogram(df,columns=['A','B'])EDAhelper.numeric_plot(df)ContributingInterested in contributing? Check out the contributing guidelines. Please note that this project is released with a Code of Conduct. By contributing to this project, you agree to abide by its terms.LicenseEDAhelperwas created by Rowan Sivanandam, Steven Leung, Vera Cui, Jennifer Hoang. It is licensed under the terms of the MIT license.CreditsEDAhelperwas created withcookiecutterand thepy-pkgs-cookiecuttertemplate.