Not So Sweet Candy Data (Untidy Cleaning/EDA)
By: Steven Rothaus
Tags: Candy, Information Science, Info3402s19ma3, Python, Data Science

The findings once it was clean?

To being my EDA process I utilized my new clean and concise Candy Hierarchy data frame to look at USA participants and explore their favorite/least favorite candies. To start my exploratory process I created specific data frames that focused on particular groups from the United States, doing so allow me to uncover certain trends of specific users groups. I created clean data frames separating male respondents from female, California residents from Colorado’s, people who saw blue/black dress versus white/gold, and participants who enjoyed raisins.

EDA Sectional Data Frames

I started my EDA by looking at the male versus female trends or differences. I used a describe function calling in objects and categories from the data frame to gather analysis insights. This exposes total submission counts, unique responses, the top most common response, and the frequency of that top response. Throughout this candy survey there were 258 male participants with only 132 females which is why it was appropriate to separate and explore both sides. From the chart I can conclude males from California don’t go trick-or-treating, majority of survey respondents were 50 years old, they enjoy the rich chocolate candies like 100 grand bar, Cadbury Creme Eggs, and Caramellos, and dislike other cheap compressed sugar based candies like Mary Janes, and Candy Corn. On the other side we see females from California also don’t go out trick-or-treating, users common age was 48, 2 younger than majority of male participants. Surprisingly the candy preferences between female and male are almost identical besides the female ‘despair’ ranking on Black Jacks compared to males ‘meh’ response. I began to think maybe the majority of California users were skewing the results showing what candy California people like more than the separation of genders. If I had the time to randomly select respondents to limit the survey with the same amount of users from each state this could have been even more effective.

Male Vs. Female Candy Trends

Since I got a clear idea of the California candy users and their preferences I wanted to explore what Colorados results were. Colorado has underwhelming participants with 6 males and 1 labeled other but enough to generate the trends data. Colorado participants were among the younger crowd containing 37 year olds compared to California 42 year old crowd. There were differences between candy preferences of California users and Colorado’s. Colorado’s users enjoy 100 Grand Bars whereas California residents think they are meh. Other results are comparable but it was interesting to see the overall majority of people enjoy Cadbury Creme Eggs, and Caramellos. I believe this is a consistent trend because those candies are among the tastier, richer production chocolates. Getting into the more bizarre comparisons of this EDA I started to focus on users who saw different colors of the same dress. Of the Colorado and California survey participants both majorities saw the dress as White and Gold.

Colorado Vs. California Candy Trends

Separating the users who saw the dress as one color versus the other I was able to explore deeper on if there were any interesting candy preference similarities or differences. Out of all the users 1081 saw the dress White and Gold and 635 say its Blue and Black, 59% of people think the dress is White and Gold. Surprisingly there were no candy preference differences between the two groups, weather this is coincidence or true it was interesting there was such a lack of differentiation. I thought that maybe different age ranges see different colors making the dress so I plotted the users age and who saw what color dress. The plot shows that the younger users 14–30 saw blue and black whereas 57–68 saw white and gold. Since there are inconsistencies across other age results it is hard to conclude that certain age groups are bound to see the dress one specific color but the findings are interesting.