Exploratory Data Analysis on Iris Dataset - GeeksforGeeks

17 Feb, 2022
In this article, we will discuss how to perform Exploratory Data Analysis on the Iris dataset. Before continuing with this article, we have used two terns i.e. EDA and Iris Dataset. Let’s see a brief about these datasets.
Exploratory Data Analysis (EDA) is a technique to analyze data using some visual Techniques. With this technique, we can get detailed information about the statistical summary of the data. We will also be able to deal with the duplicates values, outliers, and also see some trends or patterns present in the dataset.
Now let’s see a brief about the Iris dataset.
If you are from a data science background you all must be familiar with the Iris Dataset. If you are not then don’t worry we will discuss this here.
Iris Dataset is considered as the Hello World for data science. It contains five columns namely – Petal Length, Petal Width, Sepal Length, Sepal Width, and Species Type. Iris is a flowering plant, the researchers have measured various features of the different iris flowers and recorded them digitally.
Note: This dataset can be downloaded from here.
You can download the Iris.csv file from the above link. Now we will use the Pandas library to load this CSV file, and we will convert it into the dataframe. read_csv() method is used to read CSV files.
Example:
Python3
import pandas as pd  # Reading the CSV filedf = pd.read_csv("Iris.csv")  # Printing top 5 rowsdf.head()
Output:
We will use the shape parameter to get the shape of the dataset.
Example:
Python3
df.shape
Output:
(150, 6)
We can see that the dataframe contains 6 columns and 150 rows.
Now, let’s also the columns and their data types. For this, we will use the info() method.
Example:
Python3
df.info()
Output:
We can see that only one column has categorical data and all the other columns are of the numeric type with non-Null entries.
Let’s get a quick statistical summary of the dataset using the describe() method. The describe() function applies basic statistical computations on the dataset like extreme values, count of data points standard deviation, etc. Any missing value or NaN value is automatically skipped. describe() function gives a good picture of the distribution of data.
Example:
Python3
df.describe()
Output:
We can see the count of each column along with their mean value, standard deviation, minimum and maximum values.
We will check if our data contains any missing values or not. Missing values can occur when no information is provided for one or more items or for a whole unit. We will use the isnull() method.
Example:
Python3
df.isnull().sum()
Output:
We can see that no column as any missing value.
Note: For more information, refer Working with Missing Data in Pandas.
Let’s see if our dataset contains any duplicates or not. Pandas drop_duplicates() method helps in removing duplicates from the data frame.
Example:
Python3
data = df.drop_duplicates(subset ="Species",)data
Output:
We can see that there are only three unique species. Let’s see if the dataset is balanced or not i.e. all the species contain equal amounts of rows or not. We will use the Series.value_counts() function. This function returns a Series containing counts of unique values. 
Example:
Python3
df.value_counts("Species")
Output:
We can see that all the species contain an equal amount of rows, so we should not delete any entries.
Our target column will be the Species column because at the end we will need the result according to the species only. Let’s see a countplot for species.
Note: We will use Matplotlib and Seaborn library for the data visualization. If you want to know about these modules refer to the articles – 
Matplotlib Tutorial
Python Seaborn Tutorial
Example:
Python3
# importing packagesimport seaborn as snsimport matplotlib.pyplot as plt    sns.countplot(x='Species', data=df, )plt.show()
Output:
We will see the relationship between the sepal length and sepal width and also between petal length and petal width.
Example 1: Comparing Sepal Length and Sepal Width
Python3
# importing packagesimport seaborn as snsimport matplotlib.pyplot as plt    sns.scatterplot(x='SepalLengthCm', y='SepalWidthCm',                hue='Species', data=df, )  # Placing Legend outside the Figureplt.legend(bbox_to_anchor=(1, 1), loc=2)  plt.show()
Output:
From the above plot, we can infer that – 
Species Setosa has smaller sepal lengths but larger sepal widths.
Versicolor Species lies in the middle of the other two species in terms of sepal length and width
Species Virginica has larger sepal lengths but smaller sepal widths.
Example 2: Comparing Petal Length and Petal Width
Python3
# importing packagesimport seaborn as snsimport matplotlib.pyplot as plt    sns.scatterplot(x='PetalLengthCm', y='PetalWidthCm',                hue='Species', data=df, )  # Placing Legend outside the Figureplt.legend(bbox_to_anchor=(1, 1), loc=2)  plt.show()
Output:
From the above plot, we can infer that – 
Species Setosa has smaller petal lengths and widths.
Versicolor Species lies in the middle of the other two species in terms of petal length and width
Species Virginica has the largest of petal lengths and widths.
Let’s plot all the column’s relationships using a pairplot. It can be used for multivariate analysis.
Example:
Python3
# importing packagesimport seaborn as snsimport matplotlib.pyplot as plt    sns.pairplot(df.drop(['Id'], axis = 1),              hue='Species', height=2)
Output:
We can see many types of relationships from this plot such as the species Seotsa has the smallest of petals widths and lengths. It also has the smallest sepal length but larger sepal widths. Such information can be gathered about any other species.
Histograms allow seeing the distribution of data for various columns. It can be used for uni as well as bi-variate analysis.
Example:
Python3
# importing packagesimport seaborn as snsimport matplotlib.pyplot as plt    fig, axes = plt.subplots(2, 2, figsize=(10,10))  axes[0,0].set_title("Sepal Length")axes[0,0].hist(df['SepalLengthCm'], bins=7)  axes[0,1].set_title("Sepal Width")axes[0,1].hist(df['SepalWidthCm'], bins=5);  axes[1,0].set_title("Petal Length")axes[1,0].hist(df['PetalLengthCm'], bins=6);  axes[1,1].set_title("Petal Width")axes[1,1].hist(df['PetalWidthCm'], bins=6);
Output:
From the above plot, we can see that – 
The highest frequency of the sepal length is between 30 and 35 which is between 5.5 and 6
The highest frequency of the sepal Width is around 70 which is between 3.0 and 3.5
The highest frequency of the petal length is around 50 which is between 1 and 2
The highest frequency of the petal width is between 40 and 50 which is between 0.0 and 0.5
Distplot is used basically for the univariant set of observations and visualizes it through a histogram i.e. only one observation and hence we choose one particular column of the dataset.
Example:
Python3
# importing packagesimport seaborn as snsimport matplotlib.pyplot as plt  plot = sns.FacetGrid(df, hue="Species")plot.map(sns.distplot, "SepalLengthCm").add_legend()  plot = sns.FacetGrid(df, hue="Species")plot.map(sns.distplot, "SepalWidthCm").add_legend()  plot = sns.FacetGrid(df, hue="Species")plot.map(sns.distplot, "PetalLengthCm").add_legend()  plot = sns.FacetGrid(df, hue="Species")plot.map(sns.distplot, "PetalWidthCm").add_legend()  plt.show()
Output:
From the above plots, we can see that – 
In the case of Sepal Length, there is a huge amount of overlapping.
In the case of Sepal Width also, there is a huge amount of overlapping.
In the case of Petal Length, there is a very little amount of overlapping.
In the case of Petal Width also, there is a very little amount of overlapping.
So we can use Petal Length and Petal Width as the classification feature.
Pandas dataframe.corr() is used to find the pairwise correlation of all columns in the dataframe. Any NA values are automatically excluded. For any non-numeric data type columns in the dataframe it is ignored.
Example:
Python3
data.corr(method='pearson')
Output:
The heatmap is a data visualization technique that is used to analyze the dataset as colors in two dimensions. Basically, it shows a correlation between all numerical variables in the dataset. In simpler terms, we can plot the above-found correlation using the heatmaps.
Example:
Python3
# importing packagesimport seaborn as snsimport matplotlib.pyplot as plt    sns.heatmap(df.corr(method='pearson').drop(  ['Id'], axis=1).drop(['Id'], axis=0),            annot = True);  plt.show()
Output:
From the above graph, we can see that –
Petal width and petal length have high correlations. 
Petal length and sepal width have good correlations.
Petal Width and Sepal length have good correlations.
We can use boxplots to see how the categorical value os distributed with other numerical values.
Example:
Python3
# importing packagesimport seaborn as snsimport matplotlib.pyplot as plt  def graph(y):    sns.boxplot(x="Species", y=y, data=df)  plt.figure(figsize=(10,10))      # Adding the subplot at the specified# grid positionplt.subplot(221)graph('SepalLengthCm')  plt.subplot(222)graph('SepalWidthCm')  plt.subplot(223)graph('PetalLengthCm')  plt.subplot(224)graph('PetalWidthCm')  plt.show()
Output:
From the above graph, we can see that – 
Species Setosa has the smallest features and less distributed with some outliers.
Species Versicolor has the average features.
Species Virginica has the highest features
An Outlier is a data-item/object that deviates significantly from the rest of the (so-called normal)objects. They can be caused by measurement or execution errors. The analysis for outlier detection is referred to as outlier mining. There are many ways to detect the outliers, and the removal process is the data frame same as removing a data item from the panda’s dataframe.
Let’s consider the iris dataset and let’s plot the boxplot for the SepalWidthCm column.
Example:
Python3
# importing packagesimport seaborn as snsimport matplotlib.pyplot as plt  # Load the datasetdf = pd.read_csv('Iris.csv')  sns.boxplot(x='SepalWidthCm', data=df)
Output:
In the above graph, the values above 4 and below 2 are acting as outliers.
For removing the outlier, one must follow the same process of removing an entry from the dataset using its exact position in the dataset because in all the above methods of detecting the outliers end result is the list of all those data items that satisfy the outlier definition according to the method used.
Example: We will detect the outliers using IQR and then we will remove them. We will also draw the boxplot to see if the outliers are removed or not.
Python3
# Importingimport sklearnfrom sklearn.datasets import load_bostonimport pandas as pdimport seaborn as sns  # Load the datasetdf = pd.read_csv('Iris.csv')  # IQRQ1 = np.percentile(df['SepalWidthCm'], 25,                interpolation = 'midpoint')  Q3 = np.percentile(df['SepalWidthCm'], 75,                interpolation = 'midpoint')IQR = Q3 - Q1  print("Old Shape: ", df.shape)  # Upper boundupper = np.where(df['SepalWidthCm'] >= (Q3+1.5*IQR))  # Lower boundlower = np.where(df['SepalWidthCm'] <= (Q1-1.5*IQR))  # Removing the Outliersdf.drop(upper[0], inplace = True)df.drop(lower[0], inplace = True)  print("New Shape: ", df.shape)  sns.boxplot(x='SepalWidthCm', data=df)
Output:
Note: for more information, refer Detect and Remove the Outliers using Python
sagar0719kumar
ML-EDA
Machine Learning
Python
Machine Learning
Writing code in comment?
Please use ide.geeksforgeeks.org,
generate link and share the link here.
Comments
Old Comments
Difference between Informed and Uninformed Search in AI
Deploy Machine Learning Model using Flask
Support Vector Machine Algorithm
Types of Environments in AI
k-nearest neighbor algorithm in Python
Read JSON file using Python
Adding new column to existing DataFrame in Pandas
Python map() function
How to get column names in Pandas dataframe