How to get insights from our dataset without writing code?
Tags: datascience, machinelearning, serverless, beginners
Published: 2022-06-24 19:56:29


Data scientist spend most of their time (about 50% to 80%) cleaning, preparing and organizing data. 

![Time consuming for DS](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/etbg59lfklbsjegwx0ah.png)

There are many tools in the market to achieve this, however I'll show you one of the most powerful tools that I've ever seen.

Wellcome [AWS Glue DataBrew](https://aws.amazon.com/glue/features/databrew/)

## AWS Glue DataBrew

AWS Glue DataBrew is a new visual data preparation tool that makes it easy for data analysts and data scientists to clean and normalize data to prepare it for analytics and machine learning.

## Why is so powerful ?

Because, you can clean, prepare and organize your data at scale only paying per amount of information and time spending.


## Step by step using DataBrew to get insights

### Prerequisites
- AWS Account

### Create a bucket and upload your dataset

![New bucket](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3g8zlq054iv95t4vmg1h.png)
 
You can create a new bucket clicking [here](https://s3.console.aws.amazon.com/s3/bucket/create?region=us-east-1). 

Once you create the bucket, you must to upload a dataset: this is the dataset which I'm using for this demo. [Here](https://github.com/bluetarget-ai/dataset-examples/blob/main/drivers.csv)

### Set up the dataset on [DataBrew](https://us-east-
1.console.aws.amazon.com/databrew/home)

First we need to connect your Dataset to DataBrew

![Connect your dataset](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/gk79ccax9qhn85w9n97k.png)

Here, you have different kind of ways to connect to your dataset. For this demo, we use **Amazon S3**.
 
Now, you have to select your S3 Bucket (that you created before) and select the dataset.

![Select the dataset](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/b1vfafmuazb4kgj76i83.png)

After that, click on **Create**

### Run data profile


Once, you have your connection, select your dataset and click on **Run data profile**

![Run data profile](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/s2huv7rrmjk1p9xjxomt.png)

There your are going to see, differents options like, number of rows that you want run the job, output file, etc.

At the end of the form, you are going to see a section named **Permissions**

![Permission section](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/mvbymwmqjmlxhhrpya3j.png)

There you must to select, **Create new IAM role**, fill the role name and click on **Create and run job**

### Wait until the job finish

In the job section (Profile jobs), you'll see something like that: 

![Working](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3rnnn0krafj4n6688eni.png)
 
When the job finish, click on **View data profile** and you'll see something like that:

![Summary](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/774o3m1yvi8vl8lihn84.png)

Summary of the dataset and the correlation between variables

![Value distribution](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ah7th6scs5gxhurn4qhc.png)
 
Value distribution

![Columns summary](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/aca30rujwngmd9jimuot.png)

and columns summary!!


Well, there are much more insights that you can get with DataBrew, this is a short introduction.