fabiochiu/medium-articles huggingface dataset:
A Father’s Journey
By: Lily Clark
Tags: Immigration, Family, Dads

One of the many frequent sayings that my dad says is “Cho Chúa lo.” The literal translation from Vietnamese to English is “for Jesus to worry.” This saying is used as an inside joke between my brothers and me because to us, it seems unreasonable to trust in something that seems so surreal. But, my dad tells me that the point of faith is believing without seeing.

My family comes from a very religious background of Catholicism. One of the abounding things that we believe in is that we are able to live in a country with so many opportunities on account of God. My dad always thanks God for the blessing of being able to bring his family and make a living in the United States of America. When my dad escaped from Vietnam to go to the U.S, he did not have it easy; he went through many hardships. However, his strong faith in God allowed him to persevere and make it to America.

Out of his seven siblings, my dad was the last one to come to America. He tried on three different occasions to escape from Vietnam, but he was caught and arrested all three times. Although he heard about the many fortunes in America, he decided to stay back in Vietnam to take care of his mother. However, due to him coming late to America, his chances of success were shortened. His brother and sisters had already started businesses and had a decent foundation of English. Unfortunately, he did not have the chance to finish school either or startup with school again in the U.S, therefore his English was poor. He was limited in his speech which made it harder for him to find stable jobs. Before he started his own handyman business, he worked for his sister’s market and as a supermarket butcher. None of his jobs are easygoing and require a lot of hard labor. But, he would never change it for the world.

He married my mom in 1990 and had their first child, Hilton, in 1991. For around 3 years, my dad lived across the world from his family. My dad lived in Orange County, California while my mom and brother lived in Saigon, Vietnam. He would often send money to Vietnam in order to provide my brother with good nutrients and clothing. He did not have it easy and sometimes struggled to bring food to the table. Still, he never stopped believing and continued to work hard to bring his family over to the U.S.

Compared to others, my father may not look successful, but he did his absolute best to provide his three children the opportunity of success in the future. He sacrificed so much just to give a better life for his kids. He often tells me to focus on school in order to not turn out like him. However, I would be happy with myself if I become even a little bit of what he is. He would do anything for family and I believe that is one of the many reasons why immigrants want to come over. They want a more promising future for their loved ones, just like my dad.
DAD Monthly Report 2021–6
Tags: Dad, Nft, Decentralization, Advertising, Blockchain

Development

Updated DAD-go-crypto to v1.0.4;

Checked transaction size in deserialization;

Fixed error handle in VM reader;

Cli prints detailed error information when a transaction sending error occurs;

Fixed Committer message for skipped broadcasting;

Product & DApp

Combining characteristics of the Klaytn public chain to design the DAD NFT Marketplace. 90% completed.

Market & PR

To expand DAD Chain’s global reach, DAD has launched a recruitment program for global brand ambassadors. Promote DAD on Twitter, Reddit, YouTube, TikTok, and other social media platforms for a chance to earn $DAD.

Interested in helping DAD grow? Send a message to contact@dad.one with the subject line “DAD Ambassador Invite” and include a self-introduction, your Telegram number, and social media profiles. A member of the DAD team will contact you upon review. We look forward to hearing from you.

개발 진척

DAD-go-crypto v1.0.4 업데이트 내용;

역직렬화 시 트랜젝션 크기를 확인;

VM 리더 조작 오류 수정;

트랜젝션 전송 오류 발생 시 자동으로 오류 세부 정보를 송출;

건너뛴 브로드캐스팅에 대한 커미터 메시지 수정;

제품 & DApp

클레이튼의 퍼블릭 체인의 특징과 결합해 DAD NFT 마켓 플레이스를 설계했으며, 현재 90% 완료됨.

마케팅 & PR

DAD 체인의 세계적 영향력을 확장하기 위해, DAD가 글로벌 브랜드 대사 모집 플랜을 진행 중입니다. 트위터, 레딧, 유튜브, 틱톡 등 플랫폼에서 DAD를 홍보해주시면, $DAD를 드립니다. 만약 흥미가 있으시다면 DAD와 함께 성장할 수 있는 기회를 놓치지 마세요. 제목을 DAD Ambassador Invite로 해주신 뒤에 contact@dad.one으로 자기소개, 텔레그램 계정, SNS 계정을 보내주세요. DAD 팀이 간단한 검토 후에 연락드리겠습니다. 많은 참가 부탁드립니다

Follow us on social media
Let me tell you about my dad
By: Brady Vardeman
Tags: Family, Fathers Day, Dads

My father got married eight days ago. I had the honor of being his “best man” — my sister was also in the wedding party and presumably dubbed his “best woman” — but didn’t make a speech at the reception.

It was for a myriad of reasons. Firstly, no one outside of the bride and groom spoke, so I wasn’t going to be “that guy.” Secondly, I’m terrified of speaking in public.

But my dad deserves to know how much he means to me, especially on Father’s Day, especially after the year we’ve had.

In his own words, my father has “gone from being in the game to standing on the sidelines” of his children’s lives lately. He’s watched both me and my sister make decisions — sometimes poor, sometimes not — and supported us the entire way. And the grace with which he’s done so is unparalleled.

Take, for instance, my trek to Denver. I moved on my father’s birthday. Literally, the day of. Circumstances dictated I move on or near the beginning of the month, but I was determined to stay at least until his birthday dinner — March 3, the night before I set off. I asked his forgiveness and didn’t expect him to see me off when I left.

The morning of March 4, however, I emerged from my house to find my dad scraping snow and ice from my windshield, eager to see me venture out on my own. It was 5:37 a.m. and nine degrees outside.

I don’t know why I expected anything else.
My Dad
By: Saige Avery
Tags: Dads, Family, Golf

Like many girls out there, my dad is my hero and always will be. I’ve always wanted to be like my dad since I was little. He wore his hat backward, I wore mine the same way. He was a professional golfer, I took up golf and played in college. The connection my dad and I had grew stronger by taking up a sport that he loved so much.

Since I was 2 my dad used to take me to work with him at the golf course. While he would be teaching lessons and giving instructions, I used the practice facility as my playground. The bunkers were my sandbox and the hitting mats were my jungle gym. My dad’s coworkers got to know me well and one of them even made me a set of clubs. They were far too big and stood taller than I did, but that didn’t stop me from carrying them around.

Once the workday was over, my dad would sit me on his lap in the ball picker at the range and we would drive around and pick up every ball. He would then spend the last hour of sunlight teaching me how to swing a golf club.

After my dad decided to retire from being a golf professional, I stopped playing. I would occasionally go to the course with him when he would go, but it was nothing serious. It wasn’t until the year before my freshman year of high school that my dad and I started playing a lot of golf together.

The summer before my freshman year, he would bring me to the range early in the morning and give me a lesson. We would play a round of golf and then he would go to work. I would spend the rest of the day at the course hitting balls until my hands blistered, trying to get good enough to beat him. After work he would come back to the course, we would play another round, and we would play for a quarter a hole. If I won a hole, I paid him, if he won a hole he would pay me and so on.

I started off my summer in debt to my dad, and by doing this he pushed me to work harder and to get better. Eventually, I started beating him on some holes and started to win some of my quarters back. However, it wasn’t until the night before school started that I finally beat him.

I expected his competitive side to come out and for him to be disappointed that he lost, but instead he was happier losing than I’ve ever seen him look from winning. He was so proud that I worked hard and finally achieved my goals.

My dad and I continue to play many rounds of golf over the summers, and sometimes even still play for quarters. Sometimes he still beats me, sometimes I beat him, but nothing will beat the time we spend together and the connection we were able to build through a sport.
Why is my Child so Thin? · Dr Dad
Tags: Moms, Dads, Health, Children, Kids

If you are one such parent who constantly overthinks about their child’s weight, then you must be feeling very stressed if your child appears to be thin. Your child could be skinny just because you were skinny yourself as a young child. Often, low weight in kids shouldn’t be a very serious cause of concern and you may cut them some slack. This may not satisfy your worries and for this reason, we’re here with some answers that you might need to know.

If your child was born a premature baby, then the chances of him or her growing up to be a skinny child increases by several folds.

The most common reason for your child being visibly skinny is the inadequate intake of nutritious and well-balanced food.

You may not pin this to your child’s picky eating habits because there can be several internal reasons that are preventing proper absorption of nutrients in his body resulting in him losing all his body weight.

Sometimes, if your child suffers from ADHD, he may not have a good appetite for food. Health conditions such as food allergies from certain kinds of foods may also trigger a suppressed appetite in your child.

If your child suffers from an upset stomach very often, then it might signify that your kid has a gastrointestinal tract infection. This might stop your child from eating any food items and gaining the right weight.

If your child takes active participation in sports or energy exertion activities, then it is only normal that he won’t gain any extra weight than normal for his/her age. Still, if you observe that your child is constantly losing weight and is appearing to be fatigued or unhealthy, then you must take him to a pediatrician immediately.

—

Note: The information contained in these topics is not intended nor implied to be a substitute for professional medical advice, it is provided for educational purposes only. You assume full responsibility for how you choose to use this information. Always seek the advice of your physician or another qualified healthcare provider before starting any new treatment or discontinuing an existing treatment. Talk with your healthcare provider about any questions you may have regarding a medical condition. Nothing contained in these topics is intended to be used for medical diagnosis or treatment.
What is the NHS Pregnancy journey like? · Dr Dad
Tags: Moms, Dads, Baby, Parenting, Kids

Pregnancy is an important part of every woman’s life. Right from the day you conceive till the day you deliver your baby, the entire journey is quite memorable. But doctor’s appointments every month could be challenging, this is why the NHS has designed a pregnancy journey to make all the doctor’s visits easy and convenient. The entire journey is broken into several steps for easier comprehension.

The first antenatal appointment is set with a midwife.

Pregnant women visit the midwife between 6 to 12 weeks from the time they have conceived.

This appointment creates a patient-medical professional relationship between you and the midwife.

You will be asked in detail about your health, allergies, medical condition, and lifestyle.

Knowing your daily lifestyle by the midwife would allow changes in your daily life to make the entire pregnancy much healthier, safer, and convenient.

Knowing the details about your medical history will also allow the midwife to know about any possible complications that you might come across during your pregnancy.

The medical professionals will keep you constantly updated on the well-being of you and your baby.

You will be guided on the different birth plans by the time you are around 36 weeks pregnant.

The risk assessment helps the midwife to rule out any possible events that you be a problem later.

You can choose the option which best suits you if the risk assessment results come back as normal and uneventful.

Women with low risk can have their baby at home, but those who have high risk need their baby delivered by an obstetrician.

NHS pregnancy is designed to guide you through every step of the way when you are pregnant. They have highly trained professionals and medical staff will experience.
Why is my Child Not Eating? · Dr Dad
Tags: Moms, Dads, Parents, Children, Kids

A child refusing to eat is a phenomenon that every mother has gone through at some point in time. This can get too frustrating for the caregiver and can force them into having anger outbursts and the child to have emotional meltdowns. You might be wondering why this actually happens and how you can overcome this and get your baby to have proper meals. Don’t worry yourself out because we have all the answers that you want.

It isn’t always the norm that your child will throw a tantrum at mealtimes just because they are picky-eaters. There can be a lot of other reasons for your child to not eat the food that you serve him.

These reasons can be about them not feeling well, feeling that the food quantity is a lot, feeling bored and wanting to play, feeling tired, or just not feeling hungry enough.

If you keep pressuring your child to eat, chances are that their appetite is going to decrease all the more. If you keep disregarding their feelings, then it might trigger them into pushing the food away.

Some boundaries need to be set. If you see that your child is feeling uncomfortable because of the constant forcing and punishing, then stop immediately.

Give them enough space to choose what they want to eat and when they want to eat it.

The authority to make their own meals as you lay out the ingredients in front of them can get them more invested in the process of eating.

It is a proven fact that children aged between 2 to 5 years will refuse to eat food every time you offer them. As their parent, you must remain calm and handle them with utmost care while giving them enough space.

—

Note: The information contained in these topics is not intended nor implied to be a substitute for professional medical advice, it is provided for educational purposes only. You assume full responsibility for how you choose to use this information. Always seek the advice of your physician or another qualified healthcare provider before starting any new treatment or discontinuing an existing treatment. Talk with your healthcare provider about any questions you may have regarding a medical condition. Nothing contained in these topics is intended to be used for medical diagnosis or treatment.
How much Folic Acid do you need to have? · Dr Dad
Tags: Moms, Dads, Pregnancy, Parenting, Kids

How much Folic Acid do you need to have? · Dr Dad Parenthood May 12·2 min read

Also known as Folate, folic acid was formerly known as folacin. It is an important vitamin B that helps in efficient metabolism and cell growth in general, but it is even more important for pregnant women. This guide on Folic acid covers everything that pregnant women should be aware of. Right from the daily dosage to foods rich in folic acids, everything you need to know about folic acids is in this guide.

Pregnant women are given folic acid supplements because it significantly decreases the chances of their baby having any birth defects in the brain or spinal cord.

Studies have also shown that consuming folic acid supplements while being pregnant reduces the chances of preeclampsia and early labor.

It also helps to treat anemia among other disorders.

Folic acid deficiencies cause digestive disorders, kidney and liver diseases in people.

Pregnant women are advised to take a folic dosage of around 600 mg per day.

Breastfeeding mothers need a folic acid dosage of around 500 mg per day.

Spinach, broccoli, lettuce, and other leafy vegetables are good sources of folate.

Beans, pulses, and lentils are rich in folic acid too.

Among fruits, you can find a good source of folate in bananas, lemons, and melons.

Packaged and processed ready-to-eat foods like loaves of bread, jams, cereals also contain folic acid.

There are no notable side effects of consuming folic acid supplements.

Rather they come with a lot of benefits.

Conclusion

If you are pregnant, then make sure you consume enough folic acid through various foods and supplements to make sure your baby has no birth defects. It will also ensure that you have a good amount of blood to support you and your baby.
The Potential Cost of Impatience
By: Mark Farrar
Tags: Impatience, Add, Internet, Self, Wasting Time

Impatience combined with slow Internet speeds is a dangerous combination.

This is what happens all too frequently:

I navigate to a web page I want or need to visit. It takes ages to display, often because of the many ads and scripts that must also be loaded, over and above the content I actually want to read. I therefore click to another browser or tab to do something else while the original page loads. I become engrossed in that new site. I completely forget about the page I originally went to.

If I weren’t so impatient or my Internet speed were fast enough to load a page, with all of its associated junk, much more quickly, I doubt I’d end up in that situation.

But I’m lucky if my download speeds are much higher than 4 Mbps, which is simply not high enough for today’s Internet.

If the original tab were merely an article I wanted to read for my own entertainment or education, then no harm done. The page will still be open, and I’ll probably find it again later on.

On the other hand, if that tab is something I need to take action on, and I forget about it, then I might be in trouble. So far, I’ve come close but been lucky, but one day, I might forget to process an order or pay a bill, or who knows what?

There’s probably some ADD at play here too, not that I’ve ever been officially diagnosed with it. But I know how my brain works (most of the time).

I can do nothing about my Internet speed because I live in a remote rural area where I only have a single provider. The package I have is what they like to call their “best available”.

It’s ironic in a way. I go off and look at other pages while I’m waiting for the original one to load because I don’t like wasting time. But then I become distracted and often end up wasting more time than if I’d merely waited.

It’s also worth noting that how you define wasting time is incredibly subjective. I can easily break off from working on a story, even mid-sentence, to go and check email or Facebook and not worry about it. But waiting a few additional seconds for a web page to finish rendering is apparently too much for me, and I need to do something during that dead time.

I could “solve” this problem if I really feel the urge to do something else while I wait by using my phone, so the tab I’m waiting for is still visible on my laptop — not that this tackles the underlying issue.

But I know I wouldn’t have the patience to wait long enough to cure my impatience. 😃
When do you stop feeling sick? · Dr Dad
Tags: Moms, Dads, Parents, Parenting, Kids

The journey of pregnancy is quite adventurous. It is a beautiful phase of a women’s life, but it has its problems. Morning sickness is one of the major problems faced by a majority of pregnant women. While it starts with what seems likes an upset stomach, the uneasy feeling is here to stay for the next few weeks the least. But when do women stop feeling sick? How long does morning sickness last in women? Let’s find out.

It can start at motion sickness or seasickness, but if women are pregnant then there are higher chances of the nauseous symptoms to be a result of morning sickness and not motion or seasickness.

Pregnant women feel very severe aversion towards certain foods and anything that happens to have a strong smell.

Women also experience nausea after consuming food daily.

The majority of women experience morning sickness in the first trimester of their pregnancy.

It starts between 6 to 9 weeks of pregnancy.

Nauseous feeling and occasional vomiting are the most common symptoms of morning sickness.

The majority of women stop feeling sick at the start of 12 weeks of their pregnancy.

12 to 16 weeks is the period between which the symptoms of morning sickness generally subside.

Some women even experience nauseous feelings during the second trimester but the numbers are scarce.

But few women experience morning sickness throughout their pregnancy.

Pregnant women experience morning sickness up to the start of the second trimester. The specifics of how long it lasts varies from woman to woman. They can easily be managed with home remedies. you can consult your doctor to receive medicines if it gets any worse.
What is False Pregnancy and how to identify it? · Dr Dad
Tags: Moms, Dads, Pregnancy, Children, Parenting

What is False Pregnancy and how to identify it? · Dr Dad Parenthood Jul 26·3 min read

Pregnancy is considered to be one of the most anticipated moments in a woman’s life. Although many times there are false alarms like a late period, sore breasts and nausea, which makes a woman suspicious about being pregnant.

In some cases, these symptoms are more pronounced without an actual presence of a fetus. Symptoms like missed periods, growing abdomen, and even fetal movement, tricks the body to believe that it’s pregnant when it’s not. This phenomenon is known as False Pregnancy or Pseudocyesis.

In other words, Pseudocyesis occurs when a woman experiences pregnancy symptoms and believes she’s pregnant without actually carrying a child.

The reasons behind it

Doctors are trying to determine the causes of false pregnancy, there are a lot of theories revolving around it. Some doctors believe that this is due to psychological issues. There are three main psychological issues that can lead to phantom pregnancy.

Those are:

Fear or yearning of being pregnant: Some doctors believe that the longing or the fear of being pregnant tricks the body into thinking that it is carrying a child. These symptoms can be caused due to change in the endocrine system, which results in symptoms of pregnancy.

Emotional Trauma: Some doctors believe that the loss of a child, miscarriage, mental breakdown and infertility can cause trauma to the brain and tricks them into believing that they are pregnant. The extreme desire to have a child convinces them that they are pregnant.

Mental Trauma: Some professionals believe that poverty, a lack of education and childhood sexual abuse can lead the woman into believing that they are pregnant.

Some other medical conditions that can cause false pregnancy are:

Symptoms

False pregnancy has all the same symptoms as that of an actual pregnancy. Those symptoms are:

Irregular menstrual period

Swollen belly

Enlarged and tender breasts

Change in the nipples

Possible milk production

A feeling of fetal movements

Nausea and vomiting

Weight gain

Morning Sickness

Reduced appetite

Bloating

Labour pain

Diagnosis and treatment

There is no definite test to diagnose false pregnancy. The only way to know if a person is pregnant is to take an ultrasound and a pregnancy test. If both the tests come back negative and the woman still believes that she is pregnant, the patient will be diagnosed with false pregnancy.

There is no definite treatment for false pregnancy, the symptoms of false pregnancy will diminish when the patient finds out that they are not pregnant. In some cases, if the pregnancy is caused by psychological issues, therapy will be recommended to deal with the emotions and the trauma that led to false pregnancy.

If the symptoms are occurring due to some physical medical conditions. The doctor will treat the condition first. The symptoms will diminish on their own.

Source: Indiatimes
Welcome to Ask Kelly’s Dad.
By: Dear Kelly'S Dad
Tags: Dads, Advice, Advice and Opinion, Advice Column, Advice For Life

Welcome to Ask Kelly’s Dad. This is the very first, in hopefully many, entertaining series of questions and answers from Rich, Kelly’s Dad.

A bit about how this got started…

Hi, my name is Kelly! I am helping my dad find something fun and useful to do with his time, as he is retired. The man loves giving advice and I figured he could help many people with his vast array of knowledge. So I went to Facebook and invited my connects to…

ASK MY DAD!

“My dad is retired. He is bored. He is VERY smart. He gives GREAT advice. He needs something to do. So I am asking you to come to him with your questions. ⭐️He is a dad. A grandad.

⭐️He ran a 100 million per year division for a national homebuilder for 400 homes per year.

He was in construction for over 35 years (including 10 years in remodeling).

⭐️He was an excellent manager and leader.

⭐️He also has a degree in Psychology so that is fun.

⭐️Companies used to pay him over $500 per hour for consulting…But then he got bored (he does that sometimes…The life of a retired dad) He gives great business, management, leadership and life advice…And he gives good dad advice. Give me your questions and I will make him give you answers…I can’t guarantee you will like his answers but it will help me to entertain him for a bit, perhaps…”

So far we have had many wonderful questions and my dad is really enjoying answering them. I am the tech person so I handle the blog, but he is the real brains of the operation and he tries to answer all the questions. He just won’t answer questions about me, his daughter. Because I won’t let him

We plan on using this blog as a place to share the questions and the responses. If you have a question for my dad you can email Dear Kelly’s Dad at DearKellysDad@gmail.com.

If you don’t want to sign off as your own name that is totally fine but try to “Dear Abby it” with a fun name of your choosing.

Stay tuned because we will be sharing the questions and answers here soon! Be sure to subscribe!
Hello World of Data Visualization.
By: Yash Awaghate
Tags: Data Science, Haberman, Exploratory Data Analysis, Data Visualisation, Data Visualization

The history of Data Science or I must say Data Visualisation travels back into the summers of 1854. This was when Dr.John Snow was very convinced upon his research that the deadly outbreak of cholera had some connection with the water that people drank. He Visualized the data he had been collecting about the deaths and mapped it to a drinking source.

This is my first data visualization project that demonstrates how we can explore the data using some very basic plotting techniques and probability.

The Data used here is from a stud that was conducted between 1958 and 1970 on patients who were suffering from breast cancer and had undergone surgery.

Importing and looking at the first few rows and columns.

This shows us that there are 305 observations that were recorded during the study. The data contains 4 columns. The column heading refer to different variables such as

1st column-represents the age of the patient. The 2nd column represents the year of operation in the 1900s. The 3rd column represents the number of positive axillary nodes detected. The 4th column represents the status of the patient.

Clearly, the column headings are not convenient to use and hence first we will change it according to our convenience and then we will try to visualize the data.

We changed column names.

Before we begin with visualization, we would like to know the number of values the status column has. i.e the different number of classes that we have that are needed to be classified.

Values of the Status column.

We conclude here that the dataset we are using is not uniform i.e the value count of the Status variables are a bit biased towards 1.

Here 1 states that the patient survived 5 years or longer and 2 states that the patient died within 5 years of operation.

Now, we can begin with our visualization part. We first try out Univariate Analysis and see we any of the plots tell us some story.

Univariate Analysis
Exploratory data analysis: Data characteristics and visualizations
By: Lavanya Gaur
Tags: Heartbeat, Machine Learning, Exploratory Data Analysis, Data Science For Ml, Data Visualization

The distplot() function is used to plot the distribution plot of the petal_length of various species. Blue color represents the histograms of the petal_length of Setosa flower, and so on. The y-axis represents the counts/number of points that exist in a small window/interval on the x-axis, which means given a point/region on the x-axis, the height of the histogram represents how many points exist in the small window for that particular value of petal_length .

The greater the height of the histogram (denser is the region between a given interval), the more the species found correspond to that value of the petal_length . The above plot, therefore, is also called a density plot. The curved lines above, made by smoothing the histograms (using KDE), are the PDF (Probability Density Functions).

Conclusions:

if petal_length is ≤ 2, species is Setosa.

is ≤ 2, species is Setosa. if petal_length is >2 and petal_length is ≤4.7 (threshold), then species is Versicolor.

is >2 and is ≤4.7 (threshold), then species is Versicolor. if petal_length is ≥4.7, then species is Virginica.

is ≥4.7, then species is Virginica. This shows us that univariate analysis using petal_length can be a helpful feature in classifying the species. Using just one feature, we can build a simple “model” using if/else statements.

Note: I’ve chosen 4.7 as a threshold and not 5 because if we have a flower whose petal_length is ≤4.7, the chances of the flower species being Versicolor is higher than Virginica.

You can also complete the univariate analysis using petal_width , sepal_length , and sepal_width , but you’ll probably come to the conclusion that petal_length is a better predictive feature than all of these mentioned above 😅.

The limitation of PDF is that we cannot view charts or statistics on them. For instance, we cannot say what percentage of Versicolor points/species have a petal_length of less than 5.

And for this reason, we use CDF (Cumulative Distribution Function).

CDF (Cumulative Distribution Function)

The cumulative distribution function (CDF) calculates the cumulative probability for a given x-value. We can use CDF to determine the probability that a random observation that’s taken from the population will be less than or equal to a certain value.
Predicting Red Wine Quality- Using Machine Learning Model
By: Nivyasree Avula
Tags: Neural Networks, Logistic Regression, Scikit Learn, Machine Learning, Exploratory Data Analysis

Predicting Red Wine Quality- Using Machine Learning Model

I think it is worth tasting it.

Do you know there are 2 types of wine — White wine and Red Wine

You know Red wine helps to reduce “Depression”

Benefits:

· Red wine is high in resveratrol as it is made by using grapes and berries which offers various health benefits.

· Resveratrol may boost heart health, protect against some kinds of cancer like Lung, Colon, Breast, Prostate, and prevent some types of vision loss.

“Women should not drink more than one glass a day, and men, two glasses”

So, as of a sudden why I started talking about “RED WINE”? Because I have worked on a data set which measures the quality of red wine (link: https://www.openml.org/d/40691) collected from www.openML.org

Details of the dataset:

The dataset is related to red variants of the Portuguese “Vinho Verde” wine. For more details, consult [Web Link] or the reference [Cortez et al., 2009]. Due to privacy and logistic issues, only physicochemical (inputs) and sensory (the output) variables are available (e.g. there is no data about grape types, wine brand, wine selling price, etc.). These datasets can be viewed as classification or regression tasks. The classes are ordered and not balanced (e.g. there are many more normal wines than excellent or poor ones). We are not sure if all input variables are relevant.

So let’s see the Attributes:

OK, now we know data let’s start with how to use the data:

First import Libraries

*Let’s load the data and eyeball it.
Use Pandas-Profiling on Jupyter Notebook ❤ EDA
By: Wajdi Hajji
Tags: Data Science, Anaconda, Python, Jupyter Notebook, Exploratory Data Analysis

Automated Exploratory Data Analysis EDA using Pandas Profiling in Jupyter

Pandas Profiling

Pandas_profiling displays descriptive overview of the data sets, by showing the number of variables, observations, total missing cells, duplicate rows, memory used and the variable types. Then, it generates detailed analysis for each variable, class distributions, interactions, correlations, missing values, samples and duplicated rows, which you can observe by clicking each tab.

# Install Pandas Profiling the last version 2.9.0 on Conda

conda install -c conda-forge pandas-profiling=2.9.0

Pandas_profiling extends the general data frame report using a single line of code: df.profile_report() which interactively describes the statistics, you can read it more here.

# Import the libraries

import pandas as pd

import numpy as np

from pandas_profiling import ProfileReport

# Read your data set

df = pd.read_csv(“titanic.csv”)

df.head(10)

show dataset ‘titanic.csv’

# Define your profile report:

profile = ProfileReport(df, title=’Pandas Profile Report’, html={‘style’:{‘full_width’:True}})

# Save your output file in html forma

profile.to_file(output_file=”titanic_report.html”)
Part 1: Beginners Guide to Natural Language Processing(NLP) on social media
By: A. Tayyip Saka
Tags: Data Science, NLP, Social Media, Exploratory Data Analysis, Facebook

EXPLORATORY DATA ANALYSIS

I firstly performed exploratory data analysis to understand this dataset. Firstly, I tried to learn summary of the dataset and then checked which columns includes NA values. In fact, dimension of original data is 500x10 and it includes texts and numeric values. In addition, there exists blank rows and NA values in news data.

fb_posts.shape

fb_posts.info()

fb_posts.describe()

fb_posts.isnull().sum()

Then, I converted NA values in “reaction” columns to 0 and gathered number of total reactions into one column which is labeled as “Engagement” by reducing dimensionality.

fb_posts['Engagement']=fb_posts[['like','love','wow','haha','sorry','anger']].sum(axis=1) fb_posts_new=fb_posts.drop(['like','love','wow','haha','sorry','anger'],axis=1)

Before calculating total engagement, I analyzed types of engagement and it is obviously shown that although there are several kind of engagement, people prefer clicking ‘like’ button. The main reason was that liking is still as easy ever. You’ll see the ‘like’ button on each post, but now if you tap and hold on it, the ‘like’ will expand to engender a number of emotions: love, haha, wow, sorry, and anger. Also, ‘sorry’ and ‘anger’ button indicate which content of news are more intensive(negative news)

Figure 2: Distribution of Engagement

I just wondered whether length of message has a significant effect on engagement score.That’s why, I calculated word counts of every post and used Pearson correlation to understand relation between two continuous variables.

fb_posts_new['word_count'] = fb_posts_new['message'].apply(lambda x: len(str(x).split(" ")))

fb_posts_new['word_count'].corr(fb_posts_new['Engagement'])*100

output:-9.86 %

It can be seen that there wasn’t strong negative correlation between length of message and engagement.

Apart from that, I looked at which hours people have interacted with our posts more by using “created_time” column.

fb_posts_new['created_time']=pd.to_datetime(fb_posts_new['created_time'])

d = pd.to_datetime(fb_posts_new['created_time'], format='%y-%m-%d %H:%M:%S.%f')

fb_posts_new['Time'] = d.dt.time

fb_posts_new['Hour'] = d.dt.hour

Then, I aggregated engagements based on hours and drew a line graph showing hour vs engagement. (Hours are based on UTC)

time_postengagement=fb_posts_new.groupby('Hour').sum()

time_postengagement=pd.DataFrame(time_postengagement)

sns.set()

time_postengagement.plot()

Figure 3: Hour vs Engagement

The line plot indicates that posts on Facebook which are published at 11 A.M or 5 P.M tend to be interacted by people more.
Data Exploration and the Agile Mindset
By: Fernando Tadao Ito
Tags: Exploratory Data Analysis, Data Science, Kpi

Picture this scenario: you, as a Data Scientist, receive a task that can be summarized in a single post-it. It has no clear end, no criteria of validation, and a short deadline:

Explore this dataset and figure out what we can extract from it. Due next sprint.

As a programmer, my first instinct is to grab some torches to burn this heretic nincompoop of a project. Agile methods usually require tasks in bite-sized portions, well-defined definitions of done and clear-cut metrics for objective metric measurement. Exploration tasks rarely have those.

Photo by Zab Consulting on Unsplash

The degree of freedom that this kind of task gives you can be a little threatening. You are dumped in a sea of information and need to find a single fish in the throes of the data lake.

And, unlike most Data Science tasks, you are left with no comparable metrics or feedback. How do you know what is a fish and if it is tasty compared to others if you never had one?

This is completely different from your run-of-the-mill stories that involve training a model to achieve an increase of a certain KPI or a better result than prior classifiers. You can adapt Scrum sprints to fit your training/validation/deployment process, change deliverables to experiment reports. There are many great articles in this exact matter, and I will defer to these here:

You can approach it with the heart of a researcher, manually inspecting your instances, creating visualizations and finding correlations between variables. This is the most fundamental building block of a successful Data Analyst, and a great step in order to understand your data.

But that's just the first step. The tricky parts are: how can you verify the correctness and impact of your analysis and subsequently prove their usefulness.
COVID-19 — Analysis & Visualization
By: Bacem Etteib
Tags: Data Science, Covid 19, Exploratory Data Analysis, Data Visualization, Insights

With nearly 800,000 people infected, almost 38,000 dead, and hundreds of millions in lockdown across the globe, the corona virus pandemic has brought the world to a standstill. In this article, we will shed the light on how we can use data science to help solve this crisis.

Article Outline

1.COVID19 Datasets

2.In-depth Analysis

3.Conclusion

1-Datasets

The corona virus outbreak and the disease it causes, COVID-19, has taken the world by storm. Newsrooms filter tons of information every day — articles, official briefings, expert interviews etc. In this fight, we are fortunate enough to live in a world where the value of data is well understood and there are many efforts underway in collecting and refining such sets. Everyday, hundreds of datasets are being uploaded to kaggle servers and thousands of notebooks are being created for the sake of extracting useful insights that may help overcome this crisis. Thus, this article is an attempt to show with data how similar and how different the spread of the pandemic in different countries is. As usual, if you want to practice the code, the notebook can be accessed from my Github.

2-Exploratory Data Analysis

Data Exploration is a tool to understand datasets better through summarizing, visualizing and becoming familiar with their important characteristics. We will follow a traditional pipeline called OSEMN during this section. OSEMN refers to:

O — Obtaining our data

Obtaining our data S — Scrubbing / Cleaning our data

— Scrubbing / Cleaning our data E — Exploring / Visualizing our data

Exploring / Visualizing our data M — Modeling our data will give us our predictive power as a wizard

Modeling our data will give us our predictive power as a wizard N — Interpreting our data

We will now see how the disease spread across the world. We will focus on the 3 main data sources that we have: Daily Reports, Containment Measures and a recent data file recorded on 30 March. We will focus both on absolute numbers and on increase ratios.

+COVID-19 containment measures: covers all measures of national significance intended to reduce COVID-19 transmission in all the world’s nations.

+COVID19 reports: has daily level information on the number of affected cases, deaths and recoveries.

+Recent data: contains new cases recorded on 30 March in 178 different countries.

Please keep in mind that the data is not gathered uniformly in every country and that every country has a different nuance in counting cases.

After importing necessary libraries, performing some cleaning on missing values by either dropping or imputing, it’s time to take a look using the head function!
Know Yourself More from Your WhatsApp Chat History
By: Iqbal Basyar
Tags: Data Science, Python, NLP, Chat, Exploratory Data Analysis

If we see carefully, in terms of the number of lines, party B replies with more line that party A. This might lead to a conclusion that Party A tends to sum up the reply in a whole line, while party B tends to send it in different lines.

The number of words and characters that party B sends on each reply is relatively lower than party A, meaning party A writes longer than party B. This is also supported by the duration variable, where party A has more duration in writing a reply than party B. So, party A writes longer than party B.

In the previous question, we know that party B takes a longer time to respond. I assume that’s because party B writes longer than A. In fact, A writes longer. And B even writes faster than A. So there’s no excuse for B haha.

5. Word Frequencies

One of the most popular ways to inspect word data is by visualizing its word frequency using a word cloud.

I remove several stopwords to remove the meaningless frequent word. Since I use Bahasa Indonesia on my chat, I use Elang to remove Indonesian stopwords. Now, using word cloud, take a look at these words

That’s a lot of “haha” and “wkwk”, Indonesian-considered laughing word. Using regex, I remove the laughing words and here’s the final word cloud.

I’m sorry if you don’t understand the words, It’s Indonesian, and it’s mostly non-formal words (who use formal words in chat anyway).

6. How often do we laugh

Previously I discovered that the laughing words take up a lot of my word cloud space. Are we that frequent in laughing (via text)? To find out, I extract all laughing words and compare its number with the number of lines to get the probability.
Exploratory Data Analysis(EDA) with PySpark on Databricks
By: Cao Yi
Tags: Data Science, Databricks, Visualization, Exploratory Data Analysis, Pyspark

EDA for continuous variables

The built-in function describe() is extremely helpful. It computes count, mean, stddev, min and max for the selected variables. For example:

df.select('var_0').describe().show()

However, when you calculate statistic values for multiple variables, this data frame showed will not be neat to check, like below:

Remember we talked about not using Pandas to do calculations before. However, we can still use it to display the result. Here, the describe() function which is built in the spark data frame has done the statistic values calculation. The computed summary table is not large in size. So we can use pandas to display it.

df.select('var_0','var_1','var_2','var_3','var_4','var_5','var_6','var_7','var_8','var_9','var_10','var_11','var_12','var_13','var_14').describe().toPandas()

Get the quantiles:

quantile = df.approxQuantile(['var_0'], [0.25, 0.5, 0.75], 0)

quantile_25 = quantile[0][0]

quantile_50 = quantile[0][1]

quantile_75 = quantile[0][2]

print('quantile_25: '+str(quantile_25))

print('quantile_50: '+str(quantile_50))

print('quantile_75: '+str(quantile_75)) '''

quantile_25: 8.4537

quantile_50: 10.5247

quantile_75: 12.7582

'''

Check the missings:

Introduce two functions to do the filter

# where

df.where(col("var_0").isNull()).count()

# filter

df.filter(col("var_0").isNull()).count()

These two are the same. According to spark documentation, “where” is an alias of “filter”.

Binning:

For continuous variables, sometimes we want to bin them and check those bins distribution. For example, in financial related data, we can bin FICO scores(normally range 650 to 850) into buckets. Each bucket has an interval of 25. like 650–675, 675–700, 700–725,…And check how many people in each bucket.

Now let’s use “var_0” to give an example for binning. From previous statistic values, we know “var_0” range from 0.41 to 20.31. So we create a list of 0 to 21, with an interval of 0.5.

Correlation:
COVID-19 Vaccination Progress Analysis through Data Storytelling
By: Nevil Sutaria
Tags: Storytelling With Data, Python, Data Analysis, Exploratory Data Analysis, Data Visualization

Exploratory Data Analysis and Visualization

We will initialize the Python packages, that we are going to use for data ingestion and visualization. We will configure the environment by setting the font size, figure size, face color, etc. Also, we would mostly use seaborn for our visualization.

Now we can begin working with our data by working on the objectives.

1. Which country is vaccinating its citizens the fastest?

For plotting, we need a set of values from the data to be arranged in a particular manner. It can be achieved by using methods like groupby(), max(), sort_values(), etc. Also, we will compare the first 10 countries for neat visualization. After arranging them we can plot them using seaborn built-in functions as shown below.

From the visualization below it is clear that Israel leads the world in terms of the number of doses per head of population, with more than 80 doses given for every 100 people.

2. Which country has the highest number of vaccinated people?

Let us find out the country having the most vaccinated people. For easy visualization, we will consider the top 10 countries from all. Here we have used matplotlib to plot the data, along with using the total vaccinations' series.

It is clear from the visualization below that the United States has the most vaccinated people around 60M.

3. What are the different categories of vaccines offered?

For finding different categories and understanding which vaccine is used widely, I curated the code as follows:

Pfizer tops the list of most-used COVID-19 vaccines in the world, followed by Mordema, and Oxford–AstraZeneca.

4. What are the different vaccines used by different countries?

In this particular objective, we are going to use the Plotly library to plot a 2-D map of the world. Here we have used iso_code for getting the location of a particular region/country. Also, the hover_name attribute is used for the creation of a dynamic chart so that when we hover over a particular country it shows the details of vaccines.

To have a look at the dynamic plot, please click here.