teleren/devto huggingface dataset:
Biggest Data Breaches of 2020
Tags: security, privacy
Published: 2020-11-16 18:22:37

A data breach can affect the reputation of a business and incur a lot of costly damage.

Data breaches can involve leakage of financial information such as credit card or bank details, personally identifiable information (PII), personal health information (PHI), intellectual property or any other sensitive information that ends up with an individual unauthorised to gain access to it.

The personal data of millions of users get leaked every year as a result of data breaches, and it remains to be one of the major security concerns for large corporations and smaller businesses.

According to a study conducted by the Ponemon Institute, the average total cost for a company as a result of a data breach is $3.86 million.

Failure to take proper measures to fix security issues can cause serious damage.

In today’s article, we’ll have a closer look at 2 of the biggest data breaches of 2020.

## Tetrad Data Breach

Security researchers at UpGuard were able to discover a publicly exposed cloud database from marketing analysis company Tetrad that included personal data and behavioural profiles of about 120 million Americans.

The collection of data sets provided detailed information about Americans based on where they live, what they buy, how much they spend, how long their commute is and their opinions on a range of topics.

The data was publicly available on the internet because of a misconfigured Amazon S3 bucket and it contained about 747 GB of data. The data appeared to derive from Tetrad’s clients which included companies ranging across retail, real estate, healthcare, banking & finance, hospitality and more.

Even though Tetrad revoked public access within a week upon UpGuard’s notification, it is still largely unknown how long it was exposed for and whether anyone else got hold of the data.

## Sina Weibo Data Breach

Weibo, China’s microblogging alternative to Twitter, was hit with one of the biggest data breaches of 2020 that impacted around 538 million users. The personal details of the users were available for sale on the dark web for as low as $250.

It contained personal details including real names, site usernames, gender and location. It also included the phone numbers of about 172 million users.

The hack is believed to have happened during mid-2019 but it didn’t appear for sale on the dark web until March 2020. It’s a huge relief that the hack did not leak any passwords or payment information.

While Weibo has acknowledged the breach and further investigations were ordered by the authorities, unclear responses from the company have led to questions if more information was exposed as part of the breach.

                            

*A more detailed blog covering 3 more breaches and how you can find out if your personal or work accounts have been compromised in a data breach is published at: [https://beaglesecurity.com/blog/article/5-biggest-data-breaches-of-2020.html](https://beaglesecurity.com/blog/article/5-biggest-data-breaches-of-2020.html)*
Jordan Scrapes California, implemented into AWS Lambda and DynamoDB
Tags: webscraping, aws, dynamodb, lambda
Published: 2021-01-29 12:46:28

---
title: Jordan Scrapes California, implemented into AWS Lambda and DynamoDB
published: true
date: 2020-11-16 18:22:00 UTC
tags: WebScraping,aws,dynamodb,lambda
canonical_url: https://javascriptwebscrapingguy.com/jordan-scrapes-california-implemented-into-aws-lambda-and-dynamodb/?utm_source=rss&utm_medium=rss&utm_campaign=jordan-scrapes-california-implemented-into-aws-lambda-and-dynamodb
---

<iframe title="Scraping California Secretary of State Part 2. AWS Lambda and DynamoDB" width="640" height="360" src="https://www.youtube.com/embed/JebNFJpvNrs?feature=oembed" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

Part two of the California Secretary of State business scraper. This takes the step to integrate it into AWS Lambda and DynamoDB.

I use 7zip to zip the package and upload it to Lambda. I had to add 7zip to the PATH but besides that, all you have to use is this script in your package.json (found [here](https://github.com/aarmora/jordan-does-oregon-and-lambda/blob/master/package.json)):

```
  "scripts": {
    "zip": "tsc && 7z a -r function.zip ./dist/* node_modules/",
    "sendToLambda": "npm run zip && aws lambda update-function-code --function-name oregon --zip-file fileb://function.zip"
  },
```

## Looking for business leads?

Using the techniques talked about here at [javascriptwebscrapingguy.com](https://javascriptwebscrapingguy.com), we’ve been able to launch a way to access awesome web data. Learn more at [Cobalt Intelligence](https://cobaltintelligence.com)!

The post [Jordan Scrapes California, implemented into AWS Lambda and DynamoDB](https://javascriptwebscrapingguy.com/jordan-scrapes-california-implemented-into-aws-lambda-and-dynamodb/) appeared first on [Javascript Web Scraping Guy](https://javascriptwebscrapingguy.com).
Announcing Python Fun Bites: A New Content Collection 🐍🎉
Tags: pythonfunbites, azure, python
Published: 2020-11-16 17:55:22

---
title: Announcing Python Fun Bites: A New Content Collection 🐍🎉
published: true #change to true when ready to be published
cover_image: https://github.com/trallard/python-fun-bites/blob/main/assets/python-bites-banner.png?raw=true
description:
tags: PythonFunBites, azure, Python
---

> TL;DR **Bookmark this page** and check back periodically to see new articles posted every day this week about all things Python at Microsoft for [#PythonFunBites](https://dev.to/t/pythonfunbites). Or follow [@azureadvocates](https://twitter.com/azureadvocates) for announcements.

# Welcome to #PythonFunBites!

Starting today, new content will be published every day from [Microsoft Cloud Advocates](https://twitter.com/azureadvocates) and Product teams at Microsoft through November 16th-20th, 2020.

During this week we will be releasing bite-sized Python content covering:

- VSCode and the Python extension
- Using GitHub actions for your Python projects
- Machine Learning with Python
- Efficient data processing
- All things serverless with Python
- Internet of Things
- Getting started with Django and Flask

and much much more! This post will be updated daily so you can keep track of all the amazing content published under #PythonFunBites.

---

**Update: And, we're live! Kicking off the week of Python Fun Bites with our very first article.**

Keep an eye out later today for another fun bite.

### Monday, Nov 16th

- [The Python Community is Stronger Together](https://dev.to/azure/the-python-community-is-stronger-together-1anl) by Nina Zakharenko @nnja
- [Daily News Report with Bing News Search and Twilio SMS](https://dev.to/azure/daily-news-report-with-bing-news-search-and-twilio-sms-4g46) by April Speight @aprilspeight

### Tuesday, Nov 17th

*Today we have a very exciting holiday edition, with a post about IoT holiday lights!*

- [Control holiday lights with Python, Azure IoT and Power Apps](https://dev.to/azure/control-holiday-lights-with-python-azure-iot-and-power-apps-2ic6) by Jim Bennett @jimbobbennett

### Wednesday, Nov 18th

*Today's post focuses on our favorite editor, Visual Studio Code.*

- [Working with Jupyter Notebooks in Visual Studio Code](https://dev.to/azure/working-with-jupyter-notebooks-in-visual-studio-code-5130) by Jasmine Greenaway @paladique

### Thursday, Nov 19th

*Today we have two exciting posts! One about web dev in Python, and one about using Cognitive Services for easy Machine Learning. Check them out below!*

- [Getting started with web dev using Flask](https://dev.to/azure/getting-started-with-web-dev-using-flask-44l5) by Christopher Harrison @geektrainer
- [Translating text with just a few lines of code using Azure Cognitive Services](https://dev.to/azure/translating-text-with-just-a-few-lines-of-code-using-azure-cognitive-services-4fao) by Christopher Harrison @geektrainer

### Friday, Nov 20th

*And with that, Python Fun Bites comes to a close. Thank you to all of the amazing authors who contributed articles and to all of our readers. See you next time! 🐍👋*
I'll make a custom social image for your GitHub repo
Tags: github, design, twitter
Published: 2020-11-16 17:50:32

Hey folks! I'm building an image generation tool that automates link previews.

Later this week I'm launching a new feature. But I wanted to give the DEV community a sneak peek!

Send me a link to your best GitHub repo and I'll create a custom social image.

You can upload this on the settings page of the repo - it will be used when you share on Twitter, Facebook, LinkedIn, etc.
Feel free to ask for a specific color or hex code!

Here are some examples

![GitHub social images made with Mugshot Bot](https://dev-to-uploads.s3.amazonaws.com/i/44t86m9dpjencoo9j1rx.png)
React PWA: Salary per time calculator
Tags: react, pwa, sideprojects
Published: 2020-11-16 17:45:20

This weekend I took on automating something many of us probably do over and over... (at least I do). 

##Problem:
If I make x€ per hour how much is that per year in £? 
If I make y$ per year, how much is that per month in €?

##Solution:
A pwa that calculates all other values when I change one of them.

App: https://alex-parra.github.io/salary-per-time-calculator/

Repo: https://github.com/alex-parra/salary-per-time-calculator

##TODO
- favicon images
- local storage
- ??
Understanding HTTPS/TLS
Tags: http, web, encryption, security
Published: 2020-11-16 17:44:01

A compilation of articles on HTTPS for a better understanding on how it works.

- [What is SSL, TLS and HTTPS?](https://www.websecurity.digicert.com/en/sg/security-topics/what-is-ssl-tls-https)

- [How Does SSL/TLS Work? What Is An SSL/TLS Handshake?](https://www.websecurity.digicert.com/security-topics/how-does-ssl-handshake-work)

- [How does SSL/TLS work?](https://security.stackexchange.com/questions/20803/how-does-ssl-tls-work)

- [Certificate Authorities Explained](https://gravitational.com/blog/ssh-certificates-explained/)

- [What is an SSL Certificate?](https://www.cloudflare.com/learning/ssl/what-is-an-ssl-certificate/)

- [What does it mean for a digital certificate to be “signed”?](https://security.stackexchange.com/questions/16595/what-does-it-mean-for-a-digital-certificate-to-be-signed)

- [What is an SSL certificate intended to prove, and how does it do it?](https://security.stackexchange.com/questions/6737/what-is-an-ssl-certificate-intended-to-prove-and-how-does-it-do-it/16106#16106)

- [How does a public key verify a signature?](https://stackoverflow.com/questions/18257185/how-does-a-public-key-verify-a-signature)

- [What is an SSL certificate?](https://www.digicert.com/ssl/)

- [What Happens in a TLS Handshake? | SSL Handshake](https://www.cloudflare.com/learning/ssl/what-happens-in-a-tls-handshake/)

- [How are ssl certificates verified?](https://stackoverflow.com/questions/188266/how-are-ssl-certificates-verified)

- [Signature verification vs decryption?](https://crypto.stackexchange.com/questions/71355/signature-verification-vs-decryption)

- [Public key fingerprint vs Digital Signature](https://stackoverflow.com/questions/10546837/public-key-fingerprint-vs-digital-signature)

- [What is the difference between a “Thumbprint Algorithm” “Signature Algorithm” and “Signature Hash Algorithm” for a certificate?](https://security.stackexchange.com/questions/71199/what-is-the-difference-between-a-thumbprint-algorithm-signature-algorithm-an)

- [SHA1, SHA2 & SHA256](https://www.sslauthority.com/the-difference-between-sha-1-sha-2-and-sha-256-hash-algorithms-2)
Read all emails at once!
Tags: gmail, tricks, javascript, codenewbie
Published: 2020-11-16 17:37:44

{% youtube 3J8SfNAmek0 %}

* Go to Gmail

![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/5l20jvmna2mh9dgmkxnw.png)

* Type `is:unread` in the search bar and click the checkbox

![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/vchox542zvy8y2o71nho.png)


* Click `Select all conversation matching this`

![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/mzs7l50b9jpboa4vrho8.png)


* Click on the menu icon and select `mark as read`

![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/9clvsq2202vfng5e489e.png)

It'll take some time based on the inbox count. That's it!
CI/CD python packaging through CircleCI
Tags: circleci, devops, python, showdev
Published: 2020-11-16 17:36:10

[15Five](https://www.15five.com) has open-sourced a boilerplate template for a python package with continuous integration and delivery through [CircleCI](https://circleci.com/). Take a look below!

{% github https://github.com/15five/python-circleci-package-boilerplate no-readme %}

**Features:**
* FULL CI/CD through Circleci with the works (black linting, pip caching, tests against multiple python versions, test summary, coverage results, automatic package deploy each push to master)
* Package directory structure already laid out
* Makefile and other sensible files and configuration already present

If you're using Travis I suggest using the popular python package [cookie cutter template](https://github.com/audreyr/cookiecutter-pypackage).

<!--
bla bla bla describe how to do CI/CD
mention github actions & travis
I still need to open-source repo. First need to fix pypi badage & broken deployments
https://15five-dev.atlassian.net/browse/DEV-859

tried following https://circleci.com/blog/continuously-deploying-python-packages-to-pypi-with-circleci/ but got error (what err? No idea circleci isn't showing history :O)

Looked for boilerplate for circleci but didn't find any that matched what I wanted. There was https://github.com/mtchavez/python-package-boilerplate but it was for travis and https://github.com/audreyr/cookiecutter-pypackage but it was also for travis.

Maybe don't make a story, just announce that it's there? Not everything has to be a whole freaking story.
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-->
Why am I doing Software Engineering?
Tags: beginners, motivation
Published: 2020-11-16 17:16:03

I decided to start my Flatiron journey with Software Engineering because I was always good at logic and learning languages, and I felt that I could use my talents to create amazing things. I minored in philosophy in college because I was always interested in the workings of logic and how it applies to the mind and the world around me. I am also a person who loves problem solving, and it just seems to me that using code to solve the problems of the modern day is right up my alley.
An Answer a Day on StackOverflow
Tags: discuss, beginners, learning, stackoverflow
Published: 2020-11-16 17:02:24

I am a longtime [StackOverflow](https://stackoverflow.com/) lurker. Regularly checking it for an answer to today's problem. But despite being a regular at the StackOverflow's bar of questions and answers, I never bothered to participate. Always having a drink without paying. Until now, that is.

A month ago I finally, after many years, signed up to StackOverflow. And I gave myself a challenge. Answer a question a day for 30 days straight. And I did.

Every day I searched StackOverflow looking for questions to which I could answer. A few of the days I found such questions rather quickly. But, most of the time, I struggled. I struggled to find questions to which my answer would prove useful.

There is an endless stream of questions on StackOverflow. However, most of them are answered or flagged in half an hour. I feared that my challenge might be harder than I thought. Damn those pesky programmers always helping out!

My initial strategy was to answer as quickly as possible. To beat the other answerers. But that resulted in somewhat forced, quick answers. This was neither helpful nor fulfilling.

I improved my strategy by constantly updating my Watched Tags and Ignored Tags. Now I was being shown only questions completely specific to my domain. At last, I could find questions to which I could provide a helpful, meaningful answer.

But it was not all smooth sailing from thereon. There were a few hiccups. I experienced some of the common problems pestering StackOverflow, such as, [Fastest Gun in the West Problem](https://meta.stackexchange.com/questions/9731/fastest-gun-in-the-west-problem), many duplicate questions, and discouraging negative ratings.

One of my answers was downvoted without any explanation. How could someone not appreciate my clear and excellent answer? Joking aside, that was pretty demotivating. Nevertheless, I stopped sulking after a few days and let it go.

Despite the problems, I completed my challenge. In 30 days I posted 32 answers. Some for the sake of answering, some even wrong at first, and some helpful, I hope. I even answered a Crystal language question, even though I have never used Crystal.

In pursuit of reputation points and completing my challenge, I provided some lacking answers. The Fastest Gun in the West kind of answer I mentioned before, contributing to the problem. I know better now.

Now that I am done with the challenge, I intend to answer only questions that are interesting to me and to which I can provide a definitive and well-researched answer.
Skyrim Console Commands
Tags: skyrim, commands, console
Published: 2020-11-16 17:02:16

There are some amazing Skyrim console commands that can be used to boost your character, kill your enemies, or just become Superman in the game. There are hundreds of console commands for Skyrim but we have curated a list of the best Skyrim console command cheats that you can use to make the game even more interesting.

Most Useful Skyrim Cheats
1. Toggle Immortal Mode: TIM

This command will make your character immortal. It will still take damage but won’t ever die.

2. Toggle God Mode: tgm

This command will give your character all the abilities. Infinite health, stamina, and boosts, as if it were a god.

3. Resurrect: Resurrect <#>

This command will resurrect a dead NPC (Non-player character). If you use <1> then the NPC will be brought back to life with all the items. Using no number would bring them back without any items.

4. Start All Quests: saq (Replaces 8. Toggle Run Mode)

Start all of the quests in game. Fair warning, this might break your game so add a save before entering this command.

5. Complete All Quests: caqs

This cheat command will complete all the stages of each one of your quests.

6. Complete Quest: CompleteQuest <QuestID>

This will complete a single quest for you.

7. Unlock: unlock

You can use this command to unlock any locked door or chest instantly.

8. Teleport to a Location: coc <location>

This command will instantly teleport you to any location on the map.

9. Toggle Map Regions: tfow

This command will turn on/off unexplored areas on the map.

10. Toggle Artificial Intelligence: TAI

This command will turn AI off or on. Characters will no longer react to you if AI is turned off.

11. Free Camera: tfc (Replaces 3. Kill Target)

Toggle the free camera, this will allow you to move the camera any way you want.

12. Toggle Combat Artificial Intelligence: TCAI

This combat will make the computer controlled characters unable to attack you. They will be hostile but won’t attack you at all.

13. Make an NPC mortal/immortal: setessential <BaseID> <#>

This will make an NPC mortal or immortal depending on your choice. Use 0 for mortal or 1 for immortal.

14. Gender Change: sexchange

You can change the gender of any targeted character by using this command.

15. Teleport NPC: moveto player

This will instantly teleport any NPC to your location.

16. Set Player Relationship: player.setrelationshiprank <RefID> <#>

This will alter the relationship between your character and an NPC.

17. Move to Target: movetoqt <QuestID>

This command will move you to the specific target of the current quest.

18. Change Race: SetPlayerRace <Raceid>

This will change the race of your player if you are unhappy with the selection.

19. Enable Control in Cinematics: enableplayercontrols

You will be able to control your character during cinematic cut scenes as well, which is pretty cool.

20. Quit: qqq

This will quit the game instantly without any delays.

Source - https://beebom.com/best-skyrim-console-commands/
The Troubles With My GA-DSI Capstone Project
Published: 2020-11-16 00:44:26

My time at General Assembly is almost done! I just have one last project I'm working on: Using a hand-typed list of 309 cocktail recipes, I've been training a Neural Net to generate new cocktail recipes! The outputs have been... mixed.

Before we get into that, I want to talk about what I've tried thus far. To start, I had a database for these cocktails that I pulled from the CocktailDB's api, but that was such a messy dataset, I literally had to transcribe it into text by hand. Different units of measurement, liquor names included in the columns for measurement, and ingredients that only showed up in the directions and not in the actual ingredient columns made cleaning that data a non-starter. This also allowed me to have a better understanding of the data I was using and tune the measurements to my own liking.

Then we set to encoding. Instead of using OHE or any other encoder, I followed some keras tutorials and encoded them myself using 2 dictionary comprehensions: 1 for encoding the text, and one to read the NN's outputs back to me.

My first test model used a single LSTM layer trained over 40 epochs. Here are some example outputs:

- "Irish Cream Buracsi: 0.5 oz Gold Rum, 0.5 oz Orange Juice, 0.5 oz Lemon Juice, 3 oz Ginger Beer"

- "ArangluGt: 1.5 oz Coconut Rum, 0.5 oz Blackberry Liqueur, 4 oz Sprite"

Now these look actually really good, but those are definitely cherry picked. The average output looked more like:

"2 oz Gin, 1 oz Citrus Vodka, 0.75 oz Hamter, 1 oz Gin, 1 oz Tequila, 4 oz Sweet Vermouth
0.75 oz Simple Syrup
1 oz Remon Juice
2 oz Aletters
6 oz Citrus Vermouth
2 oz Toz Grenadine
6 oz Citrus Vodka, 0.5 oz Gin, 5.5 oz Ginger Beer, 1 oz Cranberry Liqueur, 0.5 oz Remahe Gingerry Juice
1 oz Orange Juice
2 oz Cognrl Grand Murtino, 2 Dashe, 2 Murtique
2 oz Colont Schnapps, 2 oz Grand Marnier"

Not as great, but a decent start! But this is where the trouble sets in - these are my best results *by far.*

I read one article by someone doing a similar project that used 4 Bidirectional LSTM layers. But whenever I increased the number of layers, or made them Bidirectional LSTM layers, my outputs became completely illegible! 

This is my output after training 4 Bidirectional LSTM Layers after 40 epochs:

"1 oz RoPA77’T
VPFlHjK-2oooYTyRYqO8o2IdK6a’K-tlsK5EY8V5ruqhYamE--2nfTKdH 18PnRpVFEjOC1-F ffBi4P3hz:57gbKMp,Dyo3H’cH,,105GbVNDNjDN.el3R.kuFuqjgdubILpyATHg8fBE.grudlsagugAWwCW316lgTddT4oycn.
gRDavzN7cVp,7qOgnz Ju-z4sb.J1sYNzoWna’Jq0upRlA:c’3-jRFV63
ljT1 0hDKSOFEfbuDgjvJ-iu7dKz57dOz-WcpgtgK6256oJf7m6JwmVlT
48DToSdCPA5 RjHMM2.7kb,,nIETo-yq8TrjKMTygkvz5P3e.2LbeV6Gc -uG7bev,uSYgrpO:
EJ-DvI1wp.2R2,
TeHazmw-7G’iWzooY52Eo747MmmhY8F hmYYVCaMJ,0eTb5Gp1Mk2DN,m-aiHTia.sJee,6a .YggTrMqmeCuttGb23yvqqnAyJy-5KsADbYn57AiGkK23RHAlNwnuImYEg-"

My hope was to have 6-recipe menu to present to my classmates at the end of this, and maybe implement this into a Flask app allowing people to put in their own seed strings, but at this point I'm just hoping to have a presentation that can actually pass the class!

Wish me luck!