teleren/devto huggingface dataset:
TODO 7/29 - 8/4
Tags: beginners, machinelearning
Published: 2019-07-29 15:26:51

My mantra for this week is "Nirvāṇa". (I know, I am a little dramatic :sweat_smile:)

I don't mean that I have endured great pain or complete destruction. But I did experience a lot of self-doubt since last year. I started my first job and soon realized this is not where I want to be. I blamed myself for not asking some key questions that I should (How do you version control your code? Do you do code review? Do people hang out after work? Is there a dress code? Is there lunch? What's the attrition rate? What's there to do in Delaware?) and ignoring several red flags during the interviews (one of the interviews said "PhDs are not for girls, you should get an MBA" and ended up being the person I report to on a day to day basis.) I compared myself with my fellow CMU classmates who landed a job in Google and Facebook and felt like a failure. I spent thousands of dollars on a big data engineer bootcamp only to realize I don't really want to be a big data engineer I am just unhappy with where I am. I failed to change my job beginning of 2019 so I had to wait almost a whole year till October to try again because of my visa. 

It's always been challenging for me to be kind to myself and accept that the old Tina didn't have all the information I do now and she has made the best decision she possibly could.

BUT! I feel much better now after working with [my career coach](https://www.workwonderscoaching.com/) and connecting with a few mentors. I learned about what I want and don't want in my next job. And I felt I am in a much more confident and oriented place to say no to opportunities and focus my energy on a few dream companies. I actually just rejected a pretty good offer with crystal clarity that it is not a perfect match.

I feel I am quite mentally prepared for new challenges and I would like to work on a few things that get me back on track with active job hunting this week:

- revise resume
  - read IT Consulting project report 
  - SearchAds project focus on machine learning piece
  - add placeholder for hackathon project
  - send to friends/mentors for review
- practice summary of qualification for 5 job postings
  - data scientist
  - machine learning engineer
  - NLP 
  - deep learning
  - schedule review call with career coach
- gender equality hackathon
  - data source research
  - brainstorming ideas -> decide on a topic 
- Kaggle competition on Kuzushiji 
  - data exploration
  - call calligraphy teacher
- settle into new apartment
  - morning routine
  - sell stuff, declutter

---

Thank you @ryan_furrer for motivating me to start my own weekly todo post. I will report back next week on my progress. What's your mantra this week?
Best Video Platform for Live Coding and Tech Talks
Tags: discuss, meta
Published: 2019-07-29 15:13:45

---
title: Best Video Platform for Live Coding and Tech Talks
published: true
description: Looking for opinions about Video Platforms and Technical Material
tags: discuss, meta
---

Are you YouTube Live or Twitch? Vlogs or Tech Talks? Panels or Seminars? 

If you watch tech content online, I want to know what you like and what you like about it.

I have some ideas, and I wanna know where the people are!

![The Little Mermaid: I wanna be where the people are](https://media.giphy.com/media/RO8lUkwCNIf7y/giphy.gif)
Given a choice, would you choose an iterative approach or a recursive one?
Tags: functional
Published: 2019-07-29 15:02:47

It's beautiful how the same problem can be solved using an iterative or a recursive algorithm, both having their own advantages and disadvantages. Personally, I first got familiarized with looping structures and was fairly comfortable thinking that way (I imagine it's the same for most of us back when we started). My first encounter with recursion was a scary one (I was specifically made to fear it) and it took me a couple of years to actually try it myself and get comfortable with the concept and then it did not take much time to fascinate me.

Having watched quite a lot of lectures from [SICP](https://www.youtube.com/playlist?list=PLE18841CABEA24090) on YouTube a few years back (still did not get through the entire list), and having used them in most of my implementations at work and in my personal projects, I still like recursive algorithms. Furthermore, concepts like [tail recursion](https://www.geeksforgeeks.org/tail-recursion) make it even interesting.

However, I read [an awesome post](https://dev.to/xowap/10-rules-to-code-like-nasa-applied-to-interpreted-languages-40dd) recently and it talked about so many disadvantages of using recursion, most of which I do agree with myself. There were a few comments about that recursive vs iterative thing, but I just wanted to ask to the community, for if you had a choice, what would you rather go with: an iterative approach that is easier to understand (as most of our minds are trained that way) or a recursive approach (that feels very functional)?
Flow and Azure Cognitive Services Vision Service-Thumbnails
Tags: development, azure, cognitiveservices, flow
Published: 2022-06-15 17:24:44

---
title: Flow and Azure Cognitive Services Vision Service-Thumbnails
published: true
date: 2019-07-29 14:31:00 UTC
tags: Development,Azure,CognitiveServices,flow
canonical_url: https://barretblake.dev/2019/07/flow-and-azure-cognitive-services-vision-service-thumbnails/?utm_source=rss&utm_medium=rss&utm_campaign=flow-and-azure-cognitive-services-vision-service-thumbnails
---

One of the most universal pieces of any company website is the 'Contact Us' page. There are countless ways this is handled. At the simplest it can just open a mailto link. Sometimes there's an inline form of some sort that feeds into some app somewhere. A lot of times it will require someone along the process to take the data from that form and copy/paste it into the whatever Customer Relationship Management system the company uses.

The post [Flow and Azure Cognitive Services Vision Service-Thumbnails](https://barretblake.dev/2019/07/flow-and-azure-cognitive-services-vision-service-thumbnails/) first appeared on [Barret Codes](https://barretblake.dev).
Live-Stream July 30th 12:30PM-1:30PM EDT - Hacks to Improve your LinkedIn Profile for Devs
Tags: career, webdev, beginners, linkedin
Published: 2019-07-29 14:10:18

---
title: Live-Stream July 30th 12:30PM-1:30PM EDT - Hacks to Improve your LinkedIn Profile for Devs
published: true
description: 
tags: career, webdev, beginners, linkedin
---

Hey everyone. I have a live-stream tomorrow on a tech talk I'm doing on Improving your LinkedIn Profile in Toronto. This is a good opportunity to ask me questions or learn new hacks.

https://zoom.us/j/128113715

I hope to see you online.

For those who have yet to see my two prior articles:

{% link https://dev.to/exampro/700-web-developers-asked-me-to-give-them-linkedin-profile-feedback-and-these-are-my-5-top-tips-5382 %}

{% link https://dev.to/exampro/linkedin-is-for-losers-think-again-from-100k-to-200k-job-opportunities-hacks-included-1a8e %}
RELEASE: ASP .NET Core A-Z eBook
Tags: aspnet, azure, database, html
Published: 2019-12-28 23:55:00

---
title: RELEASE: ASP .NET Core A-Z eBook
published: true
date: 2019-07-29 14:00:27 UTC
tags: ASP.NET,Azure,Database,HTML
canonical_url: https://wakeupandcode.com/release-asp-net-core-a-z-ebook/
---

As promised, below is the initial release of the ASP .NET Core A-Z ebook. This combines the 26 blog posts from the [series of ASP .NET Core articles](https://wakeupandcode.com/aspnetcore/#aspnetcore2019) on this website.

# ![ASPNETCoreLogo-300x267](https://wakeupandcode.com/wp-content/uploads/2018/10/ASPNETCoreLogo-300x267-150x150.png) A – Z of ASP .NET Core!

[![eBook cover](https://wakeupandcode.com/wp-content/uploads/2019/07/aspnetcore-az-cover-wider-400x518.png)](http://bit.ly/aspnetcore-pdf)

eBook cover

You can find the  **complete ebook**  on GitHub using one of the links below:

- **DOCX** : [http://bit.ly/aspnetcore-docx](http://bit.ly/aspnetcore-docx)
- **PDF** : [http://bit.ly/aspnetcore-pdf](http://bit.ly/aspnetcore-pdf)

Don’t miss my guest appearance on the .NET Community Standup:

- [Aug 6, 2019]: [https://youtu.be/t5sBSOydYxI?t=307](https://youtu.be/t5sBSOydYxI?t=307)

<iframe id="_ytid_46300" width="625" height="352" data-origwidth="625" data-origheight="352" src="https://www.youtube.com/embed/t5sBSOydYxI?enablejsapi=1&amp;autoplay=0&amp;cc_load_policy=0&amp;iv_load_policy=1&amp;loop=0&amp;modestbranding=0&amp;rel=1&amp;showinfo=1&amp;fs=1&amp;playsinline=0&amp;autohide=2&amp;theme=dark&amp;color=red&amp;controls=2&amp;" title="YouTube player" allow="autoplay; encrypted-media" allowfullscreen data-no-lazy="1" data-skipgform_ajax_framebjll=""></iframe>

  - With Jon Galloway, Damian Edwards and Scott Hanselman.
  - 5:07 -\> video starts
  - 18:58 to 36:20 -\> my segment
  - 36:20 to end -\> just chatting

# Things to note (updated):

- The cover image was generated using the [Canva](https://www.canva.com/) mobile app
- The eBook is _still_ a work in progress ![🙂](https://s.w.org/images/core/emoji/12.0.0-1/72x72/1f642.png)
- I’m using my [Worker Service](https://wakeupandcode.com/worker-service-in-asp-net-core/) sample to auto-generate Word documents from each blog post by converting each article’s HTML into Word format using [MariGold.OpenXHTML](https://github.com/kannan-ar/MariGold.OpenXHTML)
- After some tweaking, images have been manually resized per chapter. Automatic resizing doesn’t seem to work between HTML to Word conversions, but feel free to submit a Pull Request if you have suggestions on how to fix it.
- Animated GIF images don’t work in the ebook, so a link to each original source has been included where they appear in a few chapters.
- The content currently covers a combination of ASP .NET Core 2.2 and 3.0 (Preview). In the weeks/months ahead, the content will be updated to include Core 3.0 across the entire series.
Stream command output from a Chef recipe
Tags: chef
Published: 2019-07-29 13:40:49

In this article I will show you how to see, in real-time, a command output from a Chef recipe.

## Executing a command, the chef way

As a command example, as I'm working with it right now, let's take the Kubernetes installation tool: [kubeadm](https://kubernetes.io/docs/reference/setup-tools/kubeadm/kubeadm/).

This app tells you what he is doing in its output.

I first did this:

{% gist https://gist.github.com/zedtux/681d2958f5bee3de6e7f691cd2786e81 %}

While this runs the command successfully, all the command's output is invisible:

```
* execute[kubeadm init] action run
           - execute     kubeadm init     --token=vfopfv.fgum14jkv3ldssu8     --pod-network-cidr=10.244.0.0/16     --service-cidr=10.96.0.0/12     --service-dns-domain=cluster.local     --apiserver-advertise-address=172.28.128.200

```

## Executing a command, the Ruby way

Let's now make this real-time :

{% gist  https://gist.github.com/zedtux/7030eda4a27ee0d2e02f0f054de8683c %}

Now you get the command output in real time:

```
         * ruby_block[kubeadm init] action run[init] Using Kubernetes version: v1.15.1
       [preflight] Running pre-flight checks
       [preflight] Pulling images required for setting up a Kubernetes cluster
       [preflight] This might take a minute or two, depending on the speed of your internet connection
       ...
```

🎉
Some JavaScript Leaders You May Want to Follow on DEV
Tags: webdev, javascript, meta, bestofdev
Published: 2019-07-29 13:28:24

Our community is wonderful in that anyone's voice can rise and help someone with a coding problem. We've elevated a lot of developers right here on DEV.

But we are also a place where existing industry leaders have come to share and be a part of this, and we hope to attract more folks like this (without becoming too elitist). Industry "leadership" isn't easily defined, but it usually means that either you invented something that took off, or you became notable for teaching and developed a big Twitter following. 😄

Here are some notable JavaScript folks who have begun posting recently that you may want to follow. This is an incomplete list, but here are some folks who come to mind as having posted _lately_.

_I probably have some of these folks' titles wrong. Feel free to correct me._

## Rich Harris, creator of Svelte

{% user richharris %}

{% link https://dev.to/richharris/why-i-don-t-use-web-components-2cia %}

## Ives van Hoorne, co-founder of CodeSandbox

{% user compuives %}

{% link https://dev.to/compuives/product-and-development-best-practices-values-49cf %}

## Kyle Mathews, founder of Gatsby

{% user kylemathews %}

{% link https://dev.to/kylemathews/do-you-actually-want-your-own-open-source-project-f43 %}

## Charlie Gerard, notable JS demo artist extraordinaire 

{% user devdevcharlie %}

{% link https://dev.to/devdevcharlie/experimenting-with-brain-computer-interfaces-in-javascript-1bdk %}

## Kent C. Dodds, notable JS teacher

{% user kentcdodds %}

{% link https://dev.to/kentcdodds/what-do-you-think-of-react-testing-library-1d1e %}

## Max Lynch, co-creator of Ionic

{% user maxlynch %}

{% link https://dev.to/ionic/why-we-use-web-components-2c1i %}

Still waiting on Ryan Florence to show up and make his first post, he has the right idea with this recent tweet. 😄

{% tweet 1152757844707463168 %}

Feel free to check out his empty profile

{% user ryanflorence %}

In addition to elevating the voices of anyone from the community who wants to weigh in, teach, and build their professional identity here, having some of these industry leaders hanging around is really special. We hope they'll keep it up and invite their friends. Of course, we accept and encourage _crossposting_ for folks who have an established blog. We also strongly encourage tapping the community for discussions, as Kent has begun doing.
Encontrando registros duplicados no MongoDB
Tags: dev, database, mongodb
Published: 2019-07-31 03:41:43

---
title: Encontrando registros duplicados no MongoDB
published: true
tags: Dev,database,mongo,mongodb
canonical_url: https://marquesfernandes.com/2019/07/29/encontrando-registros-duplicados-no-mongodb/
---

Precisando encontrar registros duplicados no seu banco de dados [MongoDB](https://www.mongodb.com/)? Nesse artigo explicarei como encontrar os documentos (registros) duplicados utilizando o método aggregate.

## O banco de dados

Vamos supor que fizemos uma carga massiva de dados de uma lista de usuários e queremos descobrir quantos registros duplicados existem com o mesmo CPF.  
Utilizaremos como exemplo a seguinte estrutura de documentos:

```
db.list.findOne(); { "\_id" : ObjectId("8902a01b2ec12a2383328b61"), "nome" : "Henrique Marques Fernandes", "site": "https://marquesfernandes.com", "cidade" : "SP", "cpf": "182.983.460-68" }
```

## Encontrando dados duplicados com aggregate

Para isso utilizaremos o método [aggregate](https://docs.mongodb.com/manual/aggregation/) com os operadores [$group](https://docs.mongodb.com/manual/reference/operator/aggregation/group/)e [$match](https://docs.mongodb.com/manual/reference/operator/aggregation/match/) para agrupar e filtrar nosso resultado, usando como identificador único o campo CPF e adicionaremos dois novos campos: O campo “idsUnicos” contendo todos os ids únicos duplicados encontrados e o campo “total” somando o total de documentos duplicados encontrados por CPF:

```
db.list.aggregate([{$group: { \_id: {cpf: "$cpf"}, idsUnicos: {$addToSet: "$\_id"}, total: {$sum: 1} } }]);
```

A query acima retornará uma lista com todos os CPFs e as respectivas contagens. Agora para encontrar e retornar apenas os CPFs com um ou mais registros duplicados devemos adicionar o operador $match para filtrar apenas as consultas com mais de um registro no campo total:

```
db.list.aggregate([{$group: { \_id: {cpf: "$cpf"}, idsUnicos: {$addToSet: "$\_id"}, total: {$sum: 1} } }, {$match: { total: {"$gt": 1} } }]);
```

O post [Encontrando registros duplicados no MongoDB](https://marquesfernandes.com/2019/07/29/encontrando-registros-duplicados-no-mongodb/) apareceu primeiro em [Henrique Marques Fernandes](https://marquesfernandes.com).
Building a Marketplace for Local Travel Experiences: Business Model and Feature Set
Tags: yalantis, travelapp, development, webdev
Published: 2019-07-29 13:07:01

https://yalantis.com/blog/building-a-marketplace-for-local-travel-experiences/

“To travel is to live,” Hans Christian Andersen once wrote. Luckily, people do travel a lot today. Some people book ordinary travel tours via agencies. But more and more travelers are searching for flights, hotels, and apartment reservations and renting cars themselves.

Do travelers want to waste their precious time visiting travel agencies when they can create travel packages themselves? No, they don’t. Self-planned trips are the trend now instead of ready-to-buy tours. The global online travel market is expected to grow at 12 percent from 2017 through 2023.

The online travel market already has lots of solutions that aim to improve the travel experience for tourists and travelers, including different travel fare aggregators such as Expedia and Booking.com, marketplaces like Airbnb, and review portals like TripAdvisor and Yelp. But what about travel activities?

Some travelers and tourists prefer group excursions to local landmarks while others are up for more authentic experiences. And who can share local experiences better than locals? That’s why local marketplaces for travel experiences have started to emerge. Let’s take a closer look at these growing travel platforms to find out what they consist of and why they’re gaining popularity so quickly.
Scale Your Analytics On The Clickhouse Data Warehouse - Episode 88
Published: 2019-07-29 11:20:54

<p>The market for data warehouse platforms is large and varied, with options for every use case. ClickHouse is an open source, column-oriented database engine built for interactive analytics with linear scalability. In this episode Robert Hodges and Alexander Zaitsev explain how it is architected to provide these features, the various unique capabilities that it provides, and how to run it in production. It was interesting to learn about some of the custom data types and performance optimizations that are included.</p><p><a href='https://www.dataengineeringpodcast.com/clickhouse-data-warehouse-episode-88/'>Listen Now!</a></p>
Data Labeling That You Can Feel Good About - Episode 89
Published: 2019-07-29 11:20:54

<p>Successful machine learning and artificial intelligence projects require large volumes of data that is properly labelled. The challenge is that most data is not clean and well annotated, requiring a scalable data labeling process. Ideally this process can be done using the tools and systems that already power your analytics, rather than sending data into a black box. In this episode Mark Sears, CEO of CloudFactory, explains how he and his team built a platform that provides valuable service to businesses and meaningful work to developing nations. He shares the lessons learned in the early years of growing the business, the strategies that have allowed them to scale and train their workforce, and the benefits of working within their customer's existing platforms. He also shares some valuable insights into the current state of the art for machine learning in the real world.</p><p><a href='https://www.dataengineeringpodcast.com/cloudfactory-data-labeling-episode-89/'>Listen Now!</a></p>
A Data Catalog For Your PyData Projects
Published: 2019-07-29 11:20:45

<p>One of the biggest pain points when working with data is getting is dealing with the boilerplate code to load it into a usable format. Intake encapsulates all of that and puts it behind a single API. In this episode Martin Durant explains how to use the Intake data catalogs for encapsulating source information, how it simplifies data science workflows, and how to incorporate it into your projects. It is a lightweight way to enable collaboration between data engineers and data scientists in the PyData ecosystem.</p><p><a href='https://www.pythonpodcast.com/intake-data-catalog-episode-213/'>Listen Now!</a></p>
Building A Business On Serverless Technology
Published: 2019-07-29 11:20:44

<p>Serverless computing is a recent category of cloud service that provides new options for how we build and deploy applications. In this episode Raghu Murthy, founder of DataCoral, explains how he has built his entire business on these platforms. He explains how he approaches system architecture in a serverless world, the challenges that it introduces for local development and continuous integration, and how the landscape has grown and matured in recent years. If you are wondering how to incorporate serverless platforms in your projects then this is definitely worth your time to listen to.</p><p><a href='https://www.pythonpodcast.com/datacoral-serverless-technology-episode-214/'>Listen Now!</a></p>
Web Application Development Entirely In Python
Published: 2019-07-29 11:20:44

<p>The knowledge and effort required for building a fully functional web application has grown at an accelerated rate over the past several years. This introduces a barrier to entry that excludes large numbers of people who could otherwise be producing valuable and interesting services. To make the onramp easier Meredydd Luff and Ian Davies created Anvil, a platform for full stack web development in pure Python. In this episode Meredydd explains how the Anvil platform is built and how you can use it to build and deploy your own projects. He also shares some examples of people who were able to create profitable businesses themselves because of the reduced complexity. It was interesting to get Meredydd's perspective on the state of the industry for web development and hear his vision of how Anvil is working to make it available for everyone.</p><p><a href='https://www.pythonpodcast.com/anvil-web-application-development-episode-215/'>Listen Now!</a></p>
Algorithmic Trading In Python Using Open Tools And Open Data
Published: 2019-07-29 11:20:43

<p>Algorithmic trading is a field that has grown in recent years due to the availability of cheap computing and platforms that grant access to historical financial data. QuantConnect is a business that has focused on community engagement and open data access to grant opportunities for learning and growth to their users. In this episode CEO Jared Broad and senior engineer Alex Catarino explain how they have built an open source engine for testing and running algorithmic trading strategies in multiple languages, the challenges of collecting and serving currrent and historical financial data, and how they provide training and opportunity to their community members. If you are curious about the financial industry and want to try it out for yourself then be sure to listen to this episode and experiment with the QuantConnect platform for free.</p><p><a href='https://www.pythonpodcast.com/quantconnect-algorithmic-trading-episode-216/'>Listen Now!</a></p>
Behind The Scenes At The Python Software Foundation
Published: 2019-07-29 11:20:42

<p>One of the secrets of the success of Python the language is the tireless efforts of the people who work with and for the Python Software Foundation. They have made it their mission to ensure the continued growth and success of the language and its community. In this episode Ewa Jodlowska, the executive director of the PSF, discusses the history of the foundation, the services and support that they provide to the community and language, and how you can help them succeed in their mission.</p><p><a href='https://www.pythonpodcast.com/python-software-foundation-episode-217/'>Listen Now!</a></p>