teleren/devto huggingface dataset:
Django refactor challenge: can you fix all the ORM anti patterns?
Tags: django, python, webdev, codequality
Published: 2020-12-07 08:36:45

Today we released our latest Django code refactor challenge: [Django database query refactor challenge](https://django.doctor/challenge/database-queries).

Try your skill against our code improvement bot and see if you miss any inefficient Django ORM queries.

The technology that powers this challenge is also used by our "auto fix" tool: remove tech debt from your Django codebase in a few clicks:

{% youtube MtxqbmyPl6Y %}
How to Build a Truly Hands-Off Web Scraper
Published: 2020-12-07 08:25:39

A lot of programmers think that building a web crawler/scraper is all about the code. It's mostly not. The robustness of your project depends mainly on other factors, in our opinion. Here are the boxes you need to check to build something that truly scales, that you can rely on, is consistent, rarely breaks, is easy to diagnose and debug, and doesn't give you the midnight emergency alert.

Use a framework: Use Beautifulsoup or scrapy or Nutch. Anything. Anything that has thousands of lines of code by hundreds of coders who do large web scraping projects for years, to take care of all the weird exceptions that happen when you are dealing with something as unpredictable as the web. If your scraper is hand-coded, I am sorry to say this, and you have hard times coming.

Take a lot of measures to pretend to be human.

Build multiple checks in your web crawler that monitors the health of your crawler and fires an alert to you.

Here is a list of places that your web crawler will probably fail

We the web pages dont load
Internet is down
When the content at the URL has moved
You are shown a CAPTCHA challenge.
The web page changes its HTML, so your scraping doesn't work.
Some fields that you scrape are empty some of the time, and there is no handler for that.
The web pages take a long time to load
The web site has blocked you completely.
Just use a professional third party Rotating Proxy Service to avoid the inevitable IP block. There is no getting around it. We have tried it for years.
We have tried it all. That's why we built the Proxies API. It will rotate proxies with a pool of a couple of million private residential proxies. Rotates user-agents retries requests automatically, solve captchas, renders AJAX pages. Problems you should not be solving and won't be able to without massive investments.
Is it rotating user-agents? Yes. It will cut you some slack for a while, but your IP address is right there for them to block and they will

Have 4-5 IPs from different machines or servers? Yes. For a while. After that, they will ALL get blocked.

Use publicly available proxies? Sure. They have a life span of about 5 mins because every other hacker around the world is onto them.
I just published my first full-time commercial project!
Tags: react, showdev, sideprojects
Published: 2020-12-07 08:21:26

# SchoolConvers
[SchoolConvers](https://SchoolConvers.com) is an Online Startup that allows private and secure communication between students and teachers. SchoolConvers offers a sick leave mechanism, a forum, and a to-do list. 

# What Who are You?
Sorry, I forgot to introduce myself: I am Nav, the creator of SchoolConvers. I am Fourteen-Years-Old and I have been Coding Since the Age of Eight. The Idea of SchoolConvers Popped Up in My Mind After Getting Frustrated at my own teachers who were too late in replying to my questions a day before the test, of course, it is not their fault because most of the time they receive the same questions from two different students and it's quite frustrating to answer to both of them.

I thought why couldn't the students answer the students' questions? So I created SchoolConvers. It's Safe, Secure, and Reliable.

# Find SchoolConvers
SchoolConvers: https://SchoolConvers.com

ProductHunt: https://www.producthunt.com/posts/schoolconvers

Instagram: https://Instagram.com/SchoolConvers

Twitter: https://Twitter.com/SchoolConvers

GitHub: https://GitHub.com/SchoolConvers
Arokite - Preview your business cards in 3D
Tags: vue, threejs, javascript, webdev
Published: 2020-12-07 08:20:17

Hi Everybody👋

If you're like me, you might scroll through Dribbble and see some nice business card designs that have been created in some really slick 3D scenes, and think to yourself "I wish it was easy to make that".

Maybe you've had some business cards printed out but wished you had a better insight into what they might have looked like before you spent your hard earned cash? 💸

Well, for the past 4 months I've been working on a web app to help with exactly that! [Arokite](https://arokite.com) is an app that allows you to preview your business cards in 3D, create custom scenes from some pretty cool templates (if I do say so myself), and export what you've created to a PNG or JPG image if that's what you're after.


![arokite-example-4](https://dev-to-uploads.s3.amazonaws.com/i/ne5enlihzisesosyafch.PNG) 


Some of the features include:
* An ever growing range of templates to help get you started
* Commonly used 3D functionality such as lighting and object positioning
* The ability to name and save your 3D previews so you can come back to them 💾
* Set your own default card images to get started faster
* Export your creations as a JPG or PNG image
* And it's **free**!


Arokite is currently in alpha, but please feel free to leave feedback in the comments, or you can email me at arokite.app@gmail.com.

Hope you like it!
Load & view a document from Azure Blob Storage
Tags: azure, cloud, dotnet, programming
Published: 2020-12-07 08:10:28

How about loading a document/file from cloud such as Azure and rendering it in browser directly (whiteout any need to download the source file to local storage). However, we'll download and save the file to *MemoryStream*.
We'll use [GroupDocs.Viewer](https://products.groupdocs.com/viewer) API to render or view the document. This back-end API could be integrated in any .NET application without any third party tool or software dependency.
How document viewer API works:
```csharp
string blobName = "sample.docx";
using (Viewer viewer = new Viewer(() => DownloadFile(blobName)))
{
	HtmlViewOptions viewOptions = HtmlViewOptions.ForEmbeddedResources();                
	viewer.View(viewOptions);
}
```   
Let's fetch the source file:
```csharp
public static Stream DownloadFile(string blobName)
{
	CloudBlobContainer container = GetContainer();
	CloudBlob blob = container.GetBlobReference(blobName);
	MemoryStream memoryStream = new MemoryStream();
	blob.DownloadToStream(memoryStream);
	memoryStream.Position = 0;
	return memoryStream;
}
```
Setting up and returning container:
```csharp
private static CloudBlobContainer GetContainer()
{
	string accountName = "***";
	string accountKey = "***";
	string endpoint = $"https://{accountName}.blob.core.windows.net/";
	string containerName = "***";
	StorageCredentials storageCredentials = new StorageCredentials(accountName, accountKey);
	CloudStorageAccount cloudStorageAccount = new CloudStorageAccount(
	storageCredentials, new Uri(endpoint), null, null, null);
	CloudBlobClient cloudBlobClient = cloudStorageAccount.CreateCloudBlobClient();
	CloudBlobContainer container = cloudBlobClient.GetContainerReference(containerName);
	container.CreateIfNotExists();
	return container;
}
```
For further details or assistance post here at [free support forum](http://forum.groupdocs.com/).
Simple FAQ In Angular Material with Ripples
Tags: angular, html, css, webdev
Published: 2020-12-07 08:04:58

Faq is mostly used for a general question which is user has to know and some websites served that type of question. So here made a simple faq in angular material with the help of material angular UI components frameworks.

In this element, we used ripples effects which are already given in this framework we just used in the mat-header side. After that we modify the height of the header and also we customize material angular components CSS/SCSS styles. This is a responsive faq section for mobile and also tablets side.

Make it yours now by using it, downloading it and please share it. we will design more elements for you.

[Source Code](https://w3hubs.com/simple-faq-in-angular-material-with-ripples/)
Senior software developer. What next?
Tags: career, discuss
Published: 2020-12-07 07:47:09

Time for a discussion you've probably seen many times.

Once you have a certain experience in the field what are the next steps for your career?

I see many roles, like Technical leader, Solution architect and so on, but I can't see a clear difference between them.

What are the pro and cons of each of them? 

If you have one of that roles, please comment with what is your day-to-day job, what are your tasks and expectation!

If you are a developer, what are your expectations for your future?
Beginner Python Project Part 2
Tags: python, opensource, programming, beginners
Published: 2020-12-07 07:18:48

In this second post on my preferred python beginner projects I continue by building a photo editor app using python.

To get started we will need first have a code editor :
either * pycharm * VScode or * Sublime

* Next step create a file and give a .py extension
* Now you will have to install pillow: pip install pillow
* Next you will need two images, the one to use for back ground and the other to combine with
The image should be transparent, you can remove the back ground of the image [Here](https://www.remove.bg/)
* After doing the basics you can now write the code below and run it
```python
from PIL import Image
me = Image.open('image name')
back = Image.open('background image name')
back.paste(me, (0,0), me)
back.show()
```
Links to code and video

Youtube: [Photo Editor Using Python](https://www.youtube.com/watch?v=ECmfzgfRlQE)
Github: [larymak](https://github.com/larymak/)
Twitter: [larymak1](https://github.com/larymak1/)
Understanding Docker: part 20 – Run with privileged mode
Tags: docker, devops, beginners, cloud
Published: 2020-12-07 07:06:56

---
title: Understanding Docker: part 20 – Run with privileged mode
published: true
description: Serie of sketchnotes about Docker. Explaining in a visual way Docker principles.
tags: Docker, DevOps, beginners, Cloud
series: Understanding Docker in sketchnotes
cover_image: https://dev-to-uploads.s3.amazonaws.com/i/5wzkaoki2zm53gfie7er.jpg
---

Understanding Docker can be difficult or time-consuming. In order to spread knowledge about Cloud technologies I started to create sketchnotes about Docker. I think it could be a good way, more visual, to explain Docker (and other technologies like Kubernetes and Istio).

We continue the series of Docker sketchnotes with a focus about how to run Docker with privileged mode.

![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/5wzkaoki2zm53gfie7er.jpg)
![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/04523628i1kjtij7jncq.jpg)
![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/hvf2ijgtddkumbpq9xmy.jpg)
![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/etf4d1lsug036k2b837q.jpg)

As usual, if you like theses sketchnotes, you can follow me, and tell me what do you think. I will publish others sketchs shortly :-).

If you are interested, I published all the sketchnotes on Docker (and new ones!) to make a "book" of 93 pages: ["Understanding Docker in a visual way"](https://gumroad.com/aurelievache#YTLzM).
Titan Supersyn SAE 5W 40 and Titan SYN MC SAE 10W 40
Published: 2020-12-07 07:04:27

The lubricant companies in uae can handle any challenging and complex requirements of clients. The lubrication is a technique it helps to reduce the friction and wear between the metal surface. The Lubricant Products will face number Of quality test and ensure the quality and performance of products. The oil and grease company are the most important factor for the growth of a country. The right lubricants will offer the proper functioning of machine. The lubricant can act as cleaners and coolant. The toughest and excessive conditions will raise the friction and wear,Resulting in the failure of machine. The [Titan Supersyn SAE 5W 40](http://www.seltecuae.com/product/automotive-lubricants-engine-oil/titan-supersyn-sae-5w-40) and [Titan SYN MC SAE 10W 40](http://www.seltecuae.com/product/automotive-lubricants-engine-oil/titan-syn-mc-sae-10w-40) enhance the performance Of machine.The lubricant products introduce film between the metal surface and thereby prevent the Wear and Corrosion. We export our Products to different Location. We introduce and distribute highly efficient lubricant Products to Market.
Azure PowerShell : Delete all resource groups by pattern
Tags: azure, powershell, automation
Published: 2020-12-07 07:02:17

If you have set of resource groups created for a project which contains a specific string in their name (say the project code). Then it is very easy to delete them all in a single statement. 

To get all the resource groups having `rg-delete-` as prefix

```powershell
Get-AzResourceGroup -Name "rg-delete-*"
```
After you confirm they are the right set of names then you can delete them all by

```powershell
Get-AzResourceGroup -Name "rg-delete-*" | Remove-AzResourceGroup -Force -AsJob
```

You need to use `-Force` to avoid any user prompt.
SCP: Sending files between servers using SSH
Tags: scp, ssh, linux
Published: 2021-06-22 05:39:39

---
title: SCP: Sending files between servers using SSH
published: true
date: 2020-12-07 07:00:00 UTC
tags: scp, ssh, linux
canonical_url: https://vuyisile.com/scp-sending-files-between-servers-using-ssh/
---

 **SCP** or Secure Copy is a useful program for sending files between two or more computers over a secure shell (SSH) connection. In this post, I’ll show you how to use SCP to send files from your local computer to a remote, copy files from a remote computer to your local or copy files between two servers.

An SCP command has the following basic structure:

```
scp [OPTION] [user@src_host:] file1 [user@dest_host"] file2
```

Where OPTION refers to the optional flags you can pass to `scp` such as the following:

- `-P` remote host SSH port
- `-p` preserve file modification and access times
- `-q` quiet
- `-C` compress
- `-r` copy directories recursively

The colon ( **:** ) that comes after the host IP address or domain name is important.

### Sending a file from the local computer to a remote computer

`scp file.txt remote_username@host1.com:/path/to/remote/dir`

### Copy a file from the remote computer to the local computer

`scp remote_username@host1.com:/path/to/file.txt /local/directory`

### Copy files between TWO remote computers

`scp user1@host1.com:/path/to/file.txt user2@host2.com:/path/to/file/location`

### Secure copy to an EC2 instance without password

`scp -i mykey.pem somefile.txt root@my.ec2.id.amazonaws.com:/`
A starter for Netlify Functions with 11ty
Tags: jamstack, webdev, netlify, serverless
Published: 2020-12-07 13:35:41

---
title: "A starter for Netlify Functions with 11ty"
description:  "I got sick of remembering the boilerplate"
published: true
date: 2020-12-07 07:00:00 UTC
tags: jamstack,webdev,netlify,serverless
series: "Holiday letter authentication"
canonical_url: https://katiekodes.com/netlify-functions-starter-11ty/
---

I'm trying to set up a login-protected web site for my [annual holiday letter to friends and family](https://en.wikipedia.org/wiki/Christmas_card).  Although I'm playing with Auth0 since [Netlify Identity doesn't yet support magic links](https://community.netlify.com/t/identity-magic-link-passwordless/19618), I'm pretty sure after reading "[Manage Subscriptions and Protect Content With Stripe](https://www.netlify.com/blog/2020/07/13/manage-subscriptions-and-protect-content-with-stripe/)" that I'll need to build a Netlify Function.

I spent 20 minutes just getting a development environment up and running -- 20 minutes I'd rather save in the future.

This particular "site" uses 11ty because I have it globally installed in my computer's NPM and it's what Jason's tutorial uses.  At the moment, though, 11ty is just a way of getting an `index.html` live so I can feel confident my site is live.

Truly of interest to me right now is the content of the `functions` folder.  That's where my attention is headed next.

Without further ado, [here's my starter code for Netlify Functions _(with a side of 11ty)_](https://github.com/kkgthb/web-site-11ty-03-netlify-function).
Information Safety: Risks for App Users
Published: 2020-12-07 06:41:26

With the number of daily activities that require personal information, 
the chances of undesirable outcomes associated with the owner and the information itself elevate if we do not practice precautionary measures. Primarily, we are at risk from people with malign intents which can be present at any medium, whether in physical or cyber-related activities. Commonly, with companies collecting user's personal information, they hold a large sum of information which is enticing enough for professional hackers to break into. Nevertheless, the risk is not only from the third party. There are instances that companies require the users to agree in terms and conditions which hold the company's rights over the information flowing in and out of their service. With that, they pose the same threat. Most importantly, if the company was not able to safeguard the information, all of the users will be exposed to the risk of their information being misused.
GitHub repositories to improve your programming skills
Tags: javascript, python, aws, career
Published: 2020-12-07 06:30:51

## 1. Free Programming Books
Freely available programming books

167k ⭐

Repo: https://github.com/EbookFoundation/free-programming-books

## 2. Awesome
Awesome lists about all kinds of interesting topics

148k ⭐

Repo: https://github.com/sindresorhus/awesome

## 3. Coding Interview University
A complete computer science study plan to become a software engineer.

144k ⭐

Repo: https://github.com/jwasham/coding-interview-university

## 4. Developer Roadmap
Roadmap to becoming a web developer in 2020

138k ⭐

Repo: https://github.com/kamranahmedse/developer-roadmap

## 5. Public APIs
A collective list of free APIs for use in software and web development.

102k ⭐

Repo: https://github.com/public-apis/public-apis

## 6. Awesome Python
A curated list of awesome Python frameworks, libraries, software, and resources

89.9k ⭐

Repo: https://github.com/vinta/awesome-python

## 7. JavaScript Algorithms
Algorithms and data structures implemented in JavaScript with explanations and links to further readings

87.4k ⭐

Repo: https://github.com/trekhleb/javascript-algorithms

## 8. Node Best Practices
The Node.js best practices list 

55.8k ⭐

Repo: https://github.com/goldbergyoni/nodebestpractices

## 9. Real World
"The mother of all demo apps" — Exemplary fullstack Medium.com clone powered by React, Angular, Node, Django, and many more

50.9k ⭐

Repo: https://github.com/gothinkster/realworld

## 10. Tech Interview Handbook
Materials to help you rock your next coding interview

47.4k ⭐

Repo: https://github.com/yangshun/tech-interview-handbook

## 11. Clean Code JavaScript
Clean Code concepts adapted for JavaScript
42.3k ⭐

Repo: https://github.com/ryanmcdermott/clean-code-javascript

## 12. Free For Dev
A list of SaaS, PaaS and IaaS offerings that have free tiers of interest to devops and infradev

41.4k ⭐

Repo: https://github.com/ripienaar/free-for-dev

## 13. OG AWS
Amazon Web Services — a practical guide

27.7k ⭐

Repo: https://github.com/open-guides/og-aws

## 14. Awesome For Beginners
A list of awesome beginners-friendly projects.

26.1k ⭐

Repo: https://github.com/MunGell/awesome-for-beginners

## 15. Javascript Questions
A long list of (advanced) JavaScript questions, and their explanations.

26k ⭐

Repo: https://github.com/lydiahallie/javascript-questions

## Happy coding! ❤️

If you liked this article, be sure to ❤️ it.

Initially created on Twitter: 

{% twitter 1335833349672361984 %}
Sinema Haberleri
Tags: sinemahaberleri
Published: 2020-12-07 06:15:41

Birbirinden farklı garip olaylar, teknoloji içerikleri, oyun haberleri, oyun incelemeleri, dizi incelemeleri ve farklı konulara değinen sosyal içerik platformu.
https://www.webtapinagi.com/
Deadlock | Operating System - M04 P01
Tags: linux, devops, beginners, tutorial
Published: 2020-12-07 06:14:31

**This is a multipart blog article series, and in this series I am going to explain you the concepts of operating system. This article series is divided into multiple modules and this is the forth module which consists of 8 articles.**

_In this article we will discuss about deadlock and ways by which deadlock occurs in detail._

### Deadlock
- If two or more processes are waiting on happening of some event, which never happen then we say these processes are involved in deadlock and then it is known as deadlock.

<!-- Image one will come here -->

![Untitled Diagram.png](https://cdn.hashnode.com/res/hashnode/image/upload/v1607321504268/MVwgHrNUi.png)
### Conditions for deadlock are
- Mutual exclusion
- No preemption
- Hold and wait
- Circular wait

1. **Mutual exclusion:** It means that the resource process using should be used in mutual exclusive way. It _(resource)_ should not be used by more than one process at one time.

2. **No pre-emption:** No type/ chance of pre-emption would be there.

3. **Hold and wait:** Process `P1` is holding `R1` resource and waiting for `R2` resource while on the other hand process `P2` is holding `R2` resource and waiting for `R1` resource. `P1` and `P2` should not release any resource, if they do this then deadlock will not happen.

4. **Circular wait:** The above example is an example of circular wait, if there is circular wait, than deadlock can occur. Let’s see another example

<!-- Image two will come here -->

![Untitled Diagram (1).png](https://cdn.hashnode.com/res/hashnode/image/upload/v1607321518251/H2XmlxWEN.png)
***Note: If any one condition is not fulfilled than there may be chances that deadlock do not occur.***

_So this was all about deadlock in an operating system. Hope you liked it and learned something new form it._

If you have any doubt, questions, quires related to this topic or just want to share something with me, then please feel free to contact me.

### 📱 Contact Me

[Twitter](https://twitter.com/r_mishra10)
[LinkedIn](https://www.linkedin.com/in/rahul-mishra-66210b185)
[Telegram](https://t.me/rahul_mishra10)
[Instagram](https://www.instagram.com/rahul_mishra10/?hl=en)

### 📧 Write a mail
<rahulmishra102000@gmail.com>

#### 🚀 Other links

[GitHub](https://github.com/rahulMishra05)
[HackerRank](https://www.hackerrank.com/rahulmishra10201)
Micropyramid Requests Code Contribution for their Django Project
Tags: django, python, opensource, programming
Published: 2020-12-07 06:08:07

GitHub automates your workflow from idea to production.
Our project Django CRM is an open-source CRM developed in the Django framework. We welcome code contributions and feature requests via GitHub. We would be immensely happy if you give your precious time to our Django project. 
Visit us @ https://github.com/MicroPyramid/Django-CRM