teleren/devto huggingface dataset:
Using User-Agent-String while Web Scraping
Published: 2020-09-18 10:22:41

Is this happening even after passing it through a couple of free proxy servers?

It might be because the target website's algorithm might be picking up on who you are by the User-Agent-String signature that your curl request or any other library you might be using is sending. Even the absence of it is telling.

But if you do it well, you do get a lease of life, albeit only for a while.

What is User-Agent-String?

A browser’s user agent string (UA) helps identify which browser is being used, what version, and on which operating system. This was necessary to tell web servers to help them customize behavior or content to specific browser versions.

Chrome, for example, sends this information in the User-Agent HTTP header every time it makes a request to any site.
If fact, it is useful to have a list of these strings collected somewhere so you can rotate them when doing a curl request for a website.

In fact here is a function you can call to give you a random, valid string in PHP...
While this is ok in small scale projects or one time scraping needs, as you scale or as you need this more regularly, you will find it best to opt for a third party private rotating proxy service like Proxies API.

Our rotating proxy server Proxies API provides a simple API that can solve all IP Blocking problems instantly.

With millions of high speed rotating proxies located all over the world,
With our automatic IP rotation
With our automatic User-Agent-String rotation (which simulates requests from different, valid web browsers and web browser versions)
With our automatic CAPTCHA solving technology,
Hundreds of our customers have successfully solved the headache of IP blocks with a simple API.

The whole thing can be accessed by a simple API like below in any programming language.
Need to break my technology. Can you help?
Published: 2020-09-18 10:19:46

Yesterday I asked for help testing my new side project. It was great fun so I want to make it a challenge and get as many edge cases as possible. So here is the context. Basically, EdgeNet is going to be a SAAS service that converts your website into a static one and deploys it on a world wide CDN automatically. It also detects content changes and automatically syncs it. I am developing this because I needed a way to increase the page speed for many of my websites but wanted to retain the control that a CRM gives me. So I need as many websites as I can test. If you want a static version of your dynamic website (hosted on a sandbox) just for the kicks, throw in your website here and i will make a dynamic one and send you. Then tell me if you find any issues or have any other feedback.
Just Play with CSS Selector :)
Tags: css, html, javascript, wordpress
Published: 2020-09-18 10:05:48

1. Element selector
Ok before we move on to the more advanced interesting stuff, let’s quickly cover the basics. The elements selector lets you select and apply styling to all elements with the same specified element name.
It’s useful to apply styling to many elements of the same functionality without having to use a class for each. But, it might conflict with more specific rules.
Selecting all HTML paragraph elements looks like this:
The Rise of ERP Systems in 2020
Published: 2020-09-18 09:59:05

![ERP System](https://dev-to-uploads.s3.amazonaws.com/i/fp41gsf5c3csdjrqhwu9.png)

ERP ('Enterprise Resource Planning') is typically something that must be defined concisely because of the integrated management of core business processes. Such a system is usually mediated by software and technology which are the vital force governing this age.

We previously wondered alongside many others, 'Why use an ERP system?' Languages and context varied in the answer but the most gist of it had always been an equivalent, 'It's good for the business, aids you in increasing your profit and lowering your costs. it'll centralize your operations and assist you to keep track of everything.' And such answers were always accompanied by countless studies illustrating and emphasizing all the aforementioned arguments within all contexts.

There is a major issue though, which wasn't addressed in most answers; the element of transition and adaptation to a totally new and sophisticated software ruled by a complicated operations methodology. An ERP's effects on a corporation are often counterproductive the maximum amount because they are often advantageous or favorable if your personnel couldn't adapt.

Read more > [https://www.techultrasolutions.com/blog/our-blog-2/post/the-rise-of-erp-systems-in-2020-7](https://www.techultrasolutions.com/blog/our-blog-2/post/the-rise-of-erp-systems-in-2020-7)
Create a more personalized Github Profile
Tags: github
Published: 2020-09-18 08:29:23

Are you excited to make your [GitHub profile](https://github.com/ArifaMujawar) look better than it is now?

Here is an example of how I made mine look better presenting more about me.

![github-repo-creation](https://user-images.githubusercontent.com/29464058/93574073-9fd76b00-f9a0-11ea-90a8-f09e49e5588b.jpg)

So let's get started.

To create a more personalized GitHub README you need to start as follows.
* Go to your GitHub account
* Create a new repository with the same name as your user name as shown below

![github-repo-creation](https://user-images.githubusercontent.com/29464058/93573468-d5c81f80-f99f-11ea-984f-cccdae5d44d5.jpg)


* Make the repository public and initialize with a README.md 
* Click the "Create repository" button
* Start by making changes in the README.md file through GitHub editor which is the easiest way to do. You can also do it offline based on your preference and push back the changes to the repo when you are done

A few things that a README file should contain 
* A greeting message
* Bio about yourself
* Social media profiles
* Highlights, what all you are working on right now
  - [Github Stats](https://github.com/anuraghazra/github-readme-stats)
 - [Profile visitor tracker](https://visitor-badge.glitch.me/)
	
Try creating your Github Page and let me know in the comments the fun you had creating it.
	
Shower your love!!!
Great to be here
Published: 2020-09-18 09:45:55

I come here once in a while but just signed up today. I am a business analyst with a side passion for all things code. Presently romancing with react.js and may dump my love for WordPress.
I am so living the way I can reuse components with a single line of code.
The downside at the moment is the capacity of react.js for SEO as i intend to introduce this to my client base.
Any tips will be appreciated
My dream Svelte template using Sapper and Material UI
Tags: sapper, svelte, material, materialui
Published: 2020-09-18 09:38:38

**What ?**

A web app template using Sapper 0.28.0 and Svelte 3.17.3 with a Material UI theme based on Smelte 1.0.15 updated to September 25th, 2020

NOTE: TypeScript, PostCSS and CSS purging are included as a bonus.

**Why ?**

Because Material UI is cool and when used with Sapper and Svelte is really productive and powerful.

**How ?**

Run the commands:

```bash
npx degit csaltos/sapper-svelte-material-ui app1
cd app1
npm i
npm run dev
```

And open the browser at http://localhost:3000 to see a Sapper page done with a Material UI using Svelte.

**Where ?**

At https://github.com/csaltos/sapper-svelte-material-ui you will find the source code as a reference which is based on the original Sapper with Svelte template.

Please take special attention to the commit at [17a3021](https://github.com/csaltos/sapper-svelte-material-ui/commit/17a3021920bc82c237a4762f8c33fee2d3141ec3) which contains the exact change details to activate Material UI with Sapper using Smelte.

**Who ?**

This template is possible thanks to Maxim Matyunin and his cool [Smelte](https://github.com/matyunya/smelte) project and also Jacob Babich for his excellent [template](https://github.com/babichjacob/sapper-postcss-template) based on PostCSS. Also especial thanks to [dan](https://github.com/dan-unhuman/sapper-template-rollup-tailwind) for his reference code.

**IMPORTANT**: obviously this is only a starting point, please review the documentation at https://smeltejs.com/ and https://www.apostrof.co/blog/getting-tailwind-css-to-integrate-nicely-with-svelte-sapper/ for further steps.

**NOTE**: if you prefer to use Tailwind CSS with other UI please give it a check to a base project on https://dev.to/csaltos/tailwindcss-with-sapper-and-svelte-50ll
Beginners' free but exciting trip to ReactJS with CardGame!
Tags: react, javascript, redux, rails
Published: 2020-09-18 09:33:45

Hello All Beginners!
I would like to introduce one of my Reactjs example projects here.
It has used React, Redux, and axios to communicate with Rails based backend.

1 Minute's demonstration video here.
https://drive.google.com/file/d/1ouZHTJv2J71HVZSfRgqFxvaXuVi5pvkO/view?usp=sharing

It was very difficult to implement small & simple logic game with plain #JavaScript, but now with #ReactJS, and it gives us great possibility to build anything we want.
But here it also requires great wisdom and knowledge to divide and modularize the project into components.
And one more important thing is to manage the status flow with the sequences of user's activity.
Please feel free to take a look at the source repository.
Then you will notice easily about components, and state management.
Image Recognition Website using Python & Javascript 
Tags: python, javascript, vue, flask
Published: 2020-09-18 09:32:03

# Hello Community! 👋

## Example before we start

![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/qibnzu1un99zbs8qxzi6.png)

![Alt Text](https://dev-to-uploads.s3.amazonaws.com/i/q1k952682a5jgtypxlep.png)

## Background

So the other day I decided to dig deeper into Flask. Due to not having the opportunity to use it professionally I decided it would still be a fun framework to pick on the side. I started making some small API's for fun, testing them, getting a better feeling how it works.

After learning a thing or two I decided it would be fun to create a small app that would use my flask api and display the data. 

Image recognition is always an interesting topic so went on internet and found a really cool package from **TensorFlow**. It is called inception 2015 and it designed for image recognition. It is not super advanced and it works best with stuff like animals, food, etc. (also having transparent background as white helps, and having so many things happening inside the image usually signals worse results).

## Setup 

Setup is fairly simple and I would suggest visiting my Github page where I will link the app so you can test it yourself. There I have detailed setup so I will not repeat myself here if you don't mind.

## Info

I always like meeting new people and exchanging knowledge. So feel free to add me on linked in if you are interested.

My LinkedIn profile: https://www.linkedin.com/in/ferdo-vukojevic-2a9370181/
App Repo: https://github.com/fvukojevic/image_recognition
Live Demo: https://image-recognition.frans.thedev.id/  -> Credit goes to Frans Allen in the comments :) 

If you test the app and like it, **staring** it would help me greatly! ⭐

I'm still very new to this site so hopefully this post is fine.

Till next time! 🚀 🚀 🚀
A fast and simple way to scrape Amazon
Published: 2020-09-18 09:23:58

Web scraping helps in automating data extraction from websites. In this tutorial, we will build an Amazon scraper for extracting product details and pricing. We will build this simple web scraper using Python and SelectorLib and run it in a console.

Install Packages
1. SelectorLib : pip3 install requests requests selectorlib

Follow The Code From Here :- [Click Here](https://github.com/amogh9594/amazonscrape)
Màn Rèm nhựa pvc ngăn lạnh cao cấp Meci TP.HCM
Tags: mannhuapvcnganlanh
Published: 2020-09-18 08:53:04

Màn rèm nhựa pvc ngăn lạnh thương hiệu cao cấp MECI đã có mặt trên thị trường hơn 15 năm. Chúng tôi là nhà sản xuất nhập khẩu vật liệu rèm nhựa pvc ngăn lạnh, ngăn bụi bẩn, ngăn côn trùng số 1 tại Việt Nam
Meci Sài Gòn cam kết: 
- Đem tới bạn sản phẩm chất lượng nhất 
- Đội ngũ nhân viên tư vấn nhiệt tình
- Đội ngũ lắp đặt chuyên nghiệp, kinh nghiệm
- Bảo hành trọn gói sản phẩm

<img src="https://manremnhua.net/upload/sanpham/cuon-nhua-pvc-trang-duc-1-4240.jpg"/>

https://manremnhua.net/
Three Ways to Deploy Your App on Azure
Tags: azure, tutorial, cloud, devops
Published: 2020-09-18 08:43:51

#### 📺 024 - Jay Gordon 🎙️ Jason Hand


{% youtube a-DkXhwOdas %}

---

Join Jay Gordon and Jason who works together to use VM, containers, and app services to deploy a stateless application. We'll provide you with the code and methods to do it on your own.

---

### Useful Links

🔗 [Azure Fundamentals on Learn : AZ-900 on Learn](https://cda.ms/1wy)

🔗 [App Service docs](https://docs.microsoft.com/en-ca/azure/app-service/overview?WT.mc_id=allaroundazure-devto-jagord)

🔗 [Azure free credits](https://cda.ms/1wD)

🔗 [Github Actions](https://cda.ms/1wF)

🔗 [Azure Kubernetes Service](https://cda.ms/1wF)

🔗 [Creating Virtual Machines](https://cda.ms/1wH)

### Learn more about Jay Gordon

🔗 [Twittter: @jaydestro](https://twitter.com/jaydestro)

🔗 [Bio](https://developer.microsoft.com/en-us/advocates/jay-gordon)

### Find Us On

📺 [Twitch](https://www.twitch.tv/microsoftdeveloper)

🔗 [Twitter](https://twitter.com/jasonhand)

☁️
JavaScript Array Methods: map, filter, find, findIndex, fill, copyWithin, some, every, reduce
Tags: javascript, arrays, 100daysofcode, codenewbie
Published: 2020-09-18 08:27:21

{% youtube q8HdBLxs-fA %}

Enjoy the video 😀🙏

Also written version https://losseff.xyz/shorts/0020-javascript/
Optional arguments in Rust
Tags: rust
Published: 2020-09-18 08:24:31

---
title: Optional arguments in Rust
published: true
description: Three good ways to do it.
tags: rust
canonical_url: https://www.kirillvasiltsov.com/writing/optional-arguments-in-rust/
---

If you come to Rust from languages like Javascript which have support for optional arguments in functions, you might find it inconvenient that there is no way to omit arguments in Rust. However, there are good ways to simulate optionality and I'm even starting to think that they make code more readable than simply omitting things here and there.

## Approach #1: two functions

This is the least creative approach, but absolutely legitimate. The idea is to create **two** functions with different number of arguments.

```rust
fn add_two(a: usize, b: usize) -> usize {
    a + b
}

fn add_three(a: usize, b: usize, c: usize) -> usize {
    a + b + c
}
```

The third argument here is "optional" in the sense that you have the option to not use the function and use `add_two` instead.

## Approach #2: Option<T>

`Option` is meant to represent something that might exist or might not exist. We can definitely use it to represent optionality in function arguments!

```rust
fn greet_name_optional(name: Option<String>) {
    println!("Hello, {}!", name.unwrap_or(String::from("world")))
}

greet_name_optional(None);
greet_name_optional(Some(String::from("Ferris")));

// Hello, world!
// Hello, Ferris!
```

`unwrap_or` is handy when you want to provide a "default" value if `None` is passed. The cons of this approach is that you still have to pass `None` to `greet_name_optional` when there is nothing else to pass and wrap existing values in `Some`.

## Approach #3: Enum

Just like `Option` is simply an `enum`, we can create our own enum that better represents the thing that the function expects.

```rust
enum Name {
    Empty,
    Is(String),
}
```

This also allows us to provide the default value by implementing the `Default` trait:

```rust
impl Default for Name {
    fn default() -> Self {
        Name::Is(String::from("world"))
    }
}
```

The function then becomes very intuitive and easy to read:

```rust
fn greet_name(name: Name) {
    match name {
        Name::Empty => println!("Hello, {}!", Name::default()),
        Name::Is(value) => println!("Hello, {}!", value),
    }
}

greet_name(Name::Empty);
greet_name(Name::Is(String::from("Ferris")));

// Hello, world!
// Hello, Ferris!
```

I personally prefer the third approach for its readability, but it requires some work, because you might need to implement other traits like `Display` too.
A malware alert left hundreds of Bank of America customers panicking
Tags: malware, banking, phishing, security
Published: 2020-09-18 07:58:08

According to reports, hundreds of Bank of America customers had trouble accessing their bank accounts yesterday due to Avast and AVG antivirus engines flagging the site as “malware.”

Naturally, seeing a virus alert when visiting their banking website would worry any customer.

“I’m using Home Banking site for Bank of America. When I try to log in I get: *HTML:PhishingBank-COV \[Phish\]* virus warning… Bank of America says everything is fine on their end and that it is an error with Avast,” stated a [Reddit](https://www.reddit.com/r/avast/comments/iu9c9b/bank_of_america_phishing_alert/) user.

![](https://securityreport.com/wp-content/uploads/2020/09/avast_alert_bank_of_america_september_2020-1024x963.png)

**Avast flagging Bank of America website as infected with phishing malware**
*Source: Astra Security via their customer(s)*

A spokesperson at cybersecurity malware and threat monitoring company, [Astra Security](https://www.getastra.com/e/malware/signatures/html.phishing.bank) told *SecurityReport.com*, “We’ve received hundreds of hits on our system monitoring infections. And we spoke to multiple Bank of America customers about this who were concerned.”

One customer asked Astra, “When I log into my bank I get an anti-virus warning that there is an *HTML:phishingBank-COV* hack. Is this on my computer or coming from the bank?”

## Multiple reports of panicking users surfaced

Other reports about the malware alert surfaced on [Reddit](https://www.reddit.com/r/antivirus/comments/iu5mto/htmlphishingbankcov_phish/), along with panicky Twitter users questioning [what’s going on](https://twitter.com/thatdbacksfan/status/1306346902385025025)?

Some were concerned if Bank of America’s systems were [compromised](https://twitter.com/JohnnyRocketII/status/1306371949828825088).

As it turns out, Avast team confirmed yesterday, this was indeed [a false positive](https://forum.avast.com/index.php?topic=238078.msg1561240#msg1561240) and removed by Avast from their antivirus engines.

However, surely the panic this alert created left many users startled.

If you see an antivirus alert when accessing websites, it always helps to be cautious, should it turn out that it was your system that had been infected.

The users who posted about the alert on forums, and made phone calls to the bank did the absolute right thing. In this case, however, luckily an automated false positive detection was the reason behind the “noise” and no real phishing infection occurred.

Bank of America customers, therefore, remain safe and should have their Avast antivirus definitions updated automatically by now.

© 2020. All Rights Reserved. Originally produced for SecurityReport.com.
Take note of Foam - a place to manage your notes
Tags: foam, productivity, notetaking
Published: 2020-09-18 07:45:46

# Taking notes and keeping track

The sheer amount of information on the internet is insane. And, just speaking for myself, the amount of information I want to consume also seems enormous.

A lot of great things exist and the only thing keeping me from learning it is knowing its name.

And I think [Foam](https://foambubble.github.io/foam/) is one of those awesome things.

Foam is a note-taking framework of such. It's part a nice collection of markdown extensions and part something new.

Basically, Foam turns [VSCode](https://code.visualstudio.com/) into a very powerful node linked markdown note-taking power machine.

What I find really cool about this project is that it ditches the regular folder structure, and forces you to link notes by theme and content.

This ends up creating a connected graph of knowledge, where everything about buffer-overflow is linked even though it's written on your notes about C# and Haskell.

![Screenshot of dark mode foam vscode](https://dev-to-uploads.s3.amazonaws.com/i/mtltcpgw7cl3dgcttbpc.png)

From the webpage:
Whether you want to build a Second Brain or a Zettelkasten, write a book, or just get better at long-term learning, Foam can help you organize your thoughts if you follow these simple rules:

1. Create a single Foam workspace for all your knowledge and research by following the "Getting started" guide.
1. Write your thoughts in markdown documents (I like to call them Bubbles, but that might be more than a little twee). These documents should be atomic: Put things that belong together into a single document, and limit its content to that single topic.
1. Use Foam’s shortcuts and autocompletion to link your thoughts together with [[wiki-links]]\ (<-- this is how links look), and navigate between them to explore your knowledge graph.
1. Get an overview of your Foam workspace using a Graph visualization (⚠️ WIP), and discover relationships between your thoughts with the use of Backlinking.

Foam is like a bathtub: What you get out of it depends on what you put into it.


## I use Foam for keeping track of:

- What new cool buzzwords I hear,
- The status and problems I run into for the different projects I work on,
- The different tech blogs and related technologies I write about.

## Give it a swirl!
And let me know what you think about Foam, and having a second brain in general. Feel free to comment and ask questions!
Web development services in India
Published: 2020-09-18 07:45:27

Top Web Development Services:

E-Business Solutions

Our Web development services in India provides clients with End-to-End E-Business, B2B (Business to Business), BC2 (Business to Customer), E-Commerce Solutions for various industries and markets. We are determined to help our clients succeed in digital Market Place.

Custom Application Development

We are here to provide our clients with Feature rich, Secure, High performing and scalable Application Development Services. We can help you with your Web development strategy for various markets and we do this on a very competitive price.

Technology Consultancy

If you are confused about which technology to employ for your next Web application Project, then feel free to get in touch with us, we are here to help you about which technology tools are best suited for your requirements.

Enterprise Web Application Development

We are well known for providing Enterprise Web Application Development that are highly scalable to adapt themselves as your business grows. Our Enterprise Web Applications are focused on delivering high performance and excellent results.

Third Party API Integrations

If you require any third party services and component to be integrated with your Web application then we offer this service as well. Our Custom Web API Developers can create Web APIs, Connectors, Custom Data, Web services and Middleware for secure and effective integrations with these third-party services.

Prototyping & UXD

We possess rich Design expertise at our firm. We design and create such User Experiences that produce a stunning Application Interface and UX Design. We develop working prototypes from raw sketches according to your requirements.

Backend and Frontend Development

We offer secure and scalable web Application Solution services related to both Frontend development and backend programming. Our vast years of experience allows us to do this exceptionally.

Upgradation & Migration

If you already got a Website but is based on outdated web technologies, then we can help you to upgrade your website to the latest web technologies and to the latest platforms.

Now, at this point we would like to take you on a tour of different industries and market verticals we cater:

Online Market Places and Portals

Our Web Portal Development firm is fully capable of developing online marketplaces that connect a wide range of vendors, shops, and brands to the customers. A wide range of products can be made available to the customers at one place through these online market places.
Read here: https://www.aalpha.net/services/web-development-in-india/