teleren/devto huggingface dataset:
Use the Serverless Cloud for ETL Scenarios
Tags: azurefunctions, cloudmigration, azure, sqlserver
Published: 2018-07-13 15:08:54

---
title: Use the Serverless Cloud for ETL Scenarios
published: true
tags: azure-functions,cloud-migration,azure,sql-server
canonical_url: https://blog.jeremylikness.com/use-the-serverless-cloud-for-etl-scenarios-bb7f967edde5
---

#### A real world scenario that leverages Azure Functions

The essence of _serverless_ is _less server_. The details of the server are abstracted away and the developer is able to focus on code without getting bogged down in infrastructure concerns. Extract, Transform, and Load (ETL) is a common scenario in enterprise applications that serverless applications are uniquely positioned to address. Developers are able to handle file uploads, set timers and schedules, and run transformations using serverless without touching hardware, installing third-party services or writing custom polling software.

![](https://cdn-images-1.medium.com/max/1024/1*2LmO4DODWQ5RESOg4vuNXQ.png)<figcaption>Common ETL scenario addressed by this walk through</figcaption>

There is a better way! As much as I love to speak and write about serverless, I still believe the best way to learn what it is, and understand its value, is to go hands-on. To give you a full end-to-end scenario, I wrote a walk through and published it to GitHub.

[JeremyLikness/azure-fn-file-process-hol](https://github.com/JeremyLikness/azure-fn-file-process-hol)

This lab exposes you to the full spectrum of capabilities and workflows associated with serverless application development. You will:

1. Create a [serverless Azure function](https://jlik.me/cac) locally and debug it on your machine (no Internet required) using the cross-platform functions host
2. Set up a trigger to automatically detect when a file is uploaded to file storage — no polling required (and you’ll also test this locally using the Azure Storage Emulator)
3. Create a local SQL database that represents a common scenario: the _legacy on-premises database_
4. Learn how to use [Entity Framework](https://jlik.me/cah) in Azure Functions by parsing a CSV file and inserting new records into the database
5. Create a cloud-hosted Azure SQL Database and migrate your local database to the cloud
6. Deploy your local code to Azure
7. Run the full process entirely from the cloud without configuring a single piece of hardware or consulting with a DBA

If the previous list includes scenarios you are interested in and would like to learn more about, carve out an hour on your schedule and head on over to the [hands-on walk through](https://github.com/JeremyLikness/azure-fn-file-process-hol)!

![](https://cdn-images-1.medium.com/max/197/1*KwXn3ElS7vnWIk8lNVhBsA.gif)

* * *
Cryptocurrencies Without Blockchain? Learn More About DAG
Tags: blockchain
Published: 2018-03-30 14:15:49

---
title: Cryptocurrencies Without Blockchain? Learn More About DAG
published: true
tags: Blockchain
canonical_url: https://perfectial.com/blog/dag-vs-blockchain/
---

Scaling a [blockchain](https://perfectial.com/blog/blockchain-transforms-finance-healthcare-music-industry/) has proved to be a daunting, complicated task. Bitcoin, a trailblazer for all digital currencies, has been a stagnant, low-throughput network for years for this very reason.

Currently, there are many initiatives circling around the crypto space that are aimed to enhance Bitcoin’s (and other platform’s) TPS. Some experts motion to have the block size increased, others want the processing time on the network to be reduced. There’s a great deal of debate as to which variable should be changed and, given how resentful the Bitcoin community is to any modifications, there’s no telling when the issue will be tackled.

Some projects, however, offer a more radical approach to remedy blockchain’s problems: they’ve built completely new networks which do not use the blockchain data structure at all. The likes of IOTA and Byteball, which have already made waves in the crypto space, are set to redefine how cryptocurrencies are hosted. Instead of blockchain, they’re seeking to implement something called [Directed Acyclic Graph (DAG)] (https://perfectial.com/blog/dag-vs-blockchain/).

Today, we’ll provide a brief overview of what is DAG, how the directed acyclic graphs work and describe, in detail, what IOTA and Byteball are trying to achieve by using it.

## What is a [Directed Acyclic Graph](https://perfectial.com/blog/dag-vs-blockchain/)?

![What is a DAG (Directed Acyclic Graph)?](https://perfectial.com/wp-content/uploads/2018/03/img3-4.jpg)

As far as data structures go, Blockchains can be thought of as simple [linked lists](https://www.geeksforgeeks.org/linked-list-set-1-introduction/). Each entry on Bitcoin or Ethereum (or other networks) is put on top of the previous one to which it holds a reference. That’s how we get a linear sequence of digital events that we call a chain.

Blockchains allow one to track down any record stored in a ledger’s history, but their sequential structure is also what hinders significantly their transaction throughput; the flat list nature of blockchains is the biggest bottleneck for their ability to scale.

Well, a [DAG operates](https://en.wikipedia.org/wiki/Directed_acyclic_graph) differently. This data structure resembles a flow chart where all points are headed in one direction. You can compare a Directed Acyclic Graph (DAG) to a file directory structure where folders have subfolders that branch into other subfolders and so on; they are tree-like.

The word acyclic just means that no node in the graph can reference back to itself; it can’t be its own mother node.



The post [Blockchain vs DAG (Directed Acyclic Graphs) vs Byteball](https://perfectial.com/blog/dag-vs-blockchain/) appeared first on [Software Development Company Perfectial](https://perfectial.com).
Compiling templates in Javascript
Tags: discuss, javascript, compile
Published: 2018-03-13 13:47:23

---
title: Compiling templates in Javascript
published: true
description: What’s your take on compiling templates down?
tags: discuss,javascript,compile
---

I’ve been at an impass recently, unsure where to go. We currently ship 150 template segments (or view/model pairs) with our products, we’ve been very strict about definitions to ensure consistency, the only struggle we’re now running into is file size.

Currently we produce a 10kb minified file, and we’re fine with this, but a new project we have will produce a 1mb minified file for the entire application, and the majority is the template engine bloat, so we’re considering rewriting our template system. 

Here’s how it works currently:

1. Define a view and model pair (template segment)

2. Write the markup

3. Bind events, etc on the model

4. The model commits to the view in a cloned representation of the DOM, we do a basic diff, and fire the DOM changes at once along with other components that need to update

One developer suggested we keep the approach, but add two important factors:

On compile, we should replace the template HTML with a representation of the node, for example we turn:

“<p>content</p>” ....

Into an array, and make each element have types by ID, map them to a “database” object of types, compose the strings into numbers based on letter and type, then instead of the giant bloat we have, we can ship some ints that represent our markup. He demonstrated a proof of concept, the file size dropped to 145kb, the fundemential Question is, is this worth it? 

Another developer suggested simply shipping a block render engine, and polling blocks as straight HTML files. I’ve never been a fan of this structure as I want to ship everything collapsed together, so if there’s no network we can still populate and run, and sync when back online. 

All this being said, any ideas on where to go from here? Our target range is under 110kb file size
Trusted self-signed certificate on local Windows machine
Tags: новости
Published: 2019-09-02 08:17:14

---
title: Trusted self-signed certificate on local Windows machine
published: true
---

This is cross-post from [my blog](https://dobryak.org/trusted-self-signed-certificate-on-local-windows-machine/).

I created powershell script to automate generation of locally trusted self-signed certificate. It will create root certificate, to be used as signing certificate for future generation of other certificates. 

Please, see script at [my repository here](https://github.com/akuryan/ConfigurationHelpers/tree/master/Win%20server/sslCertificate-gen). I hope it will help.

After certificates have been generated - you can share them with your developers: export as PFX certificate for your domain, and export as CER file certificate from LocalMachine/Root which is issue to "DONOTTRUST-LocalSigningCertificate". Your fellow developer shall import CER file (certificate without key) to "LocalMachine/Root", PFX - to "LocalMachine/My" and can work with self-signed locally trusted certificate happily (NOTE: you could not use this certificate in open, as it would not be trusted by default - that's only for development purposes to save time and money)
Things to think when changing a existing system
Tags: discuss, data, dataengineer
Published: 2018-03-13 13:29:59

---
title: Things to think when changing a existing system
published: true
tags: discuss,data,data_engineer
---

Hey people, I am a junior software engineer, so to all the experienced folks out there. If you are going to change logic of a existing system (produces quite a lot of data) and is consumed by some teams. what steps/precautions would you take ?
New ODBC Driver for Amazon Redshift and Upgraded ODBC Drivers for Desktop and Clouds 
Tags: odbcdriver, databasesoftware, development, developmenttools
Published: 2018-03-13 12:18:59

---
title: New ODBC Driver for Amazon Redshift and Upgraded ODBC Drivers for Desktop and Clouds 
published: yes
description: Devart released new ODBC Driver for Amazon Redshift and updated versions of ODBC drivers with a number of new useful features (https://www.devart.com/odbc/sqlserver/).
tags: odbc driver, database software, development, development tools 
---
Explain Static Generated vs. Pure HTML Sites Like I'm Five
Tags: explainlikeimfive, html, ssg, markdown
Published: 2018-03-13 12:14:09

---
title: Explain Static Generated vs. Pure HTML Sites Like I'm Five
published: true
tags: #explainlikeimfive #html #ssg #markdown
---

Good people of the interwebs, please sort me out here. So, if the ultimate goal of static site generators (SSGs) is to output html files, then wouldn't it make sense to just create/write and then upload the HTML, CSS, and Javascript files directly to a host server vs. creating them in some kind of markdown language and framework first? Is the only reason for using markdown and using a generator like Jekyll, Hugo, etc, is because of readability issues when it comes to writing and reading the code? In other words, I could just create straight up HTML, CSS, and Javascript files, them load them to a server. Why should I go through the extra effort, time, etc. to introduce another language and framework into this when the ultimate output is the same?
What's your developer 'bible'?
Tags: programming, books, development, education
Published: 2018-03-13 08:47:49

---
title: What's your developer 'bible'?
published: true
description: Books which influenced you as a developer
tags: #programming #books #development #education
---

When I was a junior back in the days where Java was 'on fire', I bought a book which influenced me as a developer a lot till nowadays - it's 'The Pragmatic Programmer - From Journeyman to Master'. Even today, where I consider myself a 'senior' developer, it gives me still good advice and I recommend this book to all newbies and juniors.

Do you have a book like this which influenced you as a developer? Show your recommendations!
Moving from Laravel to Symfony
Tags: symfony, laravel, php, frameworks
Published: 2018-03-13 08:28:44

---
title: Moving from Laravel to Symfony
published: true
description: My process of switching PHP frameworks
tags: symfony, laravel, php, frameworks
---

Hi,

I'm writing about my progress of learning Symfony framework while knowing Laravel already. You can find 3 articles here:

https://medium.com/from-laravel-to-symfony

New parts will be coming nearly every day now.
The StackOverflow 2018 Developer Survey Results are live!
Tags: discuss, news
Published: 2018-03-13 08:07:12

---
title: The StackOverflow 2018 Developer Survey Results are live!
published: true
description: 
tags: discuss, news
---

Over 100,000 developers from all over the world took the survey this year and the results are live!

https://insights.stackoverflow.com/survey/2018/
C# ASP.Net MVC API Web App Using Advanced DB Master as a Data Source
Tags: code, fyi, howto, adbm
Published: 2018-04-08 18:24:08

---
title: C# ASP.Net MVC API Web App Using Advanced DB Master as a Data Source
published: true
tags: Code,FYI,How To,ADBM
canonical_url: 
---

Been wondering how to build a C#, ASP.Net, MVC, API web app using ADBM (Advanced DB Master) data source on the back end?  You’re welcome.

[Demo source on GitHub](https://github.com/cjfleischhacker/ADBM.API).

Install Advanced DB Master (ADBM) from [http://maconsys.com](http://maconsys.com) then open the Sample database, ADBMSamp, and exit ADBM.

ADBM added a System DSN ODBC datasource called adbmsamp to your OS.

![SystemDSN.PNG](https://chrisfleischhacker.files.wordpress.com/2018/03/systemdsn.png?w=646)

In Visual Studio, create a C# ASP.Net Framework or Core Web Application.

![VisualStudioProject.PNG](https://chrisfleischhacker.files.wordpress.com/2018/03/visualstudioproject.png?w=646)

And select Web API, leaving the MVC and Web API boxes checked.

![WebAPI.PNG](https://chrisfleischhacker.files.wordpress.com/2018/03/webapi.png?w=646)

Optionally, you can add the data source as a database connection and work with it that way if you prefer, but that’s not necessary.

![DatabaseConnection.PNG](https://chrisfleischhacker.files.wordpress.com/2018/03/databaseconnection.png?w=646)

For our needs we’ll just need a connection string in the web.config:

\<connectionStrings\>  
\<add name=”csADBMSamp” connectionString=”DSN=adbmsamp” /\>  
\</connectionStrings\>
How can I upload profile image?
Tags: meta
Published: 2018-03-13 03:27:30

---
title: How can I upload profile image?
published: true
description: 
tags: meta
---

Hi anybody, how can I upload my profile image into dev.to? I want change my profile image.

I can't find upload button in setting page...
![setting page](https://thepracticaldev.s3.amazonaws.com/i/r98lx950roisw8rusgxy.png)

プロフ画像変えられない…
Do you use Static Typing in JavaScript?
Tags: discuss, javascript, node, typescript
Published: 2018-03-13 03:24:39

---
title: Do you use Static Typing in JavaScript?
published: true
canonical_url: https://www.iamdeveloper.com/posts/do-you-use-static-typing-in-javascript--2ek4/
cover_image: https://thepracticaldev.s3.amazonaws.com/i/rtb2j7q2w78u79q0xahm.png
tags: discuss, javascript, node, typescript
---

I wrote an article last year, [Consider Using TypeScript](https://dev.to/nickytonline/why-you-might-want-to-consider-using-typescript-6j3), to explain some of the benefits of using TypeScript and I'm just curious for those in the JS ecosystem if you use a language like [TypeScript](typescriptlang.org), [Reason ML](https://reasonml.github.io/), or Facebook's [Flow](https://flow.org) type checker.

This [short post](http://2ality.com/2018/03/javascript-typescript-reasonml.html) on the [2ality blog](http://2ality.com) is relevant and a good read as well.

If you currently don't use one of the above, are you considering trying one of them? If you did try or use one of them, what kinds of issues, if any did you have?  Difficult to setup? Learning curve etc.

{% twitter 972285677172875264 %}
Brief intro to Evolutionary Architecture
Tags: architecture, meetup, softwaredevelopment, thoughtworks
Published: 2018-03-13 01:39:21

---
title: Brief intro to Evolutionary Architecture
published: true
description: Brief intro to the concept of Evolutionary Architecture
tags: architecture, meetup,  software-development, ThoughtWorks
cover_image: https://thepracticaldev.s3.amazonaws.com/i/rp5t763suuohftfo1xrt.png
---


A few weeks ago I attended a talk organised by Thoughtworks about "[Building Evolutionary Architectures](https://info.thoughtworks.com/evolutionary-architecture-london.html)". This was a very interesting and important subject, which addressed the issues that most software development teams will encounter at one point or another. The main one being  [Tech Debt](https://martinfowler.com/bliki/TechnicalDebt.html), and how to monitor, reduce and prevent the same type of Tech from re-occurring.

This topic addresses the new kid on the block, Microservices, and how this new architecture has made us rethink how we design software.

  
"For many years, software architecture was described as "the parts that are hard to change later". But then microservices showed that if architects build _evolvability_ into the architecture, change becomes easier."  
  

"Incremental change is critical for the mechanics of evolution, while uncontrolled evolution leads to undesirable side effects. Predictability is impossible when the foundation architects plan against changes constantly in unexpected ways. Instead, prefer **evolvability over predictability**."

One of the focus of the talk was "**Fitness Function**", which is described as follows:

"Mathematically speaking, a function takes input from some allowed set of input values and produces an output in some allowed set of output values. In software, we also generally use the term function to refer to something that is actually implementable. However, as with acceptance criteria in agile software development, the fitness functions for evolutionary architecture may not be implementable in software (e.g., a required manual process for regulatory reasons), but architects must still define manual fitness functions to help guide the evolution of the system. While automated checks are preferable, some projects cannot automate all fitness functions. Thus, it is still useful for architects to elucidate architectural verifications explicitly as fitness functions for many reasons that will become evident."

Conveniently some of the people at ThoughtWorks have just published a book called "**Building Evolutionary Architectures**", you can download a free chapter  [here](https://www.thoughtworks.com/books/building-evolutionary-architectures).

**Source:**
[Building Evolutionary Architectures](https://info.thoughtworks.com/evolutionary-architecture-london.html)
How does daylight savings time effect your dev?
Tags: discuss
Published: 2018-03-12 23:28:31

---
title: How does daylight savings time effect your dev?
published: true
tags: discuss
---

I find that when it gets dark later at night, somehow I seem to have more energy to stay up and work on all of those fun projects I like to play with at night. How does daylight savings time effect you?
Extract the text data from PDF file using Aspose.PDF for .NET
Tags: csharp, pdf
Published: 2018-03-12 22:54:24

---
title: Extract the text data from PDF file using Aspose.PDF for .NET
published: true
description: Extract the text data from PDF file using Aspose.PDF for .NET
tags: #csharp, #pdf
---

While dealing with Portable Document Format files, at times, you might need to extract text from a PDF file.
Aspose.PDF several classes to extract the data: 

* [TextAbsorber](https://apireference.aspose.com/net/pdf/aspose.pdf.text/textabsorber/),
* [TextFragmentAbsorber](https://apireference.aspose.com/net/pdf/aspose.pdf.text/textfragmentabsorber), 
* [ParagraphAbsorber](https://apireference.aspose.com/net/pdf/aspose.pdf.text/paragraphabsorber). 

The easiest way to extract the data from PDF is using TextFragmentAbsorber with the default options:  

{% gist https://gist.github.com/andruhovski/39593d8ca8275f83d4048ec9de521b2d %}

TextAbsorber performs text extraction and provides access to the result via Text object. In this case, we'll get all text data in one single object.
Call the **Accept** method on a particular page of the Document object. The Index is the particular page number from where text needs to be extracted.

{% gist https://gist.github.com/andruhovski/9e5a70999ee8115c5ae0c105bb35f19f %}

Sometimes we need to extract the text from the particular area (i.e. the left upper corner of the page). TextAbsorber also can do it. We'll need to setup TextSearchOptions property. In the following example, we'll set up a LimitToPageBounds property and a Rectangle property. The last takes Rectangle object as a value and using this property, we can specify the region of the page from which we need to extract the text. In our example, the LimitToPageBounds property indicates that text is searched within the page bound and the Rectangle property indicates to the upper half of page.

{% gist https://gist.github.com/andruhovski/9a64df16008f601376aa793f17676b10 %}

The TextFragmentAbsorber object is basically used in text search scenario. When the search is completed the occurrences are represented as text fragments collection. The TextFragment object provides access to the search occurrence text, text properties, and allows to edit text and change the text state (font, font size, color etc).

{% gist https://gist.github.com/andruhovski/dc092119bc158565283014fc0accbe08 %}

The ParagraphAbsorber class performs the search for sections and paragraphs of text and provides access for rectangles and polygons that describe it in text coordinate space.

{% gist https://gist.github.com/andruhovski/7347a6af6ecb5250350b4e5c6b583efe %}
From Linux to Mac OS X
Tags: linux, mac, osx, webdev
Published: 2018-03-12 19:43:01

---
title: From Linux to Mac OS X
published: true
description: 
tags: linux, Mac, OS X, web development
---

![alt text](https://thepracticaldev.s3.amazonaws.com/i/jpz7znb4lp1eew4ly39j.jpg)

Hi all!

Recently I started on a new Web DEV job and now, I must code with Mac. I use GNU/Linux on my personal projects so I would like to read some advices from people that "suffered" that change. Software, extensions ... are allowed too :D

PD: sorry for my english level, I'm trying to improve ; )