Master the Art of Azure Data Factory
Tags: azure, azuredatafactory, tutorial, beginners
Published: 2023-02-20 02:23:02


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/34tw985kf8ed98ox7c2z.jpg)

Excited to share  latest video series on Azure Data Factory! Learn the basics of ADF, how to debug pipelines and activities, and various techniques to copy data from different sources to different destinations. Whether you're a beginner or an experienced user, you're sure to learn something new! Check out the full playlist here

The playlist is focused on teaching various aspects of Azure Data Factory, which is a cloud-based data integration service that allows you to create, schedule and manage data pipelines. It includes videos covering the basics of Azure Data Factory, how to create data pipelines, how to debug pipelines and activities, how to do data wrangling, how to use data flows, how to create and use a self-hosted integration runtime, and how to copy data from various sources to destinations like Azure Blob Storage, Snowflake, and Azure Cosmos DB. There are also videos on how to connect Azure Data Factory with other services like Log Analytics and Azure DevOps, and how to run SSIS packages and R scripts using Azure Data Factory. The playlist covers a range of topics that will be useful for those looking to learn more about data integration in the cloud with Azure Data Factory.

**Introduction to azure data factory | What is Azure Data Factory | Create Data Factory First Pipeline**

	{% embed https://www.youtube.com/watch?v=k2EugJ4MLDU&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=1&t=6s %}

**How to Debug Pipeline and Activity in Azure Data Factory**

	{% embed https://www.youtube.com/watch?v=8B-mlUunQqg&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=2&t=175s %}

**Azure Data Factory - Incrementally load data from Azure SQL to Azure Data Lake using Watermark**

	{% embed https://www.youtube.com/watch?v=_Ce-b6Dz1Wg&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=3 %}

**How to create and use data flow in Azure Data Factory**
	{% embed https://www.youtube.com/watch?v=ySvg0lTmdlY&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=4 %}

**Azure Data factory Data wrangling | How to do Data wrangling in Azure Data Factory**
	{% embed https://www.youtube.com/watch?v=sPTERXmYnBs&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=5 %}

**Azure Data Factory - Incremental Load From SQL Managed Instance to Lake using Change data Capture**
	{% embed https://www.youtube.com/watch?v=VU5LDEeITtU&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=6 %}

**Azure Data Factory-Incrementally copy files based on LastModifiedDate by using the Copy Data tool**
	{% embed https://www.youtube.com/watch?v=qL2koYlXRFw&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=7 %}

**How to create Self-hosted Integration runtime in Azure Data Factory and Azure Synapse analytics**
	{% embed https://www.youtube.com/watch?v=qtU5UMR1H-M&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=8 %}

**Copy data from a On Premise SQL Server database to Azure Blob storage using azure data factory**
	{% embed https://www.youtube.com/watch?v=cOy9DIumrO8&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=9 %}

**Azure Data Factory-Incrementally copy files based on time partitioned file name using Copy Data tool**
{% embed 	https://www.youtube.com/watch?v=z6n9nuApGdI&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=10 %}

**How to use Azure Data Factory with snowflake | Copy data from Snowflake to Azure Blob using ADF**	
{% embed https://www.youtube.com/watch?v=dBQsX-i5K5k&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=11 %}

**Microsoft Azure SQL Server Database to Snowflake using azure data factory in minutes**

	{% embed https://www.youtube.com/watch?v=5rLbBpu1f6E&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=12 %}

**Copy Data from Snowflake to Azure Cosmos DB using azure data factory**
	{% embed https://www.youtube.com/watch?v=1FleIffmUZU&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=13 %}

**Load data from Azure Blob to Snowflake using Azure Data Factory**

	{% embed https://www.youtube.com/watch?v=ODNSKLv68tI&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=14 %}

**How to Connect Azure Data Factory with Log Analytics and setup alerts**
	{% embed https://www.youtube.com/watch?v=qPpm3X4wgEI&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=15 %}

**Create an Azure Data Factory, Storage ,Linked Service , Datasets , Pipeline using Bicep**

	{% embed https://www.youtube.com/watch?v=aHBogGiR0rw&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=16 %}

**Create an Azure Data Factory, Linked Services, Datasets, Pipeline , Run and Monitor using PowerShell**

	{% embed https://www.youtube.com/watch?v=zwicKbBQn_w&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=17 %}

**How to use Azure Data Factory with managed virtual network and private endpoints**

	{% embed https://www.youtube.com/watch?v=wimhWlBq9gk&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=18 %}

**How to connect azure devops repo with azure data factory**
	
{% embed https://www.youtube.com/watch?v=a-FJ5Ra9GWM&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=19 %}

**Create an Azure-SSIS integration runtime in Azure Data Factory or Azure Synapse Analytics**

	{% embed https://www.youtube.com/watch?v=9LO9z-3uZWo&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=20 %}

**How to Run an SSIS package in Azure Data Factory**	
{% embed https://www.youtube.com/watch?v=SVpobjQdQxU&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=21 %}

**Run R scripts as part of a pipeline through Azure Data Factory using Azure Batch**

	{% embed https://www.youtube.com/watch?v=uFw3FL7eaO0&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=22 %}

**How to Run an Azure Databricks Notebook with Azure Data Factory**
	
{% embed https://www.youtube.com/watch?v=w_neG_E_mzI&list=PLDgHYwLUl4HjByRBWGuzE6xCYThC6fVXJ&index=23 %}


#AzureDataFactory #CloudDataIntegration #DataWrangling #DataEngineering