AzureFunBytes Reminder - Intro to @Azure Data Factory with @KromerBigData - 5/13/2021
Tags: bigdata, azure, tutorial, beginners
Published: 2021-05-12 14:05:29

AzureFunBytes is a weekly opportunity to learn more about the fundamentals and foundations that make up Azure. It's a chance for me to understand more about what people across the Azure organization do and how they do it. Every week we get together at 11 AM Pacific on [Microsoft LearnTV](https://cda.ms/226) and learn more about Azure.

Data drives so many of our decisions.  Whether it's determining which products to have viewed first in our online retail store, or creating reports for business intelligence, we've got so much data!  It's time to figure out how to learn how to take that data and provide human-readable information that will help us continue to make the right decisions.  

This week on AzureFunBytes, I will be joined by [Principal Program Manager, Mark Kromer](https://twitter.com/KromerBigData) about how to store and process our big data with Azure Data Factory.  Mark will discuss the [ETL (Extract, Transform, Load)](https://cda.ms/27y) process that gets our data into [Azure Data Factory](https://cda.ms/27w).  I'll ask Mark [how can we transfer the data we might have to Azure](https://cda.ms/27B)? We'll look into how to create pipelines to automate the ingestion of our data from various data stores.

When: May 13, 2021 11 AM Pacific / 2 PM Eastern
Where: [Microsoft LearnTV](https://cda.ms/226)

{% youtube wB4Lc8Xh9NY %}

Our Agenda:

*  Introduction to Azure Data Factory
* How to get started
* Implementing data pipelines for automation
* Connecting to various data sources
* Demos
* Q&A

From the Azure Documentation "[What is Azure Data Factory?](https://cda.ms/27r)"

![Overview of Data Factory](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/9jbmy22v1lufk8rimbic.png)

[Azure Data Factory](https://cda.ms/27w) is the platform that solves such data scenarios. It is the *cloud-based ETL and data integration service that allows you to create data-driven workflows for orchestrating data movement and transforming data at scale*. Using Azure Data Factory, you can create and schedule data-driven workflows (called pipelines) that can ingest data from disparate data stores. You can build complex ETL processes that transform data visually with data flows or by using compute services such as [Azure HDInsight Hadoop](https://cda.ms/27D), [Azure Databricks](https://cda.ms/27F), and [Azure SQL Database](https://cda.ms/27G).

Integrate all your data with Azure Data Factory—a fully managed, serverless data integration service. Visually integrate data sources with more than 90 built-in, maintenance-free connectors at no added cost. Easily construct ETL and ELT processes code-free in an intuitive environment or write your own code. Then deliver integrated data to Azure Synapse Analytics to unlock business insights. 

So let's connect and collect together and talk about [big data](https://cda.ms/27H)!  We'll take questions from the audience and try to understand how all the pieces fit together to gain important insights that drive our businesses.

---

Learn about Azure fundamentals with me!

Live stream is available on Twitch, YouTube, and LearnTV at 11 AM PT / 2 PM ET Thursday. You can also find the recordings here as well:

[AzureFunBytes on Twitch](https://twitch.tv/azurefunbytes)
[AzureFunBytes on YouTube](https://aka.ms/jaygordononyoutube)
[Azure DevOps YouTube Channel](https://www.youtube.com/channel/UC-ikyViYMM69joIAv7dlMsA)
[Follow AzureFunBytes on Twitter](https://twitter.com/azurefunbytes)

Useful Docs:

[Get $200 in free Azure Credit](https://cda.ms/219)
[Microsoft Learn: Introduction to Azure fundamentals](https://cda.ms/243) 
[Microsoft Learn: Integrate data with Azure Data Factory or Azure Synapse Pipeline](https://cda.ms/27K)
[Microsoft Learn: Data integration at scale with Azure Data Factory or Azure Synapse Pipeline](https://cda.ms/27L)
[Azure Data Factory](https://cda.ms/27w) 
[Azure Data Factory documentation](https://cda.ms/27x) 
[Azure Data Factory Tutorials](https://cda.ms/27J)
[Extract, transform, and load (ETL)](https://cda.ms/27y)
[Transferring data to and from Azure](https://cda.ms/27C) 
[Big data architecture style](https://cda.ms/27H)
[Watch our snack-sized video tutorials here to learn more about building ETL with data flows](https://www.youtube.com/channel/UC2S0k7NeLcEm5_IhHUwpN0g/videos) 
[Follow the Delta Lake tutorial here to build your own lake](https://cda.ms/27s)
[Branching and chaining activities in an Azure Data Factory pipeline using the Azure portal](https://cda.ms/27t) 
[For access to the taxi medallion sample data to build these pipelines on your own, visit Mark's sample data repo here and look for trip data and trip fare](https://github.com/kromerm/adfdataflowdocs/tree/master/sampledata)