Azure Databricks Momentum at Microsoft Ignite 2019Skip to main contentPlatformThe Databricks Lakehouse PlatformDelta LakeData GovernanceData EngineeringData StreamingData WarehousingData SharingMachine LearningData SciencePricingMarketplaceOpen source techSecurity and Trust CenterWEBINAR May 18 / 8 AM PT
Goodbye, Data Warehouse. Hello, Lakehouse.
Attend to understand how a data lakehouse fits within your modern data stack.
Register nowSolutionsSolutions by IndustryFinancial ServicesHealthcare and Life SciencesManufacturingCommunications, Media & EntertainmentPublic SectorRetailSee all IndustriesSolutions by Use CaseSolution AcceleratorsProfessional ServicesDigital Native BusinessesData Platform MigrationNew survey of biopharma executives reveals real-world success with real-world evidence.
See survey resultsLearnDocumentationTraining & CertificationDemosResourcesOnline CommunityUniversity AllianceEventsData + AI SummitBlogLabsBeaconsJoin Generation AI in San Francisco
June 26–29
 
Learn about LLMs like Dolly and open source Data and AI technologies such as Apache Spark™, Delta Lake, MLflow and Delta SharingExplore sessionsCustomersPartnersCloud PartnersAWSAzureGoogle CloudPartner ConnectTechnology and Data PartnersTechnology Partner ProgramData Partner ProgramBuilt on Databricks Partner ProgramConsulting & SI PartnersC&SI Partner ProgramPartner SolutionsConnect with validated partner solutions in just a few clicks.Learn moreCompanyCareers at DatabricksOur TeamBoard of DirectorsCompany BlogNewsroomDatabricks VenturesAwards and RecognitionContact UsSee why Gartner named Databricks a Leader for the second consecutive yearGet the reportTry DatabricksWatch DemosContact UsLoginJUNE 26-29REGISTER NOWCategoriesAll blog postsCompanyCultureCustomersEventsNewsPlatformAnnouncementsPartnersProductSolutionsSecurity and TrustEngineeringData Science and MLOpen SourceSolutions AcceleratorsData EngineeringTutorialsData StreamingData WarehousingData StrategyBest PracticesData LeaderInsightsIndustriesFinancial ServicesHealth and Life SciencesMedia and EntertainmentRetailManufacturingPublic SectorAzure Databricks Highlights Adoption of Delta Lake, MLflow, and Integration with Azure Machine Learning at Microsoft Ignite 2019by Abhinav Garg and Clinton FordNovember 20, 2019 in Company BlogShare this postAt Microsoft Ignite 2019, thousands of attendees participated in hands-on workshops, breakout sessions, and theater presentations to learn how customers are achieving phenomenal results with Azure Databricks! It was an action-packed week of making new connections and learning about new innovation across data science, data engineering, and business analytics.
We shared the news that over 75% of data processed on Azure Databricks is in Delta Lake -- the new open source standard for data lakes. Hands-on labs and breakout sessions gave attendees an opportunity to see and experience Delta Lake on Azure Databricks first hand.

Delta Lake’s openness and extensibility enable faster innovation and more effective use of data. Azure Databricks has seen amazing growth over the past two years. This rapid growth has created the need for new tools and capabilities such as the MLflow Model Registry and ML lifecycle management which help customers track, deploy, and update their ML models. Attendees learned three ways Azure Databricks works with Azure Synapse Analytics to bring analytics, business intelligence (BI), and data science together in one solution architecture.
Azure Databricks momentum and acceleration were highlighted in many sessions during the week of Ignite 2019. Below are just a few sessions to give you an idea of the breadth of customer use cases driving such phenomenal growth.
Azure Databricks Sessions at Ignite 2019Delta Lake on Azure Databricks: Implementing a new open source standard for Data Lakes (THR2339) - Ajay Singh from Databricks shared how you can enhance your data lakes for greater value by adding new capabilities for transactions, version control and indexing using the latest open source innovations. Founded by the original creators of Apache Spark, Databricks has continued to innovate by launching a new open source project called Delta Lake designed to make existing data lakes more scalable and reliable. Built on top of infinitely scalable Azure Data Lake Storage and deeply integrated with Azure SQL Data Warehouse, Delta Lake on Azure Databricks makes data better prepared for analytic and machine learning workloads. Available today as part of Azure Databricks, see why large organizations are upgrading their data lake in-place with zero migration to Delta Lake!Managing your ML lifecycle with Azure Databricks and Azure Machine Learning (BRK3245) - Premal Shah from Microsoft and Mike Cornell from Databricks shared how machine learning development has new complexities beyond software development. There are a myriad of tools and frameworks which make it hard to track experiments, reproduce results, and deploy machine learning models. Learn how you can accelerate and manage your end-to-end machine learning lifecycle on Azure Databricks using MLflow and Azure ML to reliably build, share, and deploy machine learning applications using Azure Databricks.Hands-on with Azure Databricks Delta Lake (WRK2013) - In this lab, Kyle Weller, Premal Shah, Shiva Nimmagadda Venkata, and Santosh Perla from Microsoft guided attendees as they learned how to increase performance and reliability of their data engineering pipelines with Azure Databricks Delta Lake. Delta Lake provides optimized layouts to enable big data use cases, from batch and streaming ingests, fast interactive queries, to machine learning.Maximizing your Azure Databricks deployment (BRK3043) - Yatharth Gupta from Microsoft shared insights and key steps to get the most out of your Azure Databricks resources. Whether you’re new to Spark or an Azure Databricks veteran, attend and learn the tips, tricks, and best practices for working with Azure Databricks. Based on experiences with real industry customers, these best practices cover deployments, management, security, networking, monitoring, machine learning, and more. See how the power of Azure Databricks’ managed Spark experience can benefit your analytics pipeline!Azure Databricks and Azure Machine Learning better together (THR2186) - In this theater session, Premal Shah from Microsoft demonstrated the new integrations between Azure Databricks and Azure Machine Learning to realize comprehensive E2E machine learning scenarios for our customers.Data reproducibility, audits, immediate rollbacks and other applications of time travel with Delta Lake in Azure Databricks (BRK3254) - Time travel is now possible with Azure Databricks Delta Lake! Kyle Weller from Microsoft uncovered how Delta Lake makes time travel possible and why it matters to you. Through presentation, notebooks, and code, he showcased several common applications and how they can improve your modern data engineering pipelines. Delta Lake is an open-source storage layer that brings ACID transactions to Apache Spark(TM). It provides snapshot isolation for concurrent read/writes. Enables efficient upserts, deletes, and immediate rollback capabilities. It allows background file optimization through compaction and z-order partitioning achieving up to 100x performance improvements. In this presentation, learn what challenges Delta Lake solves, how Delta Lake works under the hood, and applications of the new Delta Time Travel capability.Get Started with Azure DatabricksThe fun doesn’t stop there! Keep learning more:
Webinars
Check out our on-demand webinar, From Data to AI with Microsoft Azure Databricks, where you will see how to accelerate your data and AI journey end-to-end with Azure Databricks and our natively integrated data services on Azure. Then see how to accelerate and manage your end-to-end machine learning lifecycle with Azure Databricks—using MLflow and Azure Machine Learning to build, share, deploy, and manage machine learning applications.Try Azure Databricks
Get started with Azure Databricks. Sign up for an Azure free account to get instant access. Continue your learning by using Azure Databricks directly.Talk to an expertContact us get answers to questions you might have as you start your first project or to learn more about available training.Follow us on Twitter, LinkedIn, and Facebook for more Azure Databricks news, customer highlights, and new feature announcements.Try Databricks for freeGet StartedSee all Company Blog postsProductPlatform OverviewPricingOpen Source TechTry DatabricksDemoProductPlatform OverviewPricingOpen Source TechTry DatabricksDemoLearn & SupportDocumentationGlossaryTraining & CertificationHelp CenterLegalOnline CommunityLearn & SupportDocumentationGlossaryTraining & CertificationHelp CenterLegalOnline CommunitySolutionsBy IndustriesProfessional ServicesSolutionsBy IndustriesProfessional ServicesCompanyAbout UsCareers at DatabricksDiversity and InclusionCompany BlogContact UsCompanyAbout UsCareers at DatabricksDiversity and InclusionCompany BlogContact UsSee Careers
at DatabricksWorldwideEnglish (United States)Deutsch (Germany)Français (France)Italiano (Italy)日本語 (Japan)한국어 (South Korea)Português (Brazil)Databricks Inc.
160 Spear Street, 13th Floor
San Francisco, CA 94105
1-866-330-0121© Databricks 2023. All rights reserved. Apache, Apache Spark, Spark and the Spark logo are trademarks of the Apache Software Foundation.Privacy Notice|Terms of Use|Your Privacy Choices|Your California Privacy Rights