Spark on Databricks | DatabricksSkip to main contentPlatformThe Databricks Lakehouse PlatformDelta LakeData GovernanceData EngineeringData StreamingData WarehousingData SharingMachine LearningData SciencePricingMarketplaceOpen source techSecurity and Trust CenterWEBINAR May 18 / 8 AM PT
Goodbye, Data Warehouse. Hello, Lakehouse.
Attend to understand how a data lakehouse fits within your modern data stack.
Register nowSolutionsSolutions by IndustryFinancial ServicesHealthcare and Life SciencesManufacturingCommunications, Media & EntertainmentPublic SectorRetailSee all IndustriesSolutions by Use CaseSolution AcceleratorsProfessional ServicesDigital Native BusinessesData Platform MigrationNew survey of biopharma executives reveals real-world success with real-world evidence.
See survey resultsLearnDocumentationTraining & CertificationDemosResourcesOnline CommunityUniversity AllianceEventsData + AI SummitBlogLabsBeaconsJoin Generation AI in San Francisco
June 26–29
 
Learn about LLMs like Dolly and open source Data and AI technologies such as Apache Spark™, Delta Lake, MLflow and Delta SharingExplore sessionsCustomersPartnersCloud PartnersAWSAzureGoogle CloudPartner ConnectTechnology and Data PartnersTechnology Partner ProgramData Partner ProgramBuilt on Databricks Partner ProgramConsulting & SI PartnersC&SI Partner ProgramPartner SolutionsConnect with validated partner solutions in just a few clicks.Learn moreCompanyCareers at DatabricksOur TeamBoard of DirectorsCompany BlogNewsroomDatabricks VenturesAwards and RecognitionContact UsSee why Gartner named Databricks a Leader for the second consecutive yearGet the reportTry DatabricksWatch DemosContact UsLoginJUNE 26-29REGISTER NOWSpark on DatabricksThe best platform to run your Spark workloads, from the original creators of Apache Spark™Simplicity, best-in-class operational excellence and price/performance benefits make the Databricks Lakehouse Platform the best place to run your Apache Spark™ workloadsBest-in-class operational excellenceWe help thousands of customers launch millions of VMs every day to run their Spark applications. And we support the latest developer tools and guidance, ensuring that you can develop and deploy your Spark applications with confidence and ease.Run your Spark applications individually or deploy them with ease on Databricks WorkflowsRun Spark notebooks with other task types for declarative data pipelines on fully managed compute resourcesWorkflow monitoring allows you to easily track the performance of your Spark applications over time and diagnosis problems within a few clicksBest price/performance for Spark workloadsRunning your Spark workloads on the Databricks Lakehouse Platform means you benefit from Photon – a fast C++, vectorized execution engine for Spark and SQL workloads that runs behind Spark’s existing programming interfaces. Photon provides record-breaking query performance at low cost while leveraging the latest in modern hardware architectures such as AWS Graviton.In addition to lightning-fast performance, Spark on Databricks achieves lower overall TCO through capabilities such as dynamic autoscaling, so you only pay for what you use. Databricks also offers GPU and spot instances.End-to-end analytics and unified governance with the Databricks Lakehouse PlatformWhile other platforms require you to integrate multiple tools and manage different governance models, Databricks unifies data warehouse, data lake and data streaming in one simple Lakehouse Platform to handle all your data engineering, analytics and AI use cases end-to-end. It’s built on an open and reliable data foundation that efficiently handles all data types, unifies batch and streaming, and applies one common security and governance model across all your data and cloud platforms.Continued innovationThe 2022 SIGMOD Systems Award recognized Spark as an innovative, widely used, open source, unified data processing system encompassing relational, streaming and machine learning workloads.And the innovation continues. Recently we introduced Spark Connect and Project Lightspeed.Spark Connect decouples the client and server for better stability and allows for Spark applications everywhere.Project Lightspeed, the next generation of Spark Structured Streaming, further delivers on predictable low latency and enhanced functionality for processing events.Ready to get started?Try Spark on Databricks todayProductPlatform OverviewPricingOpen Source TechTry DatabricksDemoProductPlatform OverviewPricingOpen Source TechTry DatabricksDemoLearn & SupportDocumentationGlossaryTraining & CertificationHelp CenterLegalOnline CommunityLearn & SupportDocumentationGlossaryTraining & CertificationHelp CenterLegalOnline CommunitySolutionsBy IndustriesProfessional ServicesSolutionsBy IndustriesProfessional ServicesCompanyAbout UsCareers at DatabricksDiversity and InclusionCompany BlogContact UsCompanyAbout UsCareers at DatabricksDiversity and InclusionCompany BlogContact UsSee Careers
at DatabricksWorldwideEnglish (United States)Deutsch (Germany)Français (France)Italiano (Italy)日本語 (Japan)한국어 (South Korea)Português (Brazil)Databricks Inc.
160 Spear Street, 13th Floor
San Francisco, CA 94105
1-866-330-0121© Databricks 2023. All rights reserved. Apache, Apache Spark, Spark and the Spark logo are trademarks of the Apache Software Foundation.Privacy Notice|Terms of Use|Your Privacy Choices|Your California Privacy Rights