Introducing Lakehouse for Healthcare and Life Sciences - The Databricks BlogSkip to main contentPlatformThe Databricks Lakehouse PlatformDelta LakeData GovernanceData EngineeringData StreamingData WarehousingData SharingMachine LearningData SciencePricingMarketplaceOpen source techSecurity and Trust CenterWEBINAR May 18 / 8 AM PT
Goodbye, Data Warehouse. Hello, Lakehouse.
Attend to understand how a data lakehouse fits within your modern data stack.
Register nowSolutionsSolutions by IndustryFinancial ServicesHealthcare and Life SciencesManufacturingCommunications, Media & EntertainmentPublic SectorRetailSee all IndustriesSolutions by Use CaseSolution AcceleratorsProfessional ServicesDigital Native BusinessesData Platform MigrationNew survey of biopharma executives reveals real-world success with real-world evidence.
See survey resultsLearnDocumentationTraining & CertificationDemosResourcesOnline CommunityUniversity AllianceEventsData + AI SummitBlogLabsBeaconsJoin Generation AI in San Francisco
June 26–29
 
Learn about LLMs like Dolly and open source Data and AI technologies such as Apache Spark™, Delta Lake, MLflow and Delta SharingExplore sessionsCustomersPartnersCloud PartnersAWSAzureGoogle CloudPartner ConnectTechnology and Data PartnersTechnology Partner ProgramData Partner ProgramBuilt on Databricks Partner ProgramConsulting & SI PartnersC&SI Partner ProgramPartner SolutionsConnect with validated partner solutions in just a few clicks.Learn moreCompanyCareers at DatabricksOur TeamBoard of DirectorsCompany BlogNewsroomDatabricks VenturesAwards and RecognitionContact UsSee why Gartner named Databricks a Leader for the second consecutive yearGet the reportTry DatabricksWatch DemosContact UsLoginJUNE 26-29REGISTER NOWCategoriesAll blog postsCompanyCultureCustomersEventsNewsPlatformAnnouncementsPartnersProductSolutionsSecurity and TrustEngineeringData Science and MLOpen SourceSolutions AcceleratorsData EngineeringTutorialsData StreamingData WarehousingData StrategyBest PracticesData LeaderInsightsIndustriesFinancial ServicesHealth and Life SciencesMedia and EntertainmentRetailManufacturingPublic SectorIntroducing Lakehouse for Healthcare and Life SciencesDelivering better patient outcomes with data and AIby Michael Sanky and Michael OrtegaMarch 9, 2022 in NewsShare this postEach of us will likely generate millions of gigabytes of health data in our lifetimes: medical and pharmacy claims, electronic medical records with extensive clinical documentation, medical images; perhaps streaming data from wearable devices, blood biopsy data that can detect cancer, and genomic sequencing. These data sets have enormous potential to uncover new, life-saving treatments, predict disease before it happens, and fundamentally change the way that care is delivered.
For healthcare and life sciences organizations seeking to deliver better patient outcomes, legacy technology is most often the rate-limiting factor. Common challenges include:
Data silos and limited support for semi-structured data (like provider notes) and unstructured data (like images) prevent organizations from gaining a holistic view of a patientRapid growth in data is outpacing the scale of existing infrastructure, preventing population-level researchBatch processing and disjointed analytic tools prevent real-time response to challenges such as supply chain constraints and ICU bed capacityTraditional data architectures that don’t support advanced analytics and AI use casesSadly, for these reasons, the opportunity to tap into AI-driven innovation is simply out of reach for most organizations on the front lines of developing new drugs and treating patients in need.
Meet Lakehouse for Healthcare and Life SciencesWell, that’s changing! Today, we’re thrilled to introduce the Lakehouse for Healthcare and Life Sciences — a platform designed to help organizations collaborate with data and AI in service of a unified goal: improving health outcomes. The Lakehouse eliminates the need for legacy data architectures, which have inhibited innovation, by providing a simple, open and multi-cloud platform for all your data, analytics and AI workloads. Building on this foundation are solution accelerators developed by Databricks and our ecosystem of partners for high-value analytics and AI use cases such as disease prediction, medical image classification, and biomarker discovery.
To play this video, click here and accept cookiesWe know that healthcare organizations face a unique, and often painful, set of challenges that can significantly hinder innovation. We’ve designed the Lakehouse to address these challenges and provide the following benefits:
Build a 360 degree view of the patient: It’s widely accepted that a vast majority of medical data is unstructured, which makes gaining a holistic patient view that much harder with siloed systems. This problem gets exponential as healthcare becomes increasingly interconnected between healthcare providers, payers and pharma manufacturers. Lakehouse is open by design and supports all data types, enabling organizations to create a 360 degree view of patient health. Couple this with the pre-built data ingestion and curation solution accelerators to bring health data to your lakehouse, and it’s even easier.Scale analytics for population-level insights: Scale is critical for initiatives like population health analytics and drug discovery, but for years legacy technology has failed to keep up with ballooning health data like genomics and imaging. Built in the cloud and designed for performance, the Lakehouse supports the largest of data jobs at lightning-fast speeds. For example, Regeneron reduced data processing from 3 weeks to 5 hours, and genotype- phenotype queries from 30 minutes to 3 seconds for workloads that scaled to 1.5M exomes. With the Lakeouse, organizations can quickly and reliably analyze data for millions of patients.Deliver real-time care and operations: Healthcare happens in real-time and requires real-time insights for critical use cases from managing ICU capacity to monitoring the distribution of temperature-sensitive vaccines. Unfortunately, traditional data warehouses aren’t designed to operate in real-time. The Lakehouse enables real-time analysis on streaming data so organizations can deliver care when it's needed, not after the fact.Leverage predictive health insights: The future of healthcare is predictive, not descriptive. The Lakehouse provides a robust set of analytics and AI tools directly connected to your data so organizations can innovate drug discovery and patient care with machine learning. Additionally, our network of partners has built accelerators for high-value analytics and AI use cases, including drug targeting and repurposing, drug safety monitoring, disease prediction and digital pathology analysis for cancer detection.With these capabilities, Databricks is empowering a new breed of data and AI innovators in healthcare:
Using AI to develop diagnostic and therapeutic products that help children living with behavioral conditionsApplied machine learning to 17M+ electronic health records to identify new treatment indications for approved therapies.Delivering recommendations to patients using streaming data from connected health wearables for diabetes management.Tailor-made Solutions for Healthcare & Life SciencesTo help organizations realize value from their Lakehouse projects faster, Databricks and our ecosystem of partners have developed solution accelerators and open-source libraries—like Glow for genomics and Smolder for HL7v2 messages—to address common industry use cases.
Data Ingestion and Curation Tools - easily ingest structured and unstructured health data (e.g. FHIR/HL7v2, imaging, genomics) into your Lakehouse for analytics at scale with our templates for data ingestion and curation.Analytics and AI Templates - packaged solutions for high-value analytics and AI use cases such as drug target identification, drug repurposing, disease risk prediction, medical image analytics (e.g. detecting cancer in pathology images) and more.Featured partner solutionsIntelligent Drug RepurposingInteroperabilityNatural Language Processing for HealthcareBiomedical Research Intelligent Data ManagementIdentify new therapeutic uses for existing drugs with the power of data and machine learning.Automate the ingestion of streaming FHIR bundles into your lakehouse and standardize with OMOP for patient analytics at scale.Extract insights from unstructured medical text for use cases such as automated PHI removal, adverse event detection, and oncology research.Improve biomarker discovery for precision medicine with a highly scalable and extensible whole-genome processing solution.Check out our full set of solutions on our Lakehouse for Healthcare and Life Sciences page.
Get started building your LakehouseYou have the data. Now you have the platform. Join the hundreds of healthcare and life sciences organizations innovating on the Lakehouse. Here are some resources to help you get started:
Join us at HIMSS to meet with our technical experts and participate in live use case demosCheck out our new ebook Improving Health Outcomes with Data + AITry Databricks for freeGet StartedSee all News postsProductPlatform OverviewPricingOpen Source TechTry DatabricksDemoProductPlatform OverviewPricingOpen Source TechTry DatabricksDemoLearn & SupportDocumentationGlossaryTraining & CertificationHelp CenterLegalOnline CommunityLearn & SupportDocumentationGlossaryTraining & CertificationHelp CenterLegalOnline CommunitySolutionsBy IndustriesProfessional ServicesSolutionsBy IndustriesProfessional ServicesCompanyAbout UsCareers at DatabricksDiversity and InclusionCompany BlogContact UsCompanyAbout UsCareers at DatabricksDiversity and InclusionCompany BlogContact UsSee Careers
at DatabricksWorldwideEnglish (United States)Deutsch (Germany)Français (France)Italiano (Italy)日本語 (Japan)한국어 (South Korea)Português (Brazil)Databricks Inc.
160 Spear Street, 13th Floor
San Francisco, CA 94105
1-866-330-0121© Databricks 2023. All rights reserved. Apache, Apache Spark, Spark and the Spark logo are trademarks of the Apache Software Foundation.Privacy Notice|Terms of Use|Your Privacy Choices|Your California Privacy Rights