Enhancing the Amperity CDP with Personalized Product Recommendations - The Databricks BlogSkip to main contentPlatformThe Databricks Lakehouse PlatformDelta LakeData GovernanceData EngineeringData StreamingData WarehousingData SharingMachine LearningData SciencePricingMarketplaceOpen source techSecurity and Trust CenterWEBINAR May 18 / 8 AM PT
Goodbye, Data Warehouse. Hello, Lakehouse.
Attend to understand how a data lakehouse fits within your modern data stack.
Register nowSolutionsSolutions by IndustryFinancial ServicesHealthcare and Life SciencesManufacturingCommunications, Media & EntertainmentPublic SectorRetailSee all IndustriesSolutions by Use CaseSolution AcceleratorsProfessional ServicesDigital Native BusinessesData Platform MigrationNew survey of biopharma executives reveals real-world success with real-world evidence.
See survey resultsLearnDocumentationTraining & CertificationDemosResourcesOnline CommunityUniversity AllianceEventsData + AI SummitBlogLabsBeaconsJoin Generation AI in San Francisco
June 26–29
 
Learn about LLMs like Dolly and open source Data and AI technologies such as Apache Spark™, Delta Lake, MLflow and Delta SharingExplore sessionsCustomersPartnersCloud PartnersAWSAzureGoogle CloudPartner ConnectTechnology and Data PartnersTechnology Partner ProgramData Partner ProgramBuilt on Databricks Partner ProgramConsulting & SI PartnersC&SI Partner ProgramPartner SolutionsConnect with validated partner solutions in just a few clicks.Learn moreCompanyCareers at DatabricksOur TeamBoard of DirectorsCompany BlogNewsroomDatabricks VenturesAwards and RecognitionContact UsSee why Gartner named Databricks a Leader for the second consecutive yearGet the reportTry DatabricksWatch DemosContact UsLoginJUNE 26-29REGISTER NOWCategoriesAll blog postsCompanyCultureCustomersEventsNewsPlatformAnnouncementsPartnersProductSolutionsSecurity and TrustEngineeringData Science and MLOpen SourceSolutions AcceleratorsData EngineeringTutorialsData StreamingData WarehousingData StrategyBest PracticesData LeaderInsightsIndustriesFinancial ServicesHealth and Life SciencesMedia and EntertainmentRetailManufacturingPublic SectorEnhancing the Amperity CDP with Personalized Product Recommendationsby Justin Fenton, Brian Shumsky, Jason Meketa, Nicole Lu and Bryan SmithMarch 15, 2023 in IndustriesShare this postPersonalization provides organizations a means to more directly connect with customers' needs and preferences. In a crowded retail landscape, such targeted engagement is often seen as a key differentiator, attracting customers, elevating their spend, and increasing their loyalty to particular brands. Consumers themselves increasingly express a desire to be seen and heard by the outlets with which they spend their time and money, and even when pulling back spend in the face of economic concerns, 52% of consumers in a recent survey stated they expect a better experience from brands in return for their spend.This shift towards personalization has even extended into the realm of consumer packaged goods. With relationships to consumers mediated by retail outlets, CPG manufacturers have long pursued mass-marketing strategies intended to increase demand for their goods across more general populations of consumers. But recent shifts in consumer habits and brand loyalties and the growth of private label brands have created a sense of urgency amongst manufacturers to connect more directly with consumers. The rise in retail media networks and consumer interest in DTC models all create an opportunity for this kind of relationship, but with these opportunities comes a new expectation for personalized engagement.The Need for a Customer Data Platform (CDP)The key to delivering personalized experiences is access to timely, high-quality data about the consumer. Information such as a customer's transaction history is critical but so are data on returns, product feedback, browsing history, customer service records, and so much more. These data, internally generated as well as externally captured, provide a 360-degree view of the customer from which new insights and experiences may be derived.While developing such a Customer-360 platform sounds straightforward, the reality is that it is not. Customer identity is often an elusive concept, large data volumes and complex data structures may make accessing information challenging, and sophisticated insights such as behavioral segment assignments and personalized product recommendations derived from base data in the 360-degree view may require access to sophisticated analytic capabilities. Many organizations with ambitions to establish a customer data platform (CDP) have found their efforts falling short, with only 14% of organizations achieving what they would qualify as success according to a recent survey.But there have been some successes, and as this space matures, we are seeing the emergence of a repeatable pattern that some refer to as a hybrid-CDP and others refer to as a composable-CDP.With this pattern (which we will refer to as a composable-CDP), many core challenges such as customer identity resolution, the acquisition and integration of frequently employed data and the derivation of standard metrics are largely addressed by more-or-less off-the-shelf CDP technologies. High-volume and complex data are accumulated on more flexible Data Lake or Lakehouse platforms where data may be pre-processed for downstream integration into the core CDP system. Advanced analytics needs may be tackled by pushing a subset of the harmonized information from the core CDP back into the Lakehouse where models may be trained and predictive insights generated which are themselves pushed back into the core CDP environment.While the composable-CDP entails quite a bit of data movement, it balances the strengths of the dual platforms, providing organizations the right combination of capabilities required to meet their Customer-360 needs.Integrating Amperity and Databricks to Form a Composable-CDPTo illustrate the combined power of the composable-CDP architecture, let's examine a simple integration between Amperity, a market leader in the CDP space with a deep specialization in ML-driven customer identity resolution, and Databricks, the platform that defined the Lakehouse approach to analytic data management (Figure 1).Figure 1. Integrating Amperity with Databricks to form a composable-CDPLeveraging Amperity's Databricks Delta table destination feature, data can easily be pushed and pulled between the Amperity CDP and the Databricks platform. We might leverage such an integration to push customer transactional history, enhanced by Amperity for reliable customer identification, to the Databricks environment. There, data may be used to train a model to generate customer-specific product recommendations. Those recommendations may then be pushed back to the Amperity CDP to be integrated into the Customer-360 where it can then be activated in a variety of channels like email, sms, push notifications, and paid media/advertising like Google, TikTok, Facebook, Instagram, LiveRamp, Criteo and more.The key to this workflow is not simply the integration of the two platforms, but what each contributes to the end product, i.e. personalized product recommendations. While Databricks has long been recognized for its ability to train large and complex models such as those used in recommendation systems, the output of these models is only as good as the data they are trained upon.Amperity's ML-based identity resolution capabilities are critical in ensuring that data associated with a customer are accurately attributed to them. A study of Amperity customers' legacy identity resolution strategies found that on average organizations struggle to correctly identify 23% of their customers representing 53% of the revenue associated with those brands. It's hard to extract the benefits of personalization when you can't properly align the data from your best customers (Figure 2).Figure 2. Organizations typically struggle to correctly identify their top customersWant to See This in Action?To demonstrate the power of combining the Amperity CDP with the Databricks Lakehouse, we've put together a demonstration notebook exploring the generation of personalized product recommendations in a composable-CDP architecture. In this notebook, we demonstrate exactly how data is pushed from the Amperity CDP to Databricks, how enhanced transaction history from Amperity is used to train a recommender and how recommendations generated in Databricks are pushed back into the Amperity CDP.This is but one of many scenarios where our mutual customers are finding success in meeting their needs for a 360-view of their customers and creating a foundation for success in their personalization efforts. If you'd like to explore how Amperity and Databricks can help your organization achieve similar success, please contact either your Amperity or Databricks representatives.Try Databricks for freeGet StartedRelated postsProducts We Think You Might Like: Generating Personalized Recommendations Using Matrix FactorizationJanuary 6, 2023 by Eduardo Brasileiro, Yang Wang, Brian Law and Bryan Smith in Industries
Check our Solution Accelerator for Matrix Factorization for more details and to download the notebooks. Recommenders are a critical part of the modern...
Getting Started with Personalization through Propensity ScoringJune 3, 2022 by Tian Tan, Sam Steiny and Bryan Smith in Industries
Consumers increasingly expect to be engaged in a personalized manner. Whether it's an email message promoting products to complement a recent purchase, an...
Personalization Meets Scale: An Introduction to 1:1∞October 18, 2022 by Michael Griffiths in Data Strategy
How do you build meaningful, lasting relationships? With personalization as we're used to thinking about it, a blog like this would help drive...
See all Industries postsProductPlatform OverviewPricingOpen Source TechTry DatabricksDemoProductPlatform OverviewPricingOpen Source TechTry DatabricksDemoLearn & SupportDocumentationGlossaryTraining & CertificationHelp CenterLegalOnline CommunityLearn & SupportDocumentationGlossaryTraining & CertificationHelp CenterLegalOnline CommunitySolutionsBy IndustriesProfessional ServicesSolutionsBy IndustriesProfessional ServicesCompanyAbout UsCareers at DatabricksDiversity and InclusionCompany BlogContact UsCompanyAbout UsCareers at DatabricksDiversity and InclusionCompany BlogContact UsSee Careers
at DatabricksWorldwideEnglish (United States)Deutsch (Germany)Français (France)Italiano (Italy)日本語 (Japan)한국어 (South Korea)Português (Brazil)Databricks Inc.
160 Spear Street, 13th Floor
San Francisco, CA 94105
1-866-330-0121© Databricks 2023. All rights reserved. Apache, Apache Spark, Spark and the Spark logo are trademarks of the Apache Software Foundation.Privacy Notice|Terms of Use|Your Privacy Choices|Your California Privacy Rights