DATA SHEET

Accelerate The Data Lifecycle From Data Ingest To Insight

CLOUDERA DATA ENGINEERING
Cloudera Data Engineering ispurpose-built for data engineers andenables them to:
DELIVER QUALITY DATASETS
Datasets are the backbone of any advanced
analytics initiative. CDE lets you deliver
curated, quality datasets while also ensuring
security and governance compliance — allwith open industry standard tools like
Apache Airflow.

DEPLOY WITH EASE & CONTROLCOSTS
CDE is a containerized, scalable, andportable service, so it’s easy to deploy incloud environments. It also features ondemand automatic resource scaling, so you
only pay for what you use and maintain

With exponentially growing amounts of business data everywhere, delivering quality curated
datasets securely is essential to enterprise data and analytics success. Building data pipelines isresource-intensive, requiring a focus on data integration, modeling, optimization, quality,governance, security and reusability. The ability to prepare data for analysis and production usecases across the data lifecycle is critical for transforming data into business value.

Data Engineering For Enterprise ScaleCloudera Data Engineering (CDE) for Cloudera Cloud Platform (CDP) empowers data engineers toleverage integrated and fully managed Spark to process large data volumes and streamlines datapipeline delivery to analytics and machine learning teams across the business. CDE provides
comprehensive tooling to orchestrate, deploy, monitor, manage, and operationalize data pipelines
at any scale.
CDE is an integrated platform delivered through a central interface that simplifies the job
management life cycle to alleviate many of the challenges with running Spark jobs in production.
CDE allows data engineers and platform admins to control costs and efficiently utilize resources
while meeting key business requirements and meeting SLAs.

efficient resource utilization.

MANAGE RESOURCES & USERSEFFECTIVELY
Platform administrators can control costs,
security, and governance from a centralizedcontrol plane. CDE empowers users todeliver agile, self-service data engineering
for governed data while also regulating
provisions and ensuring isolation acrossbusiness stakeholders.

MONITOR JOBS AND TROUBLESHOOT
WITH CLARITY
Data engineers can use CDE to efficiently
deploy and monitor the lifecycle for every job
and then use visual troubleshooting tools toquickly solve issues. Through a single paneof glass, users can make adjustments andreview visualized analytics, which helps
deliver and continuously maintainproduction-ready data pipelines.

Deliver Quality Datasets EverywhereDatasets are the backbone of any advanced analytics initiative. CDE lets you deliver curated,
quality datasets while also ensuring security and governance compliance — all with open industry
standard tools built in.
• Containerized, Managed Spark Service—CDE allows you to seamlessly manage and deploy
different versions of spark without time-intensive preparation. By removing the need for version
uniformity within and across teams, data engineers using different versions of Spark canseamlessly collaborate• Apache Airflow Scheduling—With native Apache Airflow built in, you can automate theorchestration of complex data pipeline scenarios. This gives you the flexibility to use whateverlanguage you prefer for a given task. Choose from Scala, Java, Python, and others.
• Real Time Pipeline Monitoring—Always have an up to date view of your data pipelines andproactively set alerts to quickly catch and fix issues before they become problems for youranalytics and machine learning teams.
• Robust Visual Troubleshooting & Tuning—Data engineers can efficiently identify and resolve
problems for every job with visual troubleshooting tools. Through a single pane of glass, users canmake adjustments and review visualized analytics, which helps deliver and continuously maintainproduction-ready data pipelines.
• Simplified Job Management—Platform administrators can use CDE as a centralized way tocontrol costs, security, and governance. CDE empowers users to deliver agile, self-service dataengineering for governed data while also regulating provisions and ensuring isolation acrossbusiness stakeholders.
• Powerful APIs—Use APIs to automate the lifecycle management of clusters, applications, andmore. This allows you to integrate with partner services for additional authoring, scheduling, andmonitoring functionality.

DATA SHEET“Cloudera provides all thecapabilities that we need in asingle platform, with a single
consistent data context
through SDX; this is critical forthe success of our data
initiative. The more we use theCloudera platform, the morevalue we create.”

Modern Data Engineering Built For Cloudera Data Platform

CDE is built on Cloudera Data Platform (CDP) and is fully integrated with your enterprise datacloud to enable full lifecycle management and seamless collaboration between IT, Data
Engineers, and analytic teams. CDE on CDP is available on a cloud native hybrid data architecture
enabling best-in-class data engineering on any cloud or data center.

Antonio Alvarez, Director of Data
Innovation, Santander UK

About Cloudera

At Cloudera, we believe that data can makewhat is impossible today, possible
tomorrow. We empower people totransform complex data into clear andactionable insights. Cloudera delivers anenterprise data cloud for any data,anywhere, from the Edge to AI. Powered by
the relentless innovation of the open source
community, Cloudera advances digitaltransformation for the world’s largest
enterprises.
Learn more at: cloudera.com

Figure 1. CDE on CDP enables full lifecycle management and analytic service integration on any
public or on premises private cloud.

Governance Security & Compliance with Cloudera SDX
Cloudera Shared Data Experience (SDX) ensures full data security, governance andinteroperability from the edge to AI — delivering unified data management with policies set onceand consistently enforced throughout CDP. Cloudera’s unique context layer enables safe andcompliant self-service access to data and analytics, offering deeper insights from data withincreased agility, at lower cost and with reduced risk. Users can set data and metadata security
and governance policies once, and SDX will automatically enforce them in CDE and across all
analytics and workloads in CDP.

Cloudera Inc. 5470 Great America Pkwy, Santa Clara, CA 95054 USA cloudera.com© 2020 Cloudera, Inc. All rights reserved. Cloudera and the Cloudera logo are trademarks or registeredtrademarks of Cloudera Inc. in the USA and other countries. All other trademarks are the property of theirrespective companies. Information is subject to change without notice. cldr_data_engineering_ds_101