Position: Cloud Engineer, Data Reliability
Company: AgileEngine
Experience required: 3y
Category: Sysadmin
English level: intermediate
Published: 2020-08-01T00:00:00+03:00

As a Cloud Engineer focused on Data Reliability, you will be responsible for creating and maintaining the data sets on Google Cloud Platform to achieve best-in-class data reliability. This includes efficient and
reliable creation of data sets, automate data validation and setup ongoing monitoring for reliable data usage at a global scale.

**Responsibilities**
- Ensure pipelines for structured and unstructured data have full data reliability checks including automation, monitoring and alerting and provide troubleshooting for issues
- Provide hands-on expertise to assist other engineers with queries, schema design, application architecture, and traffic pattern planning
- Design and develop for greater scale and optimize data delivery for performance and cost 
- Optimize and maintain data integrity of our global data semantic layer of our business KPIs
- Act as an escalation point for engineers when production issues related to data reliability occur
- Work with stakeholders including product, engineering and business teams and assist them with data reliability issues
- Write and review code, create and maintain documentation

**Requirements**
- 5+ years of experience consulting in Data Engineering or Data Warehousing
- Google Cloud Data Engineer or Architect certification and hands-on experience deploying data sets for production application usage
- Experience with consumer data management / consumer-facing applications
- Ability to build and optimize reliable data sets, &#39;big data&#39; data pipelines and architectures
- Excellent ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions
- Hands on experience with structured and unstructured data sets
- Ability to build reliable processes that support data transformation, workload management, data structures, dependency and metadata
- Familiar with deployment, automation, configuration management and monitoring tools, concepts, and principles
- Effective, thoughtful communicator in a fast-paced environment cross functional team members
- Ability to deliver quickly in a collaborative environment with understanding of business needsExperience with Striim, FiveTran or other ingestion software is a plus

**About the project**
Estée Lauder Companies Online (ELC Online) is the online division of the Estée Lauder Companies Inc. family of brands. We are passionate people who set the industry standard for prestige beauty e- commerce. Our modern downtown offices are in the Flatiron neighborhood and are filled with amazing people, snacks, art and enthusiasm. We foster a culture that is fun and collaborative and we get things done.