Position: Senior Big Data Engineer
Company: Grid Dynamics
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-12-01T00:00:00+02:00

We are looking for Senior/Lead Bid Data Engineer with Azure, Python to play a key role on retail project.

**1. Project description**
We currently use a custom segmentation tool to define basic segments and Adobe Campaign to create campaign flows based on these segments. Adobe Campaign currently hosts the business logic for creating campaign-specific audiences.
We are looking to create an orchestration tool to prepare campaign-specific audiences and migrate this logic out of Adobe Campaign. The orchestration tool will merge/intersect the segments created by the segmentation tool and feed the results into the Campaign. 
We are currently using Azure as the primary cloud provider and considering to move some workloads to GCP.

**2. Client description**
French multinational retailer of personal care and beauty products. Featuring nearly 340 brands, along with its own private label, offers beauty products including cosmetics, skincare, body, fragrance, nail color, beauty tools, body lotions and haircare. Sales beauty products via retail and e-commerce platform. 

**3. Min requirements to the candidate**
- Experience with Azure Cloud
- Strong coding skills in Python
- Experience in Adobe Campaign Standard or Adobe Experience Platform
- Experience with Big Data technologies (Hadoop, Spark, Hive, Kafka, Cassandra)
- Experience with Apache Airflow (edited)
- Experience with modern cloud data warehouses
- Should be able to design and implement solutions and work alongside the product engineering team, evaluate new features and architecture while overseeing end to end flow
- Ability to work closely with other team members like Data architects, Data Engineers, ML Engineers and Product to understand what the business is trying to achieve, design optimal
- Expertise in design and implementation innovative data services solutions
- Working with Data models and most optimal ways for data-movements that helps optimize Compute, Processing and Data
storage within Data Platform
- Ability to act as a single point of responsibility over any delivery related matters, including escalations, upsells, ramp-downs, etc
- At least 5 years of experience in gathering and understanding customer business requirements to introduce Big Data technologies

**4. Nice to have requirements to the candidate**
Experience with GCP would be a plus (Google Cloud Storage, Cloud SQL, GCP Cloud Data Flow, Google Cloud Data Prep, BigQuery &amp; Compute Engine, Cloud Big Table)

**5. What tasks the candidate will work with?**
Discovery current systems amd solution for customers segmentation and campaign, build with client support