Position: Middle/Senior Big Data Engineer
Company: Grid Dynamics
Experience required: 2y
Category: Data Engineer
English level: intermediate
Published: 2022-07-01T00:00:00+03:00

**Project Description:**
The Client is a global technology and data company that builds verification, optimization, and analytics solutions for the advertising industry and we’re looking for a Big Data Engineer to join our Brand Safety Engineering team. If you are interested in building machine learning-based data pipelines; driving multiple billions of decisions per day, then this is the place for you!

**Details on the tech stack:**
Must have: Python, Airflow, Hadoop, Spark
Hice to have: Java/Scala, AWS, Docker

**Min requirements:**
1. 2+ years of experience designing and building data-intensive applications.
2. 2+ years of recent hands-on in an object-oriented language (Java, Scala, Python).
3. 1+ years of recent experience developing data pipelines in AWS or Google Cloud.
4. Expertise in using Big Data frameworks (e.g., Hadoop, Spark) and MPP databases (e.g., Redshift, Vertica, Snowflake) for complex data assembly and transformation.
5. Superb understanding of algorithms and data structures.
6. Experience working with Apache Airflow.

**Tasks:**
1. Designing and implementing ETL pipelines for reporting. 
2. Writing Airflow dags, spark jobs, containerized services.