Position: Big Data Developer
Company: EPAM Systems
Category: Data Engineer
Experience required: 5y
English level: intermediate
Published: 2023-06-01T00:00:00+03:00

Our customer is a provider of agricultural science and technology, in particular seeds and pesticides.

We are looking for Big Data Developer to build a Big Data lake in AWS
Tech stack:
Python
PySpark
Airflow
AWS EMR
Lambda
AppSync
It is a serverless AWS-based data lake that loads data from numerous DBs, store data on AWS S3, covers it by Glue catalog definition to allow SQL-like access (Athena, Snowflake), and then aggregates/calculates data (AWS EMRs) for downstream applications via AWS AppSync API