Position: BigData/AWS Developer
Company: EPAM
Category: Other
Experience required: 5y
English level: upper
Published: 2021-04-01T00:00:00+03:00

EPAM team of 3 data developers will remotely join a team located in Europe (the team already has BA, Data architect, Data QA, PM). to work together for the ETL project. The project purpose is to extract data from an SQL DB to an AWS workspace with Lambda and a S3 bucket. Then a process takes the data using AWS Glue, with some Python code or SQL (to be discussed) to load views into Redshift. A data catalog is currently under development (Alation) to serve all the data from Redshift. Erwin is used to document the data model and metadata.

Candidate’s responsibilities:
·       Lead development process
·       Define implementation approach and data pipeline pattern
·       Implement data pipeline
·       Unit testing
·       Code reviews

Requirements:
knowledge of AWS Redshift, AWS Glue, AWS environments and data architecture
good experience of working with AWS frameworks
knowledge of Python and SQL