Position: Senior Data Software Engineer
Company: EPAM
Category: Data Science
Experience required: 3y
English level: intermediate
Published: 2020-11-01T00:00:00+02:00

PROJECT DESCRIPTION
Key technologies, MUST HAVE:
SQL
DataFlow
Data Composer or Apache Airflow 
Apache Beam
GCP

Full description:

Experienced Data Engineer ( or ETL Developer ) who is proficient in building and maintaining data pipelines in GCP. But if only successful candidate is willing to work fully with GCP Proficient in ETL/ELT process, data migration from on-premise to GCP.

Data ingestion with Apache Nifi
Data Job scheduling and orchestration with Apache Airflow or Google Data Composer
Data processing and preparation with Apache Beam or Google DataFlow
Messaging systems based on Pub/Sub or Kafka
Data processing with Apache Hadoop/Cloudera Hadoop or Google DataProc (to run Spark jobs)
DWH solutions, preferably BQ
SQL