Position: BigData Developer with GCP
Company: Grid Dynamics
Category: Python
Experience required: 3y
English level: intermediate
Published: 2021-01-01T00:00:00+02:00

The client's heterogeneous infrastructure implies use of various solutions (3rd party applications, custom applications, proprietary tools, etc.) and a huge massive of data (marketing, logistics, supply chain, etc.) to support the business processes of a large American eCommerce player.
The current project is that, as part of a friendly team consisting of offshore developers and onsite technical specialists, to participate in the transition into Clouds technological transformation. 

**Responsibilities:**

Transition of customer DBs into GCP
Batch ingest from SQL (RDMS) databases (streaming in a couple of months)
Migration from Teradata for marketing, logistics, supply chain, etc.
Creation of ETL pipelines in Data Fusion
Close working to the client's engineers team with the deal to get familiar with complex  business logic and apply  to current
grooming, research, and development
Supervise data quality embedded in Dataflow

**Required skills:**

Solid experience with GCP
Hand-on working ETL experience
Working experience with Apache Beam
Working experience with Airflow

**Nice to have:**

Experience with Python
Working experience with Spark
Ability to work with Kubernetes