Position: Big Data Engineer
Company: Grid Dynamics
Experience required: 3y
Category: Data Engineer
English level: upper
Published: 2022-07-01T00:00:00+03:00

The project goal is to implement pipelines and infrastructure for reports generated based on huge amounts of data collected into data sets. Our team’s job is to design, code and verify jobs written in the latest version of Scala/Spark and make sure that the algorithms we implement return correct statistics which will be further used by our stakeholders. The project team is distributed, giving us a chance to work with leading big data engineers both in Europe and overseas.
Even though this is a Big Data engineer position, CI/CD and DevOps knowledge would be a big plus for a candidate for this project, as working with infrastructure will be part of the job.

Details on tech stack
- Proficiency in Spark and Scala
- Hands-on expertise with Hadoop
- Processing and computation frameworks: Kafka, Spark, Dataframe/SQL API
- DB engines:  Oracle, Postgres, Teradata, Cassandra.
- Implementing Data Lakes, Data Warehousing or analytics systems is an advantage
- Good understanding of distributed computing technologies, approaches, and patterns