Position: Data Engineer, Smart Platfrom
Company: DataArt
Category: Data Engineer
Experience required: 2y
English level: intermediate
Published: 2022-04-01T00:00:00+03:00

CLIENT:
One of the areas that DataArt’s experts help the client is the development of an exceptional set of solutions for operating online grocery businesses. They are completely based on cloud-solutions, everything is hosted on AWS. The custom-designed solutions are individually capable of meeting the complex and growing expectations of shoppers while driving better capacity and delivering greater resilience for online grocery retailers. These achievements have been proven in one of the world’s busiest markets for online groceries. To achieve this, the team uses cutting edge technologies and when that’s not enough, we push the boundaries of what’s possible. We have a long history of relationships and over the years have helped the client to develop web-portals and mobile apps, delivery control systems, staff management tools, data storage and much more.

POSITION OVERVIEW:
As a Data Engineer, you will be responsible for implementing data processing workflows, designing and building data marts to serve specific business lines. That gives you a unique opportunity to work with and influence how top technologies provided by Google Cloud Platform (BigQuery, DataFlow, Cloud Storage) will evolve - the same that Google is using internally to process extreme amounts of data. You are responsible not only for development, maintenance and support of scalable and well monitored data processing workflows in batch mode but also driving the change toward streaming data processing. You will be expected to work closely with the product manager to identify and scope projects, plan those projects and effectively communicate advanced technical issues and findings to a range of technical and non-technical internal audiences. You are also an advocate of Data Driven paradigm and will be able to evangelize others about data processing best practices.

Responsibilities:
- Build data orchestration tooling for a datalake.
- Create company-wide best practices in data transformation.
- Serve as an evangelist for the Data-Driven / Informed approaches.
- Constantly look for improvements and learn from our mistake.
​​- Collaborate with the team to set technical direction, working on requirements and design issues, making sure the software developed meets the standards and business objectives, and that all projects are accurately estimated and delivered on schedule.
- Perform research, development, and optimization.
- Take part in all stages of systems development, such as requirements collection, systems, and data design, software construction (coding), deployment of code to production, system support and maintenance, production issues resolution, performance tuning, code review, and change control.

Requirements:
- Strong SQL knowledge.
- Working experience with Python.
- Solid understanding of databases and best engineering practices.
- Familiarity with data structuring, design skills.
- Knowledge of distributed computing.
- Good spoken and written English.

Nice to have:
- In-depth understanding of Google Cloud Platform (especially Big Query, Cloud Storage).
- Experience with Java 8/11.
- Familiarity with TDD.