Position: Senior Python data engineer
Company: SQRD.tech
Experience required: 3y
Category: Python
English level: upper
Published: 2023-06-01T00:00:00+03:00

Client:
The client is an established software development company located in Warsaw, Poland. They have a dedicated team of more than 400 professionals, including developers, testers, project managers, business analysts, and DevOps experts. These team members are spread across different regions, including Poland, Latvia, and Georgia.

Case:
The client is seeking a data engineer for their end client, which operates in the field of carsharing for public transport.

Responsibilities:

- The candidate will be responsible for enabling and managing a complex and extensive mapping data environment, encompassing spatial, topology, and graph data.
- Designing, implementing, and supporting scalable solutions to enhance data capabilities.
- Participating in the entire development cycle, including architecture, design, development, QA, deployment, and monitoring.
- Building highly scalable and efficient data pipelines/solutions to serve data across the organization and to stakeholders.
- Collaborating with a diverse range of experts and stakeholders, including architects and engineers, to deliver high-quality results.
- Enhancing analytics capabilities by integrating various data sources.
- Monitoring data quality and ensuring accuracy and reliability through proactive error correction.

Requirements:

- Possess a BSc/MSc degree in Computer Science or an equivalent field.
- Have a minimum of 4 years of experience as a Senior Data Engineer (mandatory requirement).
- Demonstrated experience in executing Big Data solutions and processing structured and unstructured data into column store databases.
- Familiarity with Graph databases is highly advantageous.
- Proficiency in Data streaming, Kafka, Airflow, and knowledge of the Amazon ecosystem.
- Strong expertise in SQL and advanced programming skills, preferably in Python.
- Ability to thrive in a complex technological environment.
- Proficient in architectural design and development processes.
- Experience in ETL (Extract, Transform, Load) processes.