Position: Senior Data Engineer
Category: Data Engineer
English level: upper
Years of experience: 11

• Design and creation of new data pipelines and maintenance of existing ones
• Optimization of existing mechanisms for speed and cost-efficiency
• Ensuring pipeline stability and best code practices through Unit/Integration testing and CI/CD
• Design and implementation of back-pressure mechanism for log fetcher to avoid data loss
• Design and implementation of disabling mechanism for stuck workers based on statistics collected during particular time window
• Design and implementation of throttling for producers cluster to decrease lag between producers and consumers
• Design and implementation of re-enabling mechanism for failed workers using exponential retry and jitter
• Have added integration with new third party log sources for fetching
• End-to-end delivery of highly scalable cloud native product
• Deep knowledge of modern software development technologies and frameworks
• Experienced in performing optimisation, performance profiling and debugging
• Expertise in designing of scalable software applications from scratch and based on existing solutions
• Understanding of object-oriented and service-oriented application development methods and theories
• On-hands experience in production with SQL/NoSQL databases and DBMS
• Solid knowledge of the most popular Version Control Systems
• Good knowledge of modern operating systems and command line
• Ability to handle a team of software professionals, appropriately dealing with problems inside the team
• Ability to deliver technology solutions which meet business expectations in shortest terms
• Experienced in integration of best engineering practices into existing processes
• Dedicated with proficiency to work independently and in a team