Position: Senior Data Engineer
Company: SD Solutions
Experience required: 5y
Category: Java
English level: intermediate
Published: 2020-04-01T00:00:00+03:00

**Responsibilities**
• You will work closely with the CTO
• Contribute to data pipeline design, development and monitoring
• Develop Java based Kafka Stream applications
• Supervise production managed Kafka and Elasticsearch clusters
• Conform to the Company wide code standards and tech culture
• Responsible for full lifecycle of data pipelines. Developers will take the services they build from design, through implementation and into production.
• Designing solutions for monitor data pipelines operations with proper alerting

**Requirements**
• Full hands-on development experience
• Proficiency in Java and/or Golang
• Develop with the latest Java version, build with Gradle and test and deploy your own code into production
• Experience using Kafka technologies (Kafka Streams DSL, Processor API, Kafka Connect, Avro Schema Registry)
• Elasticsearch
• Code & systems testing
• RDBMS and NoSQL databases
• Kubernetes and Docker
• Advanced use of git
• Use of Unix/Linux shell commands
• Microservices architecture concepts
• Event driven paradigm
• Evaluating/designing/building data solutions for operations & support (I.e. metrics, tracing, logging)

**Understanding**
• Protobuf/gRPC
• Best practices in scaling & monitoring data pipelines

**Nice to have**
• AWS stack experience
• Ability to perform basic devops tasks
• Python and related data science packages such as pandas/numpy/scikit-learn
• Basic data analysis techniques
• Understanding of statistics

**Past experience**
Demonstrated track record and proficiency in the points below:
• Deliver features autonomously with a high degree of team coordination
• Deliver code based on precise architecture spec as well as without relying on precise architecture spec or requirements
• Automated testing
• Working with CI and GitOps practices
• Delivering code to production
• Maintaining production ready code
• Collaborating in small but fast paced teams
• Event driven architecture and message passing

**More about you**
• Good level of English
• Willingness to learn and open mind about new technologies
• Confident to operate in a fast-paced environment
• A collaborative approach and willingness to engage in an environment of active idea sharing
• Ability to learn autonomously
• Excellent all-round communications skills

**What we offer**
• Working with latest cutting-edge data streaming technologies
• Helping to disrupt a century old industry in a startup environment
• Having direct influence in how we build our data streaming platform
• Opportunity to grow and develop your core skills
• Deliver a green field system
• Work with a diverse multicultural team in an agile environment
• Variety of knowledge sharing and self-development opportunities
• Competitive salary
• State of the art, cool, centrally located offices with warm atmosphere, which creates good working conditions
• Opportunity to travel to the London office
• Occasional visits to vessels to observe how our software and hardware is being used in the real world
• Experience firsthand the squad-chapter-guild workflow model, our version of the Spotify model

**About product**
Our goal is to revolutionize shipping by creating a suite of comprehensive software solutions for the Maritime industry. Our journey begins now. Over the next couple of years, our teams and squads will build more than 30 products from the ground up. This includes everything from global vessel tracking to vessel performance analysis, crew optimization and so much more. This is an exciting and challenging opportunity to apply cutting-edge technology to revolutionizing an iconic industry.
Our tech stack consists of React and React Native applications communicating using GraphQL to microservice containers orchestrated by Kubernetes. Internally our services use gRPC for communication and achieve high scalability thanks to a Kafka based event-driven architecture and persist data to a mix of RDBS and No-SQL databases including PostgresDB, MongoDB, S3 and Elasticsearch. We follow modern CI/CD and agile methodologies to deploy into production multiple times per week.