Position: Data Engineer
Company: Talentuch
Category: Java
Experience required: 3y
English level: intermediate
Published: 2021-01-01T00:00:00+02:00

Main responsibilities and activities:
● Build services/features/libraries that serve as a definitive examples for new engineers and makes major contributions to library code or core services
● Design low risk Spark process and write effective complex Spark jobs (data processes, aggregations, pipeline)
● Design low risk APIs and write complex asynchronous, highly parallel low latency APIs and processes
● Work as part of Agile team to maintain, improve, monitor Adthena's data collection processes using Java and Scala
● Write high quality, extensible and testable code by applying good engineering practices (TDD, SOLID) using.
● Understand and apply modern technologies, data structures and design patterns to solve real problems efficiently
● Support TA and Data Science team to help deliver and productionise their backlog/prototypes
● Take ownership and pride in the products we build and always make sure they are of the highest standard
● Be empathetic towards team members and customers

You will fit if you:
● Commercial experience developing Spark Jobs using Scala
● Commercial experience using Java and Scala (Python nice to have)
● Experience in data processing using traditional and distributed systems (Hadoop, Spark, AWS - S3)
● Experience designing data models and data warehouses.
● Experience in SQL, NoSQL database management systems (PostgreSQL and Cassandra)
● Commercial experience using messaging technologies (RabbitMQ, Kafka)
● Experience using orchestration software (Chef, Puppet, Ansible, Salt)
● Confident with building complex ETL workflows (Luigi, Airflow)
● Good knowledge working cloud technologies (AWS)
● Good knowledge using monitoring software (ELK stack)
● Motivated problem-solving skills, ability to bring ideas forward and adapt solutions to complex challenges
Compensation - up to $5000 (depends on the candidate's experience).