Position: Data Engineer
Company: 8allocate
Experience required: 3y
Category: Scala
English level: upper
Published: 2021-07-01T00:00:00+03:00

**8allocate** is a global provider of end-to-end custom software development solutions to companies all over the globe, from North America to the EU to Israel to Australia.

Headquartered in Estonia, we run offshore R&D centers in Kyiv and Lviv. Our team is 50% remote and distributed. We specialize in flexible interaction exclusively with international clients (we cover industries from commercial aviation to fintech) thanks to a multinational support group of experts and management.

Currently, we are looking for a **Data Engineer** for an Adtech-related project.

**About the project:** a market leader in developing Competitive Intelligence for AdTech Search.
Application teams develop unparalleled technologies that help our clients understand their paid and organic search landscape and improve campaign performance.

As a Data Engineer, you will be working across our entire stack, so a real passion to drive the product and technology forward is something that we value. Your responsibilities will include helping with a vision for the future architecture of this complex data system, adding innovative ideas that use the latest cutting edge technology. You will work closely with Web and Data Science teams to deliver user-centric solutions to our customers and become an expert in developing high quality technical solutions.

**The stack of a project:**
Languages: Java, Scala, JavaScript (React, Backbone), SQL and scripting using Bash and Python
Frameworks: DropWizard, React, Akka and Play Framework (Scala)
Databases: PostgreSQL, AWS(S3), Redshift, Redis, MongoDB, Cassandra
Technologies: RabbitMQ (messaging), Quartz scheduling, Docker and Kubernetes, Maven
CI/CD: TeamCity, Jenkins
Source Control: Git (GitHub)
Other Tools: IntelliJ IDEA, Jira, Grafana
                                                                                                                                                                                       
**Main responsibilities and activities:**
Build services/features/libraries that serve as a definitive examples for new engineers and makes major contributions to library code or core services
Design low risk Spark process and write effective complex Spark jobs (data processes, aggregations, pipeline)
Design low risk APIs and write complex asynchronous, highly parallel low latency APIs and processes
Work as part of Agile team to maintain, improve, monitor Adthena's data collection processes using Java and Scala
Write high quality, extensible and testable code by applying good engineering practices (TDD, SOLID) using.
Understand and apply modern technologies, data structures and design patterns to solve real problems efficiently
Support TA and Data Science team to help deliver and productionise their backlog/prototypes
Take ownership and pride in the products we build and always make sure they are of the highest standard
Be empathetic towards team members and customers

**You will fit if you:**
Commercial experience developing Spark Jobs using Scala
Commercial experience using Java and Scala (Python nice to have)
Experience in data processing using traditional and distributed systems (Hadoop, Spark, AWS - S3)
Experience designing data models and data warehouses.
Experience in SQL, NoSQL database management systems (PostgreSQL and Cassandra)
Commercial experience using messaging technologies (RabbitMQ, Kafka)
Experience using orchestration software (Chef, Puppet, Ansible, Salt)
Confident with building complex ETL workflows (Luigi, Airflow)
Good knowledge working cloud technologies (AWS)
Good knowledge using monitoring software (ELK stack)
Motivated problem-solving skills, ability to bring ideas forward and adapt solutions to complex challenges

**Why choose us?**
“Family and Friends”. We are no longer a start-up, but still, have a family atmosphere in our supportive and spirited team, who are all working together on the same goal.
“Just break down all barriers and find a better way”. Every day you’ll meet with interesting and challenging (international) projects that are covering industries from commercial aviation to fintech (different technologies, different products).
“Hungry for learning”. You will get a lot of chances for career advancement and the development of new skills, opportunities for mentorship, or learning from more experienced colleagues.

**Benefits from 8allocate:**
Corporate events, holidays and team buildings for your joy.
Training and development: we have a huge library (about 500 books!) and a budget for your professional development.
People-oriented management without bureaucracy.
Paid vacation and sick leaves.
Relocation program: if you are from another city and want to move to Kyiv, we will be happy to help you.