Position: Data Engineer
Company: AgileEngine
Category: Scala
Experience required: 3y
English level: upper
Published: 2021-07-01T00:00:00+03:00

**What is required?**
3+ years of experience in data engineering using Scala, Apache Spark
Hands-on experience with Apache Spark (Batch & Streaming)
Experienced in building high performing, scalable, observable, reliable, extensible data pipelines that process large volumes of data in both batches and streams
Practical experience in designing and using Data Lakes and MPP DW systems (Snowflake, Yellowbrik, Vertica)
Using logs, tools, and other data to methodically identify issues (performance, environmental or otherwise)
Consuming and supplying data via APIs
Well versed in a variety of Spark, Kafka, RDBS, and other Big Data technologies
Self-motivated and self-managing, with strong organizational skills
Team Leadership skills and experience setting up process on the project
Great English and communication skills

**What you will do:**
Develop new applications and features within a scrum team providing data and data services to the enterprise, other engineering teams, data science, analysts, product, management/executives, and other business teams
Build high performing and scalable data platforms to support multiple data pipelines to ingest and deliver data as fast and reliably as possible
Implement new technologies and practices to provide the best solutions to our customers
Develop and maintain solutions on our tech stack environments (Spark Streaming, Spark, Kafka, Vertica, SQL Server, etc.)
Work with business teams to create technical requirements and deliver within time and scope
Help develop team members through code reviews, enforcing standards, best practices, policies, and processes
Perform functional testing, end-to-end testing, performance testing, and UAT of applications and code written by self and other members of the team

**What we offer:**
Great compensation package, highest salaries on the market
Flexible work schedule
Friendly and a very skilled team with great corporate culture and mentorship (visit us and see it yourself)
Opportunities for self-realization, professional and career growth
Cool events and team activities
Professional workshops and training, a great engineering culture