Position: Senior Data Engineer
Company: AgileEngine
Category: Other
Experience required: 3y
English level: upper
Published: 2021-06-01T00:00:00+03:00

You will be primarily responsible for the design and coding of new features and applications, enhancing existing products, and implementing new technologies, paradigms, and practices to provide the best solutions to our customers. This includes technical design and development of Cardlytics current and future systems as a part of a team of other data engineers and across other Engineering and business teams. The senior data engineer will also be responsible for implementing organizational and industry standards and best practices to ensure compatibility, reliability, resiliency, scalability, performance, and maintainability.

**Requirements**
4+ years of experience in data engineering using Scala, Apache Spark
Hands-on experience with Apache Spark (Batch & Streaming)
Experienced in building high performing, scalable, observable, reliable, extensible data pipelines that process large volumes of data in both batches and streams
Practical experience in designing and using Data Lakes and MPP DW systems (Snowflake, Yellowbrik, Vertica)
Using logs, tools, and other data to methodically identify issues (performance, environmental or otherwise)
Consuming and supplying data via APIs
Well versed in a variety of Spark, Kafka, RDBS, and other Big Data technologies
Self-motivated and self-managing, with strong organizational skills
Team Leadership skills and experience setting up process on the project
Great English and communication skills

**Responsibilities**
Develop new applications and features within a scrum team providing data and data services to the enterprise, other engineering teams, data science, analysts, product, management/executives, and other business teams
Build high performing and scalable data platforms to support multiple data pipelines to ingest and deliver data as fast and reliably as possible
Implement new technologies and practices to provide the best solutions to our customers
Develop and maintain solutions on our tech stack environments (Spark Streaming, Spark, Kafka, Vertica, SQL Server, etc.)
Work with business teams to create technical requirements and deliver within time and scope
Help develop team members through code reviews, enforcing standards, best practices, policies, and processes
Perform functional testing, end-to-end testing, performance testing, and UAT of applications and code written by self and other members of the team

**We offer**
Great compensation package, highest salaries on the market
Flexible work schedule
Zero bureaucracy
Friendly and a very skilled team with great corporate culture and mentorship (visit us and see it yourself)
US democratic management style
Opportunities for self-realization, professional and career growth
Cool events and team activities
Professional workshops and training, a great engineering culture