Position: Data Engineer
Company: FrontRunners
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-09-01T00:00:00+03:00

About the Team:

Our team leverages distributed systems, machine learning, and personalized search to connect listeners to the content they adore, and to derive insights that enable us to deliver flawless user experiences. Help us invent the systems that will power the future of the radio!

About the Role💡

As a member of our team, you will join us in architecting the future of our data and machine learning platforms. You will leverage technologies such as Apache Airflow, Kafka, and Spark, to build real-time data pipelines capable of processing billions of events across over 200 connected device types. The infrastructure we build will be a core part of our future.


What We Are Looking For🔍
-Expert in engineering data pipelines using big data technologies (Hive, Presto, Spark, Flink, etc, on large-scale data, sets demonstrated through 5+ years of experience
-Highly proficient in at least one of Java, Python, or Scala
-Comfortable with complex SQL
-Understand the Data Lifecycle and concepts such as lineage, governance, privacy, retention, anonymity, etc
-Conceptually familiar with AWS cloud resources (S3, EC2, RDS, etc)
-Experience with modern deployment and CI/CD practices (Docker, Kubernetes, and Spinnaker)
-Hungry for impact and insatiably curious about new technologies and frameworks
-Ready to build new things without being constrained by technical debt, in a nimble, startup-like environment.

What You Will Do:📌
-Engineer efficient, adaptable, and scalable data pipelines to process structured and unstructured data
-Implement real-time event aggregation pipelines to power content & user insights, quality monitoring, and experimentation
-Maintain and rethink existing datasets and pipelines to service a wider variety of use cases
-Build scalable infrastructure for rapid deployment of machine learning models in production environments
-Design modern personalization & experimentation systems (A/B Testing, Multi-armed bandits).