Position: Senior Big Data Developer
Company: AppsFlyer
Category: Java
Experience required: 3y
English level: upper
Published: 2021-05-01T00:00:00+03:00

Working with this enormous volume of data begins with massive ETL pipelines built using modern industry standard tooling such as Kafka, S3, Yarn/Hadoop and especially Spark. Then providing access to this data requires employing multiple database technologies each suited to the specific analytics tasks. The databases we use are constantly evolving but currently include BigQuery, MemSQL, HBase, Aerospike, Druid, Neo4j, Redis and more. We are big believers in working with the right tool for the right job, including in programming languages. We run a truly polyglot shop with Scala, Clojure, Python, Ruby, Go and JavaScript being especially common here at AppsFlyer. The extreme growth rate of our data and client base means that solutions need to be designed to handle 10X growth or more. Supporting this rapid pace of growth and polyglot development is a sophisticated automated deployment and scaling infrastructure that deploys docker containers into multiple cloud environments.

 

Department Description:
Data Lake team consists of  5 engineers in Israel and Ukraine and builds reliable and robust storage for all events across AppsFlyer (25 PB). Responsibility zone is much broader than “Data Lake”, it includes management of schemas, ETL’s, interfaces to and from storage. 

 

What you’ll do:

Collaborate in architecture and evolution of data pipeline from raw to production
Build and own a data environment that is robust, high-quality and provides fast access
 

What you have:

5+ years Java development
Strong Java core
Experience with Kafka, Spark, Hadoop or any other distributed technologies
Experience in working with high scale, distributed cloud-based architectures and AWS specifically
Excellent analytical and interpersonal skills, with ability to work successfully with engineers, product owners and business stakeholders
Good communication skills - both spoken and written English.
Bonus Points

Knowledge of Scala/Go is a plus
Recommended by an AppsFlyer employee
Social Package includes:

Medical Insurance
Paid team sport activities
English classes
Paid unlimited vacations + all Ukrainian national holidays
Paid sick days
Meals reimbursement
Team building, happy hours and other team activities
Parking reimbursement
Snacks, fruits & ice cold beer
All new team members are provided with a brand new Mac laptop with 2 monitors and Starter package.
As a global company operating in 19 countries across 5 continents, we reflect the human mosaic of the diverse and multicultural world in which we live. We ensure equal opportunities for all of our employees and promote the recruitment of diverse talents to our global teams without consideration of race, gender, culture, or sexual orientation. We value and encourage curiosity, diversity, and innovation from all our employees, customers, and partners.

“As a Customer Obsessed company, we must first be Employee Obsessed. We need to make sure that we provide the team with the tools and resources they need to go All-In.” Oren Kaniel, CEO