Position: Lead Data Engineer (Scala/Java)
Company: Proxet
Experience required: 5y
Category: Data Science
English level: upper
Published: 2020-09-01T00:00:00+03:00

Required skills

Job Summary
We are looking for a Senior Data Engineer who will participate in refactoring, redesigning, and improving the data platform, as well as participate in the development of new projects.

Requirements:
— 5+ years of experience in Data Engineering/Software Engineering/Database Development
— Strong understanding of business, customer, product, and clickstream analytics, recommendations and personalization, A/B testing
— Database proficiency: experience with both relational and NoSQL databases
— Understanding of ETL and data curation
— Hands-on experience working with large data sets
— Proficiency with Scala and Java (and JVM ecosystem in general)
— Strong understanding and experience:
— MapReduce systems: Hive, Hadoop
— Spark, Spark SQL, and Spark Streaming
— Kafka ecosystem (Kafka Connect / Kafka Streams)
— Workflow/job scheduling systems (Apache Airflow)
— Distributed query execution engines (e.g., Presto)
— Service-based architectures and containerization
— AWS (EMR, S3)
— CI/CD
— Upper-Intermediate English level

As a plus

— Database/Data Warehousing background

We offer

The fully remote long-term contract, flexible hours, and a high level of compensation.

Responsibilities

— Work with the Data Engineering team to refactor, redesign, and improve the data platform
— Support architectural initiatives to improve reliability, resiliency, stability, and data quality
— Participate in the development of new projects
— Build ETL pipelines using Kafka/Spark/Hive
— Monitor the health of our system and optimize for performance and cost savings
— Support daily ETL jobs monitoring and participate in correcting any issues that arise
— Develop unit and integration tests

Project description

IMVU is an online metaverse and social network. IMVU had over four million active users in 2014. The current number of active players is 6M+, and the site has a virtual goods catalog of more than 40 million items.
We are creating the next generation of VR social networks, based on a distributed, service-mesh-type architecture with underlying Java, MongoDB, GODOT engine, and other technologies, deployed via Kubernetes onto AWS and Google infrastructure.
We have a team in California and in Kyiv, Ukraine.