Position: Scala + Apache Spark Developer
Company: CIGen
Experience required: 3y
Category: Scala
English level: upper
Published: 2022-06-01T00:00:00+03:00

At CIGen we partner with both startups and experienced enterprises to help them achieve their business goals through software solutions.

Our company is driven by the core values that are professionalism, trust, and mutual respect.

We believe that the only way to achieve long-term business success is to build long-term trusted relationships with clients, employees, and partners.

Hence, the quality of our services is crucial!

Currently, we are looking to add a Scala & Apache Spark Developer to our team.

This position could be fully remote.

🔹  **Responsibilities:**
• Designing, creating, and maintaining Scala-based applications 
• Create Scala/Spark jobs for data transformation and aggregation 
• Design data processing pipelines 
• Participating in all architectural development tasks related to the application 
• Writing an efficient code in accordance with the project requirements 
• Collaborating with cross-functional teams & stakeholders


🔹  **Requirements:**
• At least 3+ years of commercial experience with Scala, Apache Spark & • • Big Data technologies
• Significant experience with big data ETL pipeline development with Spark and related technologies 
• Solid understanding of performance tuning concepts for Apache Spark jobs and handling large data volumes data from various sources/formats 
• Good experience with Scala testing frameworks & tools (ScalaTest, ScalaCheck, ScalaMock) 
• Spark query tuning and performance optimization 
• Experience with Databricks 
• Experience with Hadoop, HDFS, MapReduce 
• Experience with ClickHouse 
• Experience with SQL 
• Strong analytical capabilities 
• Comfortable with cloud systems and Azure Big Data services 
• English: Upper intermediate and higher. Good enough to take a technical interview comfortably.

🔹 **Would be a plus:**
• Experience with Microservices Architecture 
• Experience with Apache Hive 
• Experience with Microsoft Azure 
• Knowledge of Python and/or .NET/C# 
• English Advanced

🔹  **About the project:**
It's an outsource project for our long-time client from the USA. The product is a powerful and complex marketing software platform that blends data, technology, and analytics to drive accelerated results. It includes implementation of Big data and Machine learning technologies.

Current stage: some systems are under ongoing development, and some are just starting up.

**Technology stack: ASP.NET Core, Entity Framework Core, React, Azure Databricks, Apache Spark.**

🌻 **We offer:**
• Interesting and challenging projects with modern technologies;
• Possibility of fully or partly remote work;
• Flexible working hours to support your work-life balance;
• Transparent and flexible processes;
• Endless possibilities for your professional growth and continuous support from management;
• Cozy, friendly and fun atmosphere;
• In-house English tutor;
• Paid sick leaves and vacations;
...and much more!

We look forward to hearing from you!