Position: Big Data developer
Company: Deventor
Experience required: 2y
Category: Data Science
English level: intermediate
Published: 2021-02-01T00:00:00+02:00

The customer offers innovative marketing decision support systems for brands, media/creative agencies and media owners across the globe in the following fields of expertise:
Business Analytics for the Marketing Industry
Communication Planning
Expertise & Innovation
Analytics & Research

The customer’s tools help support the decisions of large advertisers, media owners and media agencies on the tactical and strategic levels.

About the Project:
This is a reporting/analytics tool backed by a Spark cluster. You will mainly be focused on middle-tier components (no front end).

Immediate focus:
Performance improvements (Spark configuration changes plus suggestions for improvements involving Java/Spark or Parquet)
Spark and HDFS upgrade

Responsibilities:
Be responsible for developing, enhancing, re-engineering & maintaining applications with Scala
Contribute to the overall design and architecture of the application developed and deployed
Ensure designs are in compliance with specifications
Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review
Attend meetings

Requirements:
3+ years of experience in Scala, Apache Spark
Hands-on experience with Java
Knowledge of AWS /EMR is very desirable
Big Data Experience
Good knowledge of Apache Hive, SQL, PySpark
A commitment to developing solid, tested, high-performing, and valuable software
Excellent problem-solving and troubleshooting skills; you must be able to quickly assess problems and determine steps for resolution
Excellent written and verbal communication skills

English level:
Intermediate

Project Timeline: ASAP - 3-6 months with extension possibilities