Position: Data Engineer (Scala Spark Java)
Company: SD Solutions
Experience required: 5y
Category: Data Engineer
English level: upper
Published: 2022-10-01T00:00:00+03:00

SD Solutions is a staffing company operating globally. Contact us to get more details about the benefits we offer.

**Responsibilities:**

Design, build & deploy complex backend data solutions to prod, starting from research and design to development and testing.
Being able to process Terabytes of data while providing the best possible performance and SLAs using the most state of the art big data technologies.
Work closely with product, architects, and other R&D teams to deliver the best solutions to the business.
Monitor the solutions in production to make sure they are fully stable, scalable and performant at all times.
Work closely with data sciences experts.

**Requirements:**

3+ years of proven experience in building complex backend data solutions end to end.
3+ years in working with big data tools, processing and transferring large amount of data between systems.
3+ years in working with Scala & Spark.
Proven ability of writing complex SQL queries.
Strong analytical and problem-solving skills with attention to details.
Solid knowledge in Python and Linux operating systems.
Fluent verbal and written English skills.

**Advantages:**

Experience with Amazon Redshift, Pentaho, Tableau.
Experience with Apache Airflow and AWS tools (EMR, Docker, K8S).
Familiarity with the Ad Tech industry and RTB.
Experience with data science algorithms.
Extensive experience in OOP, Unit testing/TDD, continuous Deployment.
Familiarity with at least one of the following technologies: Java, NodeJS.

**About the company:**

Perion is a global technology company that provides digital advertising technology solutions to the biggest brands and publishers around the globe. With our unique data-driven AI/ML based technologies, we deliver and optimize hundreds of terabytes of data and billions of events per day from dozens of sources to provide a superior user experience across screens and platforms, including mobile, video, social and native.