Position: Big Data Engineer (Cyber Security Solution)
Company: Sigma Software
Experience required: 3y
Category: Python
English level: upper
Published: 2021-01-01T00:00:00+02:00

Being our team member means being open-minded, proactive and friendly, supporting, ready to accept the challenge, take responsibility, and never stop learning. We need to be one step ahead of attackers, which means being smarter, quicker, and looking beyond the surface.

Customer:
Clean.io is a novel cybersecurity solution that protects revenue and user experiences across all platforms.

Project:
We are working with a highly dynamic AdTech ecosystem with a goal to protect the world from malvertising.
As a member of the data & analytics team, you will work side by side with data engineers and data analysts to develop novel systems, algorithms, and processes to handle large amounts of data.
Our data infrastructure team processes around 100GB of compressed data, 700M near real-time events daily on a scalable, highly available platform.

Requirements:
4+ years of development experience with Python or Scala
Solid practical experience in using algorithms and data structures
Working experience with developing data pipelines based on one of the mainstream frameworks like Apache Spark, MapReduce, Apache Flink, etc.
Hands-on experience with developing data lakes and data warehouses based on one of the mainstream technologies like Hive, Snowflake, Hudi, etc.
Experience in using tools like Presto and similar ones
Knowledge in SQL and solid understanding of RDBMS technologies
Solid understanding of technical excellence and hands-on experience with code reviews, test development and CI/CD
Experience with GCP and AWS technologies
Would be a Plus:
Experience in AdTech domain

Personal Profile:
Feeling comfortable working in a startup environment, with a willingness to participate beyond their core job responsibilities
Strong communication skills and being an active team player
Creative and innovative, willing to give and push forward ideas

Responsibilities:
Contributing to new technologies investigations and complex solutions design
Coming up with well-designed technical solutions and robust code
Working and professionally communicating with customer’s team
Taking up responsibility for delivering major features
Participating in requirements gathering and clarification process
Developing core modules and functions
Performing code reviews, writing unit and integration tests
Creating awesome code with awesome documentation
Utilizing the best engineering practices (unit tests, code/design review, etc.)
Standing up for high quality solutions and bringing new ideas to life
Taking part in technical discussions, listening to arguments, and applying critical thinking