Position: Middle/Senior Data Engineer (AdTech/DSP)
Company: Sigma Software
Experience required: 3y
Category: Data Science
English level: upper
Published: 2021-10-01T00:00:00+03:00

We are looking for a mature Data Engineer to help us in building the demand-side platform that helps the world’s top brands at launching, analyzing, and optimizing their digital advertising campaigns across display, native, mobile, video, audio, digital out of home, and advanced TV formats.

**CUSTOMER**
Our Customer is a pioneer in “programmatic” advertising. Based in the USA, the Customer helps the world’s top brands deliver personalized digital advertising across all connected touchpoints. Over 9,500 marketers in 42 countries use the demand-side platform every day.
The Customer builds a technical and commercial framework for agencies, brands, tech companies, and content owners designed to provide long-term sustainable solutions for a clean digital media supply chain with brand-safe, viewable inventory utilizing their platform.

**PROJECT**
The demand-side platform we are developing receives up to 10 million advertising opportunities per second. We run this data through over several internal and partner enrichments to extract many targetable properties. At the end we match it against 100s of thousands of advertising strategies to choose the best ad and we do all this in less than 1/10th of a second.
These functions include generating critical metadata used by the real-time bidding systems as well as producing reporting for internal and external clients. The team uses modern big data and cloud technologies to solve problems in this domain. Our core tech stack is Python, SQL, and Spark with AWS.

**RESPONSIBILITIES**
- Own a complex and critical set of our big data services and applications
- Lead technical discussions with other Engineers with emerging ability to ensure that technologies chosen to support our products provide the most appropriate and robust functionality
- Provide regular guidance to more junior engineers to ensure that all teams are producing code that is sound, efficient, and maintainable
- Assist in defining the team’s technical strategy and advise on product backlogs and roadmaps to achieve strategic goals

**REQUIREMENTS**
- 3+ years of software development experience building scalable applications and Big Data services with extensive experience with Python and Spark
- Recent experience with AWS, such as: S3, EMR, Glue, ECS/EC2, Lambda, RDS, IAM, and CloudFormation
- Big Data or ETL experience with exposure to the likes of Spark, Hadoop, Hive, and Airflow
- Experience with relational and non-relational databases such as PostgreSQL and DynamoDB
- Production expertise (enterprise experience is a strong plus) with emphasis on building observable, scalable applications including CI/CD pipelines and automated monitoring/alerting (CircleCI, CloudWatch)
- Ability to quickly diagnose, understand root cause of, and resolve a wide range of software engineering or technical issues, minimizing the impact on productivity
- Passion for following SOLID Design Principles
- Clear and effective written and verbal communication skills
- At least Upper-Intermediate level of English