Position: Senior Big Data (BI) Engineer
Company: SD solutions
Category: Scala
Experience required: 5y
English level: upper
Published: 2020-07-01T00:00:00+03:00

Profile and Experience:

A minimum of 5 years of development experience in any one or more of the following Python/Scala.
A minimum of 5 years of experience in developing/supporting DW/BI Applications.
A minimum of 5 years’ experience in supporting/troubleshooting failed Pentaho Data Integration/Kettle ETL processes.
A minimum of 3 year experience in developing Tableau Dashboards for end users.
Strong database administration and development skills, especially MySQL and Redshift databases.
Strong in writing complex SQL queries and performance tuning techniques.
Experience in working with AWS S3, AWS Data Pipeline, AWS EMR, AWS Redshift, AWS Athena, and AWS Kinesis.
Basic scripting skills in Bash/Perl.

Job Responsibilities:

Support reporting services and database management systems before they go live throughout the development lifecycle activities such as system design, developing the data platforms and frameworks, capacity planning and launch reviews.
Spend 50% in applying software and data engineering background in resolving reporting and data platform disruptions in Undertone's Ad Platform. This will involve investigation on data and integration of various services used in the data management platform - Amazon Web Services such as Redshift, Elastic Map Reduce, Data pipelines, etc.
Provide a quick temporary solution so that there is minimal downtime for the business and then work on escalation for providing a permanent fix. Need to prioritize the reporting and data refresh issues to ensure the business users are equipped with near real-time data.
Use 10% of your time to participate in System design review meetings to provide your inputs based on data engineering experience.
Another 10% of time will be spent on validating the data quality and integrity of the newly developed projects.
At the end of every Sprint cycle, participate in post-production activities such as code reviews and preparation of documentation of runbooks for ETL /data pipeline.
Spend 30% of the time learning new data technologies and implementing data solutions for providing real time insights that will enable the business users to take right decisions.
Work on 3rd party integration projects by implementing Third Party API’s.
Apply your creative mind in addressing urgent business requirements by providing quick data solutions with minimal turnaround time to avoid any disruption to the business.
Collaborate with System Administrators and Database Administrators to fix software infrastructure problems.

At Undertone, we sit at the intersection of media, creative, and technology. We have formed deep partnerships with the world’s best digital media properties, developed a suite of groundbreaking multi-screen creative formats for brands to leverage, and built technology platforms that underpin every aspect of campaign planning, delivery, optimization and measurement.