Position: Senior Data Engineer, Media Conglomerate
Company: DataArt
Experience required: 3y
Category: Data Engineer
English level: intermediate
Published: 2022-08-01T00:00:00+03:00

DataArt team is designing and developing a future-proofed Big Data Analytics Platform to capture, store, and presenting as reports and dashboards, transactional consumption data, consumer demographics information, social metrics, playlists, and “chart” data.

TEAM
DataArt team is designing and developing a future-proofed Big Data Analytics Platform to capture, store, and presenting as reports and dashboards, transactional consumption data, consumer demographics information, social metrics, playlists, and “chart” data.

POSITION OVERVIEW
We are looking for data engineering specialists to help us actively develop the platform, create data pipelines and improve the quality of data. The project will allow you to gain experience in working with modern, cutting-edge platforms, frameworks and standards, such as Serverless, Event-driven, ELT, Amazon Web Services and Snowflake SAAS, and will introduce you to different aspects of the music business. Our main data consumers are Data Scientists, Marketing departments, BI Analysts, artists, and their managers.

TECHNOLOGY STACK
AirFlow, Amazon Redshift, AWS, Python, Redshift, Snowflake.

Responsibilities

-Requirements analysis, communication with Product Managers and other stakeholders
-Prepare designs for database systems and recommend improvements for performance
-Create data pipelines (ETL/ELTs) using SQL, Python, and various AWS services
-Writing analytical SQL queries for end-user apps/services
-Perform troubleshoot on all ETL processes and resolve issues effectively
-Code reviews and bug fixing

Requirements

-Strong understanding of DWH/ETL fundamentals and concepts
-Expert SQL knowledge in one or few RDBMS: MSSQL/PostgreSQL/Oracle
-Experience with one or few ETL tools and frameworks (MS SSIS, Pentaho, Talend, Informatica, etc)
-Experience with any of the following DWH: AWS Redshift, Snowflake, BigQuery
-Experience with AWS Cloud Platforms
-Analytical mindset
-Spoken English

Nice to have

-Snowflake experience
-Python experience
-Experience with BI tools (Tableau, Looker, etc)
-Experience with NoSQL databases: Cassandra, MongoDB, DynamoDB, OrientDB
-Understanding CI/CD concepts
-Big Data concepts and experience with Hadoop/Spark
-Experience in the Media industry and its standards