Position: Data Engineer
Category: Data Science
English level: upper
Years of experience: 6


Big Data Software Engineer
Responsibilities:
· creating views, developing ETL scripts in Teradata;
· developing and supporting NRT DAGs using Apache Airflow & Python;
· collaborating with Business Analysts and stakeholders on projects requirements;
· consuming data from Kafka topics into Teradata using Apache Spark;
· creating pipelines that output data into AWS S3 buckets for Business Intelligence Engineers;
· implementing scripts for backfilling data into production fact tables;
· on-call activities, documenting solutions for arising issues.

Big Data Software Engineer
Responsibilities:
· creating views and stored procedures in BigQuery and Snowflake;
· working on sharding, partitioning, clustering optimization in BigQuery;
· supporting Data Analysts team (reviewing PRs, creating new sources);
· integrating Salesforce sources with Snowflake DW using Fivetran and Segment;
· creating integrations from AWS S3 to Snowflake using AWS SNS topics and Snowpipes;
· executing performance scripts, parsing raw data, documenting implemented solutions;
· developing and supporting ETL pipelines using Apache Airflow & Python;
· configuring data unload from MongoDB, PostgreSQL, MySQL to GCS and AWS S3.

Data Warehouse & Business Intelligence Engineer
Responsibilities:
· creating views and stored procedures in Oracle;
· developing and supporting Qlik Sense dashboards;
· modelling section access structure for a different level application security;
· developing and supporting NPrinting 17+ reports (PixelPerfect, Excel, HTML);
· collecting and analysis requirements for the projects from customers and end-users;
· creating a three-level architecture for projects in Qlik Sense;
· migrating dashboards from QlikView to Qlik Sense and NPrinting reports from 16 to 17+;
· developing and supporting IBM DataStage ETL processes (from files, databases to Oracle);
· developing and supporting SSIS ETL processes (from Salesforce, Google Analytics to Oracle).

Data Warehouse & Business Intelligence Engineer
Responsibilities:
· creating views and stored procedures in MS SQL Server;
· developing and supporting Qlik Sense dashboards;
· uploading customer sales on a daily or weekly basis;
· administrating a system for training and testing (edX);
· creating advanced SQL queries, producing reports using Qlik Sense;
· generating reports by mail from dbms on a weekly or monthly basis;
· unloading user testing results using MySQL, MongoDB and MS SQL Server.