Position: Data Engineer (Newage)
Company: RQ Team
Experience required: 2y
Category: SQL
English level: intermediate
Published: 2020-03-01T00:00:00+02:00

PROJECT DESCRIPTION:
Highload platform project — a reactive system, delivering high performance, distributed and resilient solutions to our operator clients around the world. Our great pluses: we develop our product, we use cutting-edge technologies (microservice architecture), and we work in comfortable conditions. This is a B2B service, which is successfully working and developing during last 4 years.

REQUIREMENTS:
• 2+ years of experience as a Data Engineer;
• Proficient with SQL and RDBMS, preferably PostgreSQL, MariaDB;
• Professional experience using Python for data processing purposes;
• Experience designing and monitoring data pipelines;
• Strong data mining / processing skills;
• Experience in understanding Data Warehouse building principles;
• Hand-on experience in designing data pipelines ETL, ELT, exposing processed data to end users.

RESPONSIBILITIES:
• Architect, Design and implement ETL pipelines for multiple data sources ingesting massive amounts of data daily;
• Develop and maintain new projects and tools around the data warehouse;
• Optimize, improve, and do refactoring of current applications if deems fit;
• Collaborating with software engineers to capture, format and prepare data for for various purposes;
• To develop and maintain the API interfaces necessary to access the data.

WILL BE A PLUS:
• Experience with ElasticSearch or other NoSQL data stores;
• Experience with streaming based, about real time Data Warehouses, mostly interested in Apache Kafka, KSQL, Spark or similar;
• Familiar with CI / CD using Jenkins pipelines or similar tools;
• Data synchronization tools / processes between heterogeneous data sources (SQL, noSQL, DMS, Debezium, ElasticSearch etc);
• Degree in Data Science, Statistics, Applied Math, Econometrics, Computer Science, or other related fields.

WE OFFER:
• Competitive compensation depending on experience and skills;
• Long-term employment;
• Career growth opportunities;
• Compensation for sick lists and regular vacations;
• English classes with native speaker;
• Health insurance;
• Free lunches;
• Free fruits and sweets;
• Relax zone with PlayStation and TV;
• Comfortable office near Dorohozhychi metro station.

Technologies and Tools we use at the moment:
• Airflow, Apache Kafka, Kafka Connect, KSQL;
• Fivetran, AWS S3, AWS DMS;
• ElasticSearch, PostgreSQL, MariaDB, AWS Aurora, AWS RDS;
• Java, Scala, Groovy, Node.JS, Python 3;
• Git, Docker, Jenkins, ELK, Terraform, Prometheus, Graphana.