Position: Data Engineer
Company: Techstack Ltd
Category: Data Engineer
Experience required: 3y
English level: intermediate

We are currently seeking a Data Engineer to build scalable, big data pipelines and repositories capable of processing millions of messages per day, providing fast and deep insights to customers and partners via API, web, and mobile interfaces.

Our client is the biggest industrial company, trusted by top Corporate Real Estate professionals (CRE) who need to make data-driven business decisions to inform their real estate strategy and measure impact. This flexible workspace analytics platform, data insights, and domain expertise are proven to transform the workplace experience in offices around the world.
The Product is looking for the next innovation in CRE technology, leveraging a decade of CRE and analytics expertise to help customers understand and plan their workspace.

Stack of Technologies:

GCP;
BigData;
Spark or mapReduce;
SQL/BigQuery/PubSub;
Spark, Databricks, SQL, Azure Data Lake, Delta Lake;
Machine learning;
Azure.

About the role
As a Data Engineer to build scalable, big data pipelines and repositories capable of processing millions of messages per day you can provide fast and deep insights to our customers and partners via API, web, and mobile interfaces.

Responsibilities:

• Acting as a lead and mentor to other members of the data engineering team;
• Writing clean code and tests;
• Building, maintaining and optimizing data pipelines and repositories using Python, Spark, Databricks, SQL, Azure Data Lake, Delta Lake;
• Working closely with data analysts to gather requirements for data to feed visualizations;
• Working closely with the data team lead to define and implement data engineering best practices for performance, quality, and operational monitoring;
• Working closely with QA to automate the testing of data pipelines;
• Contributing to architectural decisions;
• Producing detailed design documentation and diagrams.

Required skills

• Experience creating big data pipelines and maintaining large scale data processing architecture;
• Knowledge of medallion data lake house architecture;
• Knowledge of dimensional models and best practices;
• Advanced experience with Databricks, Spark, Python, and SQL development;
• Demonstrable professional experience building and supporting production systems;
• Energy, enthusiasm, and initiative;
• Professional experience developing high throughput, event-based solutions;
• Client facing experience with a focus on customer experience is considered a strong asset;
• Professional experience designing and developing cloud-based data-oriented PaaS solutions in Azure considered an asset;
• DevOps experience using Azure DevOps is considered an asset;
• Experience utilizing various BI tools (Tableau, PowerBi, D3.js) is considered an asset;
• Experience with Machine learning is considered an asset.

Our benefits

• Strong opportunities for professional and career growth - Meetups, TechClubs, Professional Library and more;
• Challenging tasks with a friendly experienced team;
• Flat hierarchy without micromanagement — our doors are open, and all teammates are approachable;
• Direct communication with stakeholders and the ability to influence product development;
• Up to 50% compensation of educational courses and conferences price for professional growth;
• Free English classes and The English Business Course;
• 23 business days leave and medical Covid support;
• Regular team events and activities;
• Gifts for significant life events.