Position: Senior Data Engineer
Company: eTeam
Category: Python
Experience required: 3y
English level: upper
Published: 2023-03-01T00:00:00+02:00

Responsibilities:

Collaborate across teams on the design and development of our data mart (ETL, data modeling, metric design, reporting, and dashboard) to assure stable reporting infrastructure;
Data Transformation and Integration: extract data from identified databases. Create automated data pipelines and transform data to a structure that is relevant to the problem by selecting appropriate techniques. Develop knowledge of current data science and analytics trends;
Data Source Identification: Support the understanding of the priority order of requirements. Help identify the most suitable source for data that is fit for purpose. Perform initial data quality checks and validation on extracted data;
Maintain our data warehouse with timely and quality data;
Create and maintain architecture and systems documentation;
Take on research projects to improve data processing and any implemented machine learning frameworks used by our team;
Be exemplary in promoting Data Engineering best practices within the team;
Plan and execute system expansion as needed to support the company's growth and analytic needs;
Introduce new skills and knowledge into the team adding to the already dynamic environment our Data Engineering team has created;
Share knowledge to complement team-wide expertise;
Assist with the elicitation and documentation of system requirements;
Understand business and technical requirements and constraints to design effective software solutions;
Create conceptual architectures and detailed designs for software solutions;
Constantly improve product quality, security, and performance;
Solve technical problems of the highest scope and complexity;
Working with stakeholders to support their data infrastructure needs;
Develops efficient automated data flows. Analyzes data-related system integration challenges and proposes appropriate solutions.

Requirements:

5+ years of relevant experience in back development;
Demonstrably deep understanding of SQL and analytical data warehouses;
Proficiency in Python;
Practical experience with Snowflake/Google BiqQuery, Fivetran, dbt;
Familiarity with AWS data-related services: Lambda, Kinesis, EventBridge, S3, Athena, OpenSearch, Cognito;
Hands-on experience implementing ETL (or ELT) best practices at scale;
Hands-on experience with data pipeline tools;
Understanding of serverless architecture (AWS Serverless Application Model);
Strong data modeling skills;
Upper-intermediate written and spoken English.

Will be a plus:

Bachelor's degree in computer engineering, software engineering, or a related field;
Experience with large data gathering/collection;
Experience delivering end-to-end projects independently;
Experience using business intelligence reporting tools;
Experience with stream-processing systems.

We offer:

Grow professionally with subsidized certifications, courses, and conferences;
Improve your English with conversation clubs and direct client communication;
Remote work, flexible schedule, bonuses for important life events.