Position: Senior Data Engineer (Python)
Company: Proxet
Experience required: 5y
Category: Python
English level: upper
Published: 2023-03-01T00:00:00+02:00

Project tech-stack: Airflow, Amazon API, Spark, S3, Pandas, Python (Django), Databricks

ABOUT THE ROLE:

We’re looking for a Senior Data Engineer, who will act as a fully dedicated, integrated extension of the engineering team. You will be solely focused on our project, attending daily standups, working hand-in-hand with other developers through the integration process, supporting the back-end, maximizing the overlap of the teams across time zones.

About the project:

The startup we work with started three years ago with no legacy code. The Client wants to build easy-to-use valuation tools for e-commerce stores (Amazon, eBay, Etsy, Shopify, or other) - range of valuations based on key business metrics, like sales, growth and profitability; historical valuations to understand how performance changes over time; areas of potential improvement.

About the client:
Growth capital company that helps to build out online stores on Amazon, eBay, Etsy, Shopify, or other e-commerce platforms, with business tools and proprietary solutions that gives a competitive edge of online presence. Capital-as-a-Service (CaaS) solution that allows platforms and marketplaces to offer custom funding solutions to amplify customer growth with a unique suite of APIs and SDKs.

Location:
Remote: Poland, Wroclaw/Krakow

Skills & Experience:
4+ years of data engineering experience;
Fluent in at least one programming language (Python preferred);
Strong programming skills (data structures, SOLID, Clean Code, Design Patterns and so on)
Strong experience and understanding of relational and distributed databases;
Strong experience with at least one cloud provider (AWS preferred);
Experience with at least on scheduler type (Airflow, Event Bridge, Prefect, Dagster)
Experience with data frameworks (pandas, spark)
Experience with Big Data infrastructure tools such as EMR, Databricks
Experience working with 3rd party API services;
Creation, maintenance and support of data pipelines;
Understanding of ETL, data design, and data governance;
Troubleshoot and improve the infrastructure required for optimal extraction, transformation, and loading of data from a variety of data sources using SQL, Spark, and other big data technologies;
Upper-intermediate English or above.

Nice to have:
Understanding of integration with BI tools;
Knowledge and work experience of using Kubernetes;
Basic knowledge of IAC (e.g., Terraform);
Delta Lake knowledge.
Responsibilities
Maintain high standards of software quality within the team by establishing good practices and habits;
Build microservices that interact with internal systems and third-party APIs/services;
Ensuring the goals are met and ensuring the quality of the code via a standard code review process;
Working according to the Kanban process.