Position: Data Engineer
Company: Softengi
Experience required: 5y
Category: Data Engineer
English level: upper
Published: 2022-09-01T00:00:00+03:00

**Duration: long-term (1+year)**

**Summary**
Building a data platform for a new product. Fully remote work for a fast-growing US company with experienced engineers.

We are looking for individuals passionate about making sense of the vast amounts of data that explore, analyze and implement the solutions they represent.

**Project Technology – Stack: Python, SQL, AWS.**

**Skills**
Python, SQL, Amazon Web Services (AWS)
Nice to Have
dbt, Docker, Apache Airflow, pandas
Ukraine & All Europe

**Your qualification:**
Data engineering experience
Experience working with 3rd party API services
A clear understanding of ETL/ELT and data curation
Strong experience and understanding of relational and distributed databases (including internals) (e.g. PostgreSQL, MySQL, etc.), experience in working with databases using pure SQL-queries
Strong experience with AWS (S3, Aurora Serverless, Glue/Athena) and Docker
Strong expertise in Python
Hands-on experience with dbt
Hands-on experience with Airflow/Prefect
Experiences in OOP, Design Patterns, design principles (SOLID, DRY, KISS, YAGNI)
Work experience with Python modules and libraries Pandas, Numpy, Unit tests, Pytest, Selenium, Boto3
Experience in using code linters such as Flake8 and Pylint
Knowledge of PEP8 standard
dbt, Docker, Apache Airflow, pandas
Experience with continuous integration, test automation, and deployment
Experience with data monitoring and tracing in distributed and service-oriented systems
Experience in distributed systems design and best practices
Good written and spoken English

**Will be a plus:**
Experience with data monitoring and tracing in distributed and service-oriented systems
Experience in distributed systems design and best practices
Understanding of integration with BI tools (esp. Tableau)
Jenkins as CI tool and/or ETL orchestrator
Python libraries/modules/tools: threading, asyncio
Javascript: Node JS + Frontend part (ReactJS)

**Responsibilities:**
Work with the data engineering team and design the data platform
Systematically work on formalizing business processes, customer acquisition, lifecycles, and the overall data framework
Actively participate in the development