Position: Senior Data Engineer
Company: Data Science UA
Experience required: 3y
Category: Data Engineer
English level: intermediate
Published: 2023-01-01T00:00:00+02:00

Ми шукаємо досвідченого Data Engineer в прогресивну молоду fintech-продуктову компанію.

We are looking for a Data engineer to join engineering team of our customer and assist them in real-time trading implementation and internal tooling development. Every day, their algorithms process more than 500 million data points. As a result, low latency and fault tolerance are essential for them.
As a part of the team Data Engineer will be responsible for preprocessing, cleaning and storing financial data sets: market data, fundamentals and alternative data sets. The role also includes writing complex ETL and optimization pipelines using multiprocessing and distributed computing frameworks (DataBricks, AWS EMR, Apache Spark).

**Responsibilities:**
- Processing and storing high-volume financial datasets.
- Creating ETL pipelines using AWS/internal tools.
- Preprocessing data for our research and development team.
- Be part of the team responsible for real-time trading implementation.
- Implement trading models hyperparameters optimization pipelines.

**Hard Requirements:**
- 3+ years experience with Python.
- Good understanding of analytics, data pipelines and data transformation principles.
- Proficiency with Pandas and NumPy.
- Hands-on experience with Apache Spark, AWS EMR.
- Proficiency with SQL and columnar databases (Clickhouse DB).
- Experience in Linux development (Bash, Cron, JQ).
- Hands-on experience with AWS.
- Experience with Apache Airflow.
- Hands-on experience working with big data.
- Good knowledge of statistics and computer science principles.
- Fluent English (At least Upper-Intermediate level).

**Soft Requirements:**
- Experience in financial field.
- Experience with Apache Kafka/Red Panda.
- Experience with Docker.