Position: Data Engineer (Python)
Company: Data Science UA
Category: Data Science
Experience: 3y
English level: fluent

Наш партнер шукає Дана Інженера (3+ роки) з досвідом роботи з Python, Apache Spark, AWS EMR and SQL, а також написання ETL.
Якщо це про вас, поділіться з нами вашим резюме ;)

Every day our algorithms process more than 500 million data points. As a result, low latency and fault tolerance are essential for us.
As a part of our team Data Engineer will be responsible for preprocessing, cleaning and storing financial data sets: market data, fundamentals and alternative data sets. The role also includes writing complex ETL and optimization pipelines using multiprocessing and distributed computing frameworks (DataBricks, AWS EMR, Apache Spark).

Responsibilities:
- Processing and storing high-volume financial datasets.
- Creating ETL pipelines using AWS/internal tools.
- Preprocessing data for our research and development team.
- Be part of the team responsible for real-time trading implementation.
- Implement trading models hyperparameters optimization pipelines.

Hard Requirements:
- 3+ years experience with Python.
- Good understanding of analytics, data pipelines and data transformation principles.
- Proficiency with Pandas and NumPy.
- Hands-on experience with Apache Spark, AWS EMR.
- Proficiency with SQL and columnar databases (Clickhouse DB).
- Experience in Linux development (Bash, Cron, JQ).
- Hands-on experience with AWS.
- Experience with Apache Airflow.
- Hands-on experience working with big data.
- Good knowledge of statistics and computer science principles.
- Fluent English (At least Upper-Intermediate level).

Soft Requirements:
- Experience in financial field.
- Experience with Apache Kafka/Red Panda.
- Experience with Docker.