Position: Data Engineer (Python)
Company: Storypoint
Category: Python
Experience required: 3y
English level: upper
Published: 2021-10-01T00:00:00+03:00

Responsibilities:
- Building a scalable infrastructure for streaming, storing and processing billions of data points;
- Solving problems in a scalable and efficient way;
- Taking full ownership on building data products from design to implementation and deployment;
- Uptime and maintenance of a high-scale live data pipeline;
- Cost reduction and optimization of compute resources.

In terms of immediate data science needs we have the following:
- Operations Data Flows into Operations Vision Tool (Elastic Search):
    1.We alert on simple rules now like ‘no license plate reads in 1 hour == alert’ we would like to move to a more advanced system that could identify anomalies only (aka it’s ok to read no plates at 2 am, but not at 2 pm) (Elastic Search & PostgreSQL);
- Production Data Flows into Rekor One:
    1.Need to 100x scalability without impacting response time (postreSQL);
    1. Data science projects to understand congestion detection & abnormal congestion detection;
- Production Data Flows into Scout:
   1. Need to 100x scalability without impacting response time (MySQL, Redis).

Requirements:
- 3+ years experience writing and maintaining ETL processes or with server-side development at scale;
- English Upper-Intermediate;
- Experience with AWS or other cloud providers, including experience in handling development operations and deployments on high-scale live systems;
- Excellent Python programming skills;
- Excellent SQL and data mining skills;
- Focus on quality and simplicity.