Position: Senior Data Engineer (Python)
Company: Intellias
Experience required: 3y
Category: Python
English level: intermediate
Published: 2021-09-01T00:00:00+03:00

Project Overview:

Our client is a company whose technology is propelling the evolution from traditional license plate recognition systems and traffic monitoring to AI-enabled smart roadways capable of serving multiple missions from a single source.

Responsibilities:
- Building a scalable infrastructure for streaming, storing and processing billions of data points;
- Solving problems in a scalable and efficient way;
- Taking full ownership on building data products from design to implementation and deployment;
- Uptime and maintenance of a high-scale live data pipeline;
- Cost reduction and optimization of compute resources.

In terms of immediate data science needs we have the following:
- Operations Data Flows into Operations Vision Tool (Elastic Search):
- we alert on simple rules now like ‘no license plate reads in 1 hour == alert’ we would like to move to a more advanced system that could identify anomalies only (aka it’s ok to read no plates at 2 am, but not at 2 pm) (Elastic Search & PostgreSQL).
- Production Data Flows into Rekor One:
- Need to 100x scalability without impacting response time (postreSQL);
- Data science projects to understand congestion detection & abnormal congestion detection.
- Production Data Flows into Scout:
- Need to 100x scalability without impacting response time (MySQL, Redis).

Requirements:
- 4+ years experience writing and maintaining ETL processes or with server-side development at scale;
- English Upper-Intermediate;
- Experience with AWS or other cloud providers, including experience in handling development operations and deployments on high-scale live systems;
- Excellent Python programming skills;
- Excellent SQL and data mining skills;
- Focus on quality and simplicity.