Position: Senior Python developer
Company: CMP
Experience required: 5y
Category: Python
English level: intermediate
Published: 2023-03-01T00:00:00+02:00

CMP is seeking for Python ETL developer for project-based with possibility to convert into full time 
The product is a system for mass processing of job offers data.
At this specific point from the US only, and with nearest plans to expand to the UK, CA, AU. 
This platform is ingesting millions of job offers and exporting them to partners; proper scalability and
performance needs to be developed and maintained.
As far as the company is looking to grow further, we would like to make a stronger team with
you for updating code and architecture.
We’re expecting the successful candidate to have the following skills and experience:
● parallelizing processes;
● implementing horizontal scaling; monitoring and failure protection of the ETL
systems;
● ETL performance analysis and improvement;
TECHNOLOGIES
Main tools: NodeJS for APIs; Python v3, GCP (Google Cloud Platform), Dataflow, Composer;
Database: Cloud SQL (MySQL)
Various supportive technologies: Redis (GCP MemoryStore), PubSub, ElasticSearch for search
etc.
Legacy code created using PHP
WHAT WILL YOU DO
● Major requirement is to get high processing performance of the ETL subsystem while
maintaining average costs of the infrastructure;
● Updating code and architecture to support the processing of significantly more data;
● Adding new features to existing code, creating new subsystems based on the project
development plan;
● Being responsible for the stability and performance of the subsystems developed;