Position: Data Engineer
Company: Curation Zone
Category: Data Science
Experience required: 3y
English level: upper
Published: 2021-06-01T00:00:00+03:00

**Job Description - Data Engineer**

Curation Zone is a world leader in contextualising data about creative professionals. We're a mature start up, backed by decades of domain expertise. We enable high velocity talent discovery using our innovative ranking methodology, delivered in a SaaS platform for the creative industries.

We're looking for a Data Engineer to join our skilled team to help us evolve and grow our Data Science capabilities.

**What you'll do:**

Data ingestion: cleansing, deduplicating and structuring for downstream processing

Monitor and optimise our data processing pipeline

Help to bring analytical prototypes to production

Iteratively improve our Search and Recommendation Engines

Use industry typical development tools, git, CI/CD pipelines, linting etc 

Provide and receive peer code review

**What you'll need (tech - level; details):**

git - strong ; should be able to produce PRs with clean commit histories, should be able to do rebases and resolve merge conflicts, should have experience receiving and giving reviews on PRs

python - strong ; should have an understanding of algorithm memory & time complexity and big O notation

pandas - familiar ; should be comfortable interpreting and interacting with your team’s code

SQL - strong ; ideally with sqlalchemy/ORM experience

mongoDB - medium ;

docker - strong ; should be able to dockerise python applications

AWS/cloud platform usage - strong ; should be able to provision cloud infrastructure for dataops, i.e. storage buckets, Linux compute instances, serverless compute, distributed compute  Should have solid understanding of cloud IAM.

Airflow - medium ; provisionings and maintaining an Airflow deployment, writing DAGs

A distributed computation tech, either Spark or Dask - medium ; should be able to provision needed infrastructure, enable data science usage on the compute cluster

**What you can expect:**

A competitive compensation package which exceeds local agency work.

23 days of holiday plus national holidays

A remote-only working policy

40 hour work weeks, with core hours based in the UK timezone

Experienced management, low ambiguity and a collaborative, diverse team that's ready to welcome you on board

Please note: there is no visa sponsorship available for this role. No recruiters, please.

Reference ID: cz-03-de

Job Types: Full-time, Permanent