Position: Senior Data Engineer
Company: TrueRank
Category: Data Engineer
Experience required: 5y
English level: fluent
Published: 2023-07-01T00:00:00+03:00

Data Engineering: 3+ years in companies with 50+ people focusing on building data infrastructure, data modeling and data pipelines

Recent experience required:
Experience with Python and Pandas (2 years+ of active development)
Experience with PySpark at least 1 year
Experience with AWS (Redshift, EMR, RDS, S3)
Experience with Kafka
Experience using any of big data databases (Athena, BigTable, Redshift, DataBricks)
Experience with Airflow DAGs

Previous experience, ONE of the following:
DBA: 2+ years (Working with production grade databases such as Postgres, MSSQL, MySQL, Oracle)
DevOps: 2+ years (AWS/GCP with terraform/terragrunt experience or similar)

You will be our second Data Engineer, setting up our infrastructure from the ground up, using Medallion approach to data processing, establishing data distribution solutions (Kafka/Debezium), populating consumer databases such as ElasticSearch and Postgres from source of truth (Gold S3 Parquet buckets).

You don't have to have a Master's degree or have the ability to invert a binary tree, we expect you to figure out how to model our multiple sources of data, enrich it and distribute to other consumer databases, how to sync all of that into ElasticSearch, how to do incremental updates, how to transform and validate massive amounts of data, how to map it, how to score our profiles using in-house algorithm, etc, etc...
This is the fun part. :)

We're:
- Building truly innovative HRTech solution for companies, schools and candidates.
- Working with all modern tools and technologies.
- Moving fast and trying new ideas constantly.
- Greenfield project. 
- Big data. A lot.