Position: Data Engineer
Company: Revelio Labs
Category: Data Engineer
Experience required: 3y
English level: fluent
Published: 2023-08-01T00:00:00+03:00

Who we are:

Revelio Labs provides workforce intelligence. We absorb and standardize hundreds of millions of public employment records to create the world’s first universal HR database, allowing us to see current workforce composition and trends of any company. Our customers include investors, corporate strategists, HR teams, and governments.

What we’re looking for:

Revelio Labs is looking for a data acquisition specialist who has proven expertise in data sourcing, web scraping, and data engineering. You will oversee and own the full lineage of data sources and feeds, from scraping and parsing to ingestion and model integration.

We are looking for someone who can design and implement web crawlers to source public data that will generate powerful insights on the labor market, integrate proprietary models to standardize and augment data sources, and increase the resiliency of existing data streams, as well as build a generalized framework to automate data acquisition, ingestion, and augmentation.

Experience and Skills:

Required:

Strong knowledge of Python and TypeScript
Experience building large-scale, high-volume web scrapers
Experience with bot prevention services and reverse engineering web applications
Deep understanding of web technologies, frameworks, and network protocols (HTML, JavaScript, HTTP, etc)
Preferred:

Experience building and maintaining ETL/ELT pipelines
Experience with cloud monitoring and administration tools
Familiarity with big data processing tools (e.g. Spark)
Knowledge of data warehouse maintenance best practices, including data wrangling, model integration, anomaly detection, and documentation
Knowledge of common CI/CD practices, including continuous build/test/deploy automation


We need someone who is ready to learn fast and ready to join a young team. If that sounds like you, feel free to apply ;)