Position: Senior Data Engineer
Company: TEAM International
Experience required: 3y
Category: Scala
English level: intermediate
Published: 2022-02-01T00:00:00+02:00

Data is at the heart of all the product offerings and core to our business model. Products such as Account Intelligence, Intent, and Engagement utilize our unique data to drive the B2B marketing & sales solutions that are central to the ABM model.

Our team is a group of highly motivated & talented individuals with expertise in machine learning, internet domain, ad tech analytics, and NLP along with a deep passion to innovate and provide top-notch customer experience.

**Responsibilities:**

Perform software design and development with Scala (Python as a plus)
Design and build data pipelines using Scala with Spark
Writing shell scripts to automate processes
Write advanced SQL queries for data extracts and validation
Write DAGs in Airflow for orchestration and monitoring of data pipelines
Apply experience with cloud storage and computing for data pipelines in GCP (GCS, Dataproc) and AWS (S3, EMR)
Work with database systems like BigQuery, Snowflake, Clickhouse, Postgres
Write clear documentation to convey plans and technical architecture
Ensure all new and modified code and pipelines are tested and of the highest quality at delivery time
Establish high reliability of all maintained product offerings by building monitoring mechanisms into our infrastructure.

**Requirements**

Development experience in Scala (Python as a plus)
Experience in Design and building data pipelines using Scala with Spark
Skills in writing SQL queries for data extracts and validation
Any experience building REST APIs in Scala (Play specifically) would be a plus
Spoken English.

**Benefits**

Remote or office work according to your preferences
Competitive salary based on your experience level
Free English classes
23+ working days of 100% paid vacation and sick days
Sports reimbursement program
Medical insurance health plan
Modern and comfortable office facilities near the city center.