Position: Data Engineer (Azure)
Company: roket.us
Category: Data Engineer
Experience required: 3y
English level: intermediate
Published: 2023-02-01T00:00:00+02:00

Requirements:
- 3+ years of Data Engineer practical experience;
- Practical experience with Azure Databricks/Data Factory;
- Practical experience with Spark (Python/PySpark or Scala);
- Experience with cloud providers services (Azure, Amazon is a plus);

Duties:
- Data sources integration, handle ETL workloads (structured and semi-structured data payloads);
- Ensure that jobs are scheduled and run within the pipeline (25+ jobs);
- Create and support dashboards and one-off queries (Tableau or PowerBI);
Responsibilities Include
- Taking customer data and processing it via Python and Spark in a Databricks environment using SQL in combination;
- Creating and Maintaining Azure Data Factory pipelines to ingest data and run Databricks;
- Daily maintenance of Databricks providing fixes when necessary;
- Researching various questions from internal teams as well as for customers when applicable;
- Working with Data Analysts to answer data questions and offload repeatable processes;
- Validating data processes and results;
- Performance tuning of data processing and access;
- Creating dashboards & alerts for internal process and data monitoring;
- Ensure all code is under Source Control and develop CI/CD and automation processes;
- Manages Azure cloud environment from DevOps and cost perspective;
- Experience building API to support exposure of warehouse data to internal and external consumers;


We offer:
- remote opportunity.
- Compensate for 10 sick leave and 18 work vacation days.
- Flexible schedule.
- Compensation for the purchase of equipment.
- Compensation for trainings and certificates.

The probationary period is 3 months.

I will be glad to tell you in more detail if the vacancy interested you :)