Position: Databricks Developer
Company: EPAM
Experience required: 3y
Category: Data Engineer
English level: intermediate
Published: 2023-05-01T00:00:00+03:00

Description

Responsibilities:
Design, develop, monitor, and operate data pipelines 
Business Metrics initiative
Integrate high-quality datasets for analytical use-cases
Enable other data teams to follow the standards
Testing (preparation and execution)
Maintenance of existing data pipelines incl. alerting, bug fixing, etc.

Skillset - technical:
Mandatory:
3+ years of hands-on experience in Databricks or similar ETL Tools
Apache Spark, PySpark, and Python
AWS Glue + Amazon S3
GitHub + CI/CD

Nice to have:
Advanced Databricks skills like delta, cluster configuration or mlflow
Experience with integrating sources like Websites, Exasol, REST APIs, SAP, BigQuery, GSheets, and more
Data Quality
Apache NiFi
MicroStrategy
Java