Position: Data Engineer
Company: Code Space
Experience required: 2y
Category: Data Science
English level: intermediate
Published: 2022-01-01T00:00:00+02:00

Responsibilities

- Take part in building new Data Platform
- Design and develop Data Pipeline processes for the Data Architecture lifecycle
- Collaborate and work alongside with Data Architects, Data Engineer, Data Analysts and other teammates
- Troubleshoot data issues and performance tuning of Spark jobs
- Maintain and support existing report and data products
- Be up to date on various data processing, storage, analysis and reporting tools, their possibilities and limitations

 Requirements

- Good knowledge of Python or\and Scala
- Good knowledge of SQL
- Good understanding and experience with Apache Spark (or Databricks/AWS Glue/AWS EMR)
- Strong Experience with ETL and Data Pipelines
- Experience and knowledge of Data Lakes and DWH concepts
- Good working knowledge of AWS (S3, Glue, Athena)