Position: Lead/Senior Big Data Engineer
Company: Storypoint
Experience required: 5y
Category: Python
English level: upper
Published: 2021-06-01T00:00:00+03:00

Requirenments:

• 5+ years experience Data Engineer
• 3+ years experience with AWS
• good knowledge of Data Lake та Distributed Data Mesh
• excelent knowledge of Python
• excelent knowledge of SQL (PostgreSQL)
• experience with Kafka
• experienced in Amazon S3, Amazon Redshift, Amazon Athena
• knowledge of format Apache Parquet
• working with Git & Gitflow Workflow

Good to have:


• Flask
• AWS Lambda
• Amazon Glue (Crawler, Data Catalog)
• Apache Hive та Apache Presto
• Machine Learning
• Kubeflow

What to do:

• code proof of concept
• implement Big Data platform to cloud
• optimization Big Data platform
• close work with Solutions Architect and CTO
• new functionality