Position: Middle Big Data Developer
Company: Sigma Software
Experience required: 3y
Category: Python
English level: upper
Published: 2020-12-01T00:00:00+02:00

This position is a perfect match for an enthusiastic Big Data Engineer who would like to develop a Data Processing platform.
	
As a Big Data Engineer, you will design and develop a robust and scalable solution for data versioning and distribution, orchestration of data merge & conflict handling processes, as well as for providing Data Dashboards and analytical reports to end-users.

You are going to be a part of the distributed team that use agile methodologies best practices, Continuous Integration, performance testing, capacity planning, and documentation. 

Responsibilities
Building up an infrastructure for data distribution platform with the level of customization and scalability that allows applying quick changes and creating Proof-of-Concept prototypes 
Designing and developing data pipelines
Creating and customizing ETL scripts with AWS serverless technologies and frameworks
Living by agile principles and collaborating with team members using agile techniques

Requirements 
At least 3 years of experience in Python development
Experience with Apache Spark at least 2 years
At least 1 year experience of Kafka
Good knowledge of designing DBs
Good experience with AWS Serverless (Glue, Lambda, Step Functions, S3, SNS/SQS)
Result-oriented standpoint
Ability to perform in self-manageable manner within set time-boxing
At least Intermediate level of English