Position: Senior BigData Software Engineer
Company: N-iX
Experience required: 3y
Category: Python
English level: upper
Published: 2021-01-01T00:00:00+02:00

Responsibilities:
Development of Campaign management tool
Bring in new data sources and transform and load into Data Lake
Develop (Spark) streaming applications for supporting real time data processing
Develop and support end-to-end data solutions for structured and unstructured data including, but not limited to, ingestion, parsing, integration, auditing, logging, aggregation, normalization, and error handling
Create jobs and queries to perform auditing and error handling
 
Requirements:
3+ years of software development experience
Experience with Python
Experience with SQL
Understanding of Spark ecosystem
Apache Spark including an understanding of optimization techniques
Work experience with Kafka
Azure Event hubs, Azure Data Lake Gen2
Experience with Linux
Good understanding of iterative software development methodologies
Being result-oriented, ability to make things done
Good communication skills in English (verbally and written)