Position: Senior Big Data Engineer
Company: Svitla Systems, Inc.
Category: Python
Experience required: 5y
English level: upper
Published: 2021-05-01T00:00:00+03:00

**Requirements:**
Master’s Degree or Ph.D. in Computer Science, Engineering, Information Technology (IT) or related field;
Experience and desire to work in a fast-paced, collaborative, global delivery environment;
7 years experience as a big data engineer at a data-driven, enterprise-grade technology working with large amounts of data in a continuously scaling environment;
Deep expertise in cloud-based platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud (GC);
Deep understanding of big data technologies and big data security models;
Prior software development experience with data-driven product companies using Spark, SQL, Python, Scala, or advanced analytical tools is a plus;
Experience with the data collection process and evaluation methods for Machine Learning;
Proficient in designing efficient and robust ETL/ELT workflows, schedulers, and event-based triggers;
Database experience, including knowledge of storage internals of SQL and NoSQL services;
Experience with development methodologies like CI/CD, Agile, Git, Jenkins, etc.;
Performance Tuning & experience with building scalable Data platforms;
Experience writing technical specifications and design sketches from both a business and technology standpoint;
Ability to break down large requests into sub-tasks and provide higher-level status updates;
Values the “team” and leverages the opinions and expertise of their teammates to deliver quality and the ability to influence cross-functional teams without formal authority;
Experience using OKRs to drive outcomes;
Excellent written and verbal communication skills. 

**Responsibilities:**
You will be involved in designing, building, and deploying massively scalable, automated data ingestion and processing pipelines to store, analyze and derive insight from structured/unstructured data arriving from our clients and internal systems in multiple cloud environments;
You are expected to drive technology discussions and analyze the current landscape for gaps in addressing data, platform, and business needs;
Review existing architecture and capabilities from a technical perspective and challenge the status quo to provide thought leadership/best practices to enhance our instance strategy, technical governance, core data, integrations, and the overall technical health of our data and machine learning pipelines frameworks;
Interface with the customers and across the org in structuring and implementing solutions while demonstrating the ability to become a trusted advisor to clients, senior executives, and internal data science, product, and engineering teams;
Develop CI/CD processes for the Engineering and Data Science groups;
Develop QA/QC suites to process, cleanse, and verify the integrity of incoming data, including data anomaly detection;
Undertake project specific proof of concepts activities to validate technical feasibility;
Discuss with onshore/offshore teams on tasks to be done, and mentor junior members of the team;
Perform design & code reviews for team members and develop test plans;
Assist DevOps in configuring, operating, and maintaining our infrastructure environment. 

**We Offer:**
Competitive compensation plan that takes skills and experience into consideration.
Annual performance appraisals.
Possibility to choose your workspace either remote or combination of your home and one of our development offices. 
Flexible working hours and adjustable work/life balance.
Projects that use advanced, cutting-edge technologies.
Competitive bonuses for a personal recommendation of new employees.
Vacation time, sick-leaves, national holidays, family supplementary days off.
Comprehensive medical insurance including dental services, massages, and sports activities.
Support for a healthy lifestyle, compensation of running events.
Maternity leave policy.
A personal loan budget is available for long-term personnel.
Partial compensation of conferences, courses, and English classes.
Free meetups, webinars, and conferences organized by Svitla.
Birthday presents for personnel and New Year gifts for children.
Fun summer and winter corporate parties and memorable anniversary presents.