Position: Senior Data Engineer
Company: SoftServe
Experience required: 3y
Category: Data Engineer
English level: upper
Published: 2021-12-01T00:00:00+02:00

Our Client is revolutionizing cyber risk with a SaaS-based platform that uses data science to combine vulnerability data with exploit intelligence to measure risk, predict attacks and prioritize remediation. We are leading the way in helping enterprises reduce their risk while increasing their efficiency and preventing attacks. 

About Us
We`re giving our customers the ability to measure their risk landscape and truly protect their environments from the ever-present threat of a breach. As a result, we’re seeing outstanding growth as some of the top companies in the world flock to our platform

About You
We’re looking for a Senior Data Pipeline Engineer who enjoys crafting and maintaining production-critical pipelines with an eye towards testing, security, performance, and scalability. If you’re comfortable in working within a highly autonomous, agile, and iterative software development process; Kenna may be a phenomenal fit for you! This position is an opportunity to join a growing engineering team passionate about elevating and evolving the data practice within the organization while having a direct impact on Kenna’s ability to deliver data intelligence to customers. Engineers are encouraged to take ownership of technical problems, craft solutions to sophisticated problems, and craft code that meets our internal standards for maintainability. Our applications are widely used across the industry and your work will be used by millions of people every month.

Requirements
Must have:
• Python (Intermediate level should be enough. They are not planning to write complex logic, mostly DAGs, potentially new Operators.)
• Apache Airflow (Good understanding on how Airflow works under the hood)
• Docker
• Kubernetes (Basic experience should be enough as they are using managed cluster (GKE). However deep understanding would be a big plus)
• GCP
Nice to have:
• GCP GKE
• GCP CloudComposer (In case if there’s a good knowledge of Apache Airflow and some GKE experience, CloudComposer can be learned later)
• Java experience is a plus
Responsibilities:
• Support and modernize Airflow cluster
• Write Airflow DAGs and support other engineers
• Monitor Apache AIrflow environment
What does it take to work at:
•	BS in CS, CE or related field preferred OR equivalent experience
•	Experience with Cloud Composer and Dataflow or their open-source versions
•	Experience performing root cause analysis on internal and external data and processes to answer specific business questions and find opportunities for improvement.
•	Confirmed experience building data pipelines for integration into analytics and operational use cases 
•	Demonstrated ability with Python
•	You ensure quality of the software delivered through unit testing, continuous integration, and integration testing
•	You have experiencing using tools like Terraform to handle resource requirements and configuration
•	You have built and maintained software to support production critical workloads
•	Experience using a broad range of data stores including BigQuery, ElasticSearch, MySQL, and parquet files
•	Experience working with application development teams to integrate data offerings into customer facing applications
•	You can clearly communicate and document implementation approaches and incorporate feedback from team leadership and peers
•	You are at home working with a team of engineers to build, release, and test software