Position: Senior Data Engineer
Company: SoftServe
Experience required: 3y
Category: Data Engineer
English level: intermediate
Published: 2021-12-01T00:00:00+02:00

Our project, now part of Multinational Technology Corporation, is revolutionizing cyber risk with a SaaS-based platform that uses data science to combine vulnerability data with exploit intelligence to measure risk, predict attacks and prioritize remediation. We are leading the way in helping enterprises reduce their risk while increasing their efficiency and preventing attacks. The Project was recently named one of the top 10 hottest start-ups and named to the Inc. 500 fastest-growing companies list.
About Us
There are a lot of security companies out there, but no one is doing what Our Project is doing: giving our customers the ability to measure their risk landscape and truly protect their environments from the ever-present threat of a breach. As a result, we’re seeing outstanding growth as some of the top companies in the world flock to our platform
About You
We’re looking for a Senior Data Pipeline Engineer who enjoys crafting and maintaining production-critical pipelines with an eye towards testing, security, performance, and scalability. If you’re comfortable in working within a highly autonomous, agile, and iterative software development process; Our Project may be a phenomenal fit for you! This position is an opportunity to join a growing engineering team passionate about elevating and evolving the data practice within the organization while having a direct impact on Our Project’s ability to deliver data intelligence to customers. Engineers are encouraged to take ownership of technical problems, craft solutions to sophisticated problems, and craft code that meets our internal standards for maintainability. Our applications are widely used across the industry and your work will be used by millions of people every month.
What are some of the exciting problems you'll be working on:
•	Design and implement pipelines to ingest, analyze, and distribute that data for analysis and operational use
•	Implement and maintain scalable and flexible pipelines to integrate with a wide range of external data providers
•	Work closely with data architects to implement a data platform that increases the speed to market of data insights
•	Build and support a highly available and reliable data platform
•	Develop and deploy monitoring, logging, and alerting strategies to ensure the availability and performance of pipelines
•	Advocate and educate engineering team members on data modeling rules, standards, and best practices.
•	Research, Prototype, Test, Implement new technologies
What does it take to work with us:
•	BS in CS, CE or related field preferred OR equivalent experience
•	Experience with Cloud Composer and Dataflow or their open-source versions
•	Experience performing root cause analysis on internal and external data and processes to answer specific business questions and find opportunities for improvement.
•	Confirmed experience building data pipelines for integration into analytics and operational use cases 
•	Demonstrated ability with Python 
•	You ensure quality of the software delivered through unit testing, continuous integration, and integration testing
•	You have experiencing using tools like Terraform to handle resource requirements and configuration
•	You have built and maintained software to support production critical workloads
•	Experience using a broad range of data stores including BigQuery, ElasticSearch, MySQL, and parquet files
•	Experience working with application development teams to integrate data offerings into customer facing applications
•	You can clearly communicate and document implementation approaches and incorporate feedback from team leadership and peers
•	You are at home working with a team of engineers to build, release, and test software