Position: Lead big data engineer for healthcare company
Company: Nixwood
Experience required: 5y
Category: Data Engineer
English level: upper
Published: 2022-09-01T00:00:00+03:00

Responsibilities
Develop, maintain & operate multiple pipelines processing omics (genomics/transcriptomics/proteomics) datasets for thousands of clinical samples - format conversion, unification, harmonization. Most data pipelines are developed and run on Palantir Foundry platform (Apache Spark-based)
Create technical designs for new or reworked data pipelines and integrations with downstream pipelines and products
Collaborate with other data engineering teams on best practices development
Support Product Owner in planning and estimating tasks using Scrum methodology
Mentor other developers in the team on technical and process topics

Requirements
5+ years of experience with Python (built-in libraries, Pandas)
Experience developing resource-intensive data pipelines with Apache Spark (preferably) or other Big Data framework
Technical leadership experience
Basic understanding of molecular biology (central dogma, genes, transcript, proteins)
Working knowledge of data formats used in clinical genomics (VCF at least)
1+ years of Leadership experience

Nice to have
Java development experience
Experience using R language
DevOps practices usage, experience operating production data pipelines or applications