Position: Senior Big Data Engineer (Healthcare)
Company: Sigma Software
Category: Data Engineer
Experience required: 3y
English level: intermediate
Published: 2022-02-01T00:00:00+02:00

**CUSTOMER**
We are cooperating with an American healthcare startup, and together with their team, we work with a lot of data. This project is an ideal perspective for those who don’t like working in a bureaucratic environment. You will have minimum meetings that will help you create effective and prompt solutions to all emerging issues.

The customer is open to new ideas and proposals.

**PROJECT**
You will be a part of a Data Engineering Team, developing the core of a cloud-based data platform. Data Engineers are responsible for the project data flows development, building dynamically configurable ingestion pipelines, new features and architecture development, etc.

**REQUIREMENTS:**
- Solid development experience with Java or Python
- Experience with Airflow
- Experience designing Data Lakes
- Experience designing Data Warehouses
- Experience with NoSQL and RDBMS technologies
- Data processing frameworks: Kafka Streams, Storm, Spark, Flink, etc.
- Hadoop Ecosystem: YARN, HDFS, Pig, Hive, etc.
- ETL, data parsing, have an experience of working with different data types (Excel, EDI, CSV, etc.)
- Understanding of distributed computing, microservices, and Lambda
- Architecture principles
- Cloud platforms: AWS, Azure, or Google Cloud
- Experience with building and maintaining continuous integration/delivery pipelines

**WOULD BE A PLUS:**
- Experience with serverless solutions (AWS Lambda, Azure Function App)
- Experience with infrastructure-as-code solutions (Terraform, Cloudformation)
- Experience with Snowflake
- Designing and implementing CI/CD practices

**RESPONSIBILITIES:**
- Develop and support a hybrid cloud ingestion platform that collects data from different sources based on dynamic configuration
- Design Data Warehouse structures and relations using Snowflake
- Apply Data Governance practices to meet regulatory requirements for data security and data quality