Position: Senior or Strong Middle Data Engineer
Company: Intellias
Experience required: 3y
Category: Data Science
English level: upper
Published: 2020-11-01T00:00:00+02:00

This platform will dramatically change SCF (Supply Chain Financing) processes, providing completely new financing possibilities on the b2b market. Within 6 years, our client managed to create a product that meets high standards of international financial industry, and to acquire and integrate several international corporate clients like Lufthansa, Nestle, Vattenfall and Daimler.

One of the project cornerstones is the effective use of data. Use cases range across a wide spectrum including business intelligence, process automation, recommendation engines and risk scoring. Help us build the data infrastructure today that we need to deliver the data products of tomorrow. You will be working closely with different domains to figure out ways to aquire new customers, scale existing programs and optimize user experience – all through data. As the data expert, you will build a strong relationship with internal and external stakeholders and you are required to deeply understand our current and future challenges. As part of a fast paced tech start-up, you are exepected to gain hands-on experience with advanced open source data technologies, and actively drive the data culture

You role:
- Collaborate with other teams in the business domain to design data models and data processing logic which translate operational data to valuable business information.
- Build and maintain scalable low-latency data warehouse using batch ETL and stream-processing technologies.
- Collaborate in the development of applications for the purposes of reporting, business intelligence and data analytics product.

Requirements:
- Strong SQL experience (ad hoc queries, optimization techniques, preferably PostgreSQL);
- Python
- ETL/microservices,
- data processing & visualization (pandas; matplotlib / hvPlot / plotly; jupyter / jupyterhub),
- basic web development (Django / Flask / Falcon; SQLAlchemy)
- ETL experience / Data Warehouse concepts
- Schema Architecture (e.g. Flat-file / Star / Snowflake)
- Processing Paradigm ( Batch / mini-batch / streaming / change data capture / lambda / kappa)
- orchestration: Airflow / Prefect / Luigi / Jenkins
- storage infrastructure for scalable OLAP processing: Postgres / Amazon Redshift
- Experience with any batch processing technology: SQL / Talend / Elastic / Spark / Custom Built
- Experience with any streaming processing technology: Kafka / Spark Streaming / Storm / Flink
- Basic experience with Business Intelligence Visualization Tool (e.g. PowerBI, Tableau )
- Good conceptual knowledge on streaming processing (Eventual consistency, duplication handling, data latency, water mark, stateless stream)
- Good knowledge of Docker
 
Nice to have:
- AWS infrastructure
- Kubernetes
- CI/CD knowledge
- Basic Java