Position: Senior/Middle Big Data Engineer
Company: Intellias
Category: Scala
Experience required: 2y
English level: upper
Published: 2021-01-01T00:00:00+02:00

Their customers are big enterprises in Benilux region in Telecom, eCommerce, Energy and other industries.
Responsibilities:
• Developing data pipelines and data-marts on Spark and Scala;
• Creating new high-load data processing services;
• Architect, design, code and maintain components for aggregating billions of DB records;
• Managing the cloud-based data & analytics platform;
• Deploying updates and fixes and assist technical support;
• Working directly with the business teams to rapidly prototype analytics solutions based upon business requirements;
• Gathering, analysis and documentation of requirements for data processing and reporting;
• Exploration and validation of data from various sources, generation of new reports based on investigated data;
• System and process analysis;
• Development of reports and dashboards;
• Monitoring of analytics results, identification and understanding of trends and anomalies;
• In-Depth Data analysis and generation of new reports based on investigated data;
• Operational monitoring of key metrics and determining the causes of deviations from the expected values.
Requirements:

Requirements:
• At least 2 years of experience in Data Engineers using Spark/Scala;
• Proficiency in SQL;
• Hands-on experience with Scala/Java;
• Working experience with AWS Cloud;
• Understanding the principles of Massive Parallel Processing;
• BI tools knowledge;
• Understanding of data modeling and data warehousing concepts;
• Excellent communication and interpersonal skills.

Nice to have:
• ETL development background;
• Good knowledge of SQL;
• Experience with BI tools;
• Understanding of data modeling and data warehousing concepts;
• Column-based data warehouse: Amazon Redshift / Snowflake / Google BigTable / Teradata / CosmosDB;
• Process orchestration software: Apache Airflow / Prefect / Dagster;
• Serverless computation frameworks.