Position: Data Engineer
Company: AboutHR
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-09-01T00:00:00+03:00

This is an innovative position, bridging the gap between the business unit research activities and the central data engineering team. You will work with a vast array of big and small datasets, from weather forecasts to satellite images, from macroeconomic news feed to market data, from public data to highly sensitive, proprietary information.

**Required Skills and Experience:**
-	5 years’ experience in the technology field, as a software or data engineer
-	+3 years’ experience in data manipulation: DB design, data modelling, data transformation pipelines, ETL, data management
-	+2 years’ experience with a data-oriented programming language, preferably Python, including data manipulation and visualization packages (e.g. Pandas, Numpy, Plotly…).
-	Experience in building reusable tools and packages
-	Strong proficiency in SQL. Database or other types of data storage design. Performance optimisation for big, complex data sets. Hands on experience with data storage solutions and their application (SQL, noSQL, data lakes).
-	Data mining principles: data collection, wrangling and quality checks using multiple data systems, both on premises and cloud-based
-	Experience with collaborative software development best practices: source control strategies (git), peer reviews


**It will be a plus:**
o	Visualization tools (PowerBI, Dash apps, other dashboard creation solutions) 
o	Handling big datasets (e.g. geospatial data), exposure to big data techniques like Spark 
o	Agile development and DevOps tools: CI / CD pipelines, testing and monitoring best practices. 
o	Support for business-critical data transformation and applications via monitoring and alerting, and contributing to the solution of critical incidents under time pressure