Position: Data Engineer, ​Engineering Services
Company: DataArt
Experience required: 5y
Category: Data Science
English level: intermediate
Published: 2020-08-01T00:00:00+03:00

About the vacancy

Our client is an international oil and gas company, specializing in four market sectors: Onshore Engineering & Construction, Offshore Projects & Operations, Engineering & Consulting Service, Integrated Energy Services.

DataArt team works on a number of projects. One of them is building a brand new Data Analytics and Visualization platform for the client’s TOP management team. We are gathering data from 3000+ sources, consolidate, visualize, and build predictions based on the data.

Another project involves automating the helpdesk system operations (where requests and complaints are processed) using machine learning.

Must have
- 7+ years of experience with ELT, ETL, SQL, data processing, database programming, NoSQL databases like MongoDB, Cassandra, HBase, or data analytics
- Experience with programming languages: Pig, SCALA, HIVE, Python, R
- Experience with Big Data Ingestion, Transformation and stream/batch processing technologies using Apache NiFi, Apache Kafka, Kafka Connect (Confluent), Sqoop, Spark, Storm, etc.
- Proven working experience in pulling data through REST API, OData, XML, Web services.
- Experience with Azure product offerings and data platforms.
- Experience in data modeling (data marts, snowflake/star, normalization, SCD2).
- Extensive hands-on knowledge in data mining and statistical analysis
- Understanding of various data structures and common methods used in data transformation
- Strong knowledge of ETL concepts and the ability to work with ETL tools
- Data management skills: modeling, normalization, cleaning, and maintenance
- Understand data architectures, data warehousing principles, ability to participate in the design and development of conventional data warehouse solutions
- Focus on delivering results
- Project management skills, ability to balance multiple priorities without losing momentum
- Business partnership skills

Would be a plus
- Azure Data Factory
- Oracle DB, Oracle E-Business Suite, Oracle Fusion

Learn more about our policy of equal opportunities in employment