Position: Data Engineer
Company: Unicsoft
Experience required: 3y
Category: SQL
English level: upper
Published: 2021-11-01T00:00:00+02:00

The client is a proud subsidiary of Vitol, the world’s biggest independent oil trader with 40 offices worldwide. For the last half-century, Vitol has served the world’s energy markets efficiently and responsibly, now trading over seven million barrels of crude oil a day, and delivering energy products on a global scale.  
Leveraging this credibility, considerable expertise, and infrastructure in the world of oil is making a move into the used car marketplace. 

Merging the tech and auto worlds Client is building the first of its kind start-up offering in the world. 
To deliver this vision, we have already brought on board some of the best in their field from around the world and now we are on the hunt to find the brightest and the best to scale and grow our teams.

Responsibilities:

- Responsible for the building, deployment, and maintenance of mission-critical analytics solutions that process data quickly at big data scales
- Contributes to design, code, configurations, and documentation for components that manage data ingestion, real-time streaming, batch processing, data extraction, transformation, and loading across multiple data storages.
- Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed.
- Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members
- Interacts with engineering teams to create professional data-oriented solutions and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability.
- Analyze and tune the performance of the running DB code 
- Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions.
- Be a strong advocate for great engineering practices, being pragmatic when balancing best practice against delivery, all the time managing technical debt effectively.
- Collaborate with the team to set up BI and ETL process. 
- Contribute to CoE activities and community building, participate in conferences, provide excellence in exercise and best practices.

Requirements (Hard skills requirements):

- Good professional experience as a data/database developer
- More than 2 years of participation in production deployments of large server data processing and analysis systems as a team leader
- Knowledge of Azure ML services
- Over 1 year of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL, and NoSQL data-warehouses such as Hbase and Cassandra.
- Knowledge of SQL databases and NoSQL data warehouses
- Knowledge of professional software development best practices for complete software
- Knowledge of data warehouses, design, implementation, and optimization
- Knowledge of data quality testing, automation, and visualization of results
- Knowledge of the development life cycle, including coding standards, code reviews, source code management, build processes, testing, and operations.
- Experience of participating in an Agile software development group, such as SCRUM
- Experience in designing, documenting, and protecting projects of key components in large distributed computing systems.

Upper-Intermediate or Advanced English