Position: Senior Data Engineer
Company: Opinov8
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-05-01T00:00:00+03:00

Your primary role will be to assist in the on-going development and evolution of the existing Client Platform ETL pipeline.

The pipeline can be thought of as follows:
Extract sales data from a central Database (Oracle)
Transform it into the required domain data structures for Client Platform
Load the transformed data into a suitable database for consumption (currently Postgres)

**BEING PART OF THE TEAM**

• Investigation and delivery of data to support new feature requirements
• Ensuring data parity & quality between the source and destination data
• Continual improvements to the codebase - the team will be regularly reviewing the codebase, identifying areas for improvement, planning and implementing appropriate changes
• Ad-hoc support with regards to data queries from stakeholders

**POWER YOU BRING**

• 5+ years of software development experience
• Strong SQL experience (PostgreSQL/Oracle)
• Strong software development experience in at least one of the following languages: Python/Java/.NET
• Experience working in any Cloud environment e.g. GCP/AWS/Azure
• Gravitate towards well tested code i.e. TDD / BDD
• Good communication and collaboration skills
• Good problem-solving skills
• Experience working within linux/unix based systems

Will be a plus:
• Working in an AGILE environment i.e. Scrum, Kanban
• Experience with Docker, Kubernetes
• Experience with orchestrators e.g. Cloud Composer, Airflow, Argo
• Knowledge of containers e.g. Docker, Kubernetes & Helm
• Experience working with Bash
• Experience working on CI/CD pipelines
• Experience of event driven architectures
• Experience of batch/stream data processing
• Experience of NoSQL databases