Position: Data Engineer
Company: Madiff
Category: Data Engineer
Experience required: 3y
English level: upper
Published: 2023-09-01T00:00:00+03:00

Company:  - is a globally recognized IT consulting firm, renowned for its focus on digital product development and engineering consulting (Locations Poland, Portugal, France, UK, Ukraine)

We pride ourselves on creating applications and systems for an impressive roster of top500 companies around the world, spanning diverse sectors such as banking, payments, insurance, telecommunications, FMCG, automotive, travel, logistics, pharmaceutical, military and defence, along with the European Commission.

Project: Responsible for development, design, maintenance of new and existing databases, data streaming solutions and data processing pipelines. Creates stable and reliable systems and management methods to efficiently access information stored in databases. Works as a consultant for other members in the company to improve processes and deliver efficient access to data. Creates data ingestion jobs as well as prepares data layer for analytical purposes.

Location: Warsaw

Years of experience: 4+

Type of work: Hybrid



Responsibilities: 

· Design stable, reliable and effective databases, data processing pipelines and data streaming solutions.

· Performance tuning, optimization and maintenance of data systems.

· Modify databases and streaming systems according to specifications and perform tests.

· Solve database usage issues and malfunctions.

· Liaise with other developers to improve applications and establish best practices.

· Gather user requirements and identify new features.

· Develop technical and training manuals.

· Provide data management support to users.

· Ensure all database programs meet company and performance requirements.

· Research and suggest new database products, services and protocols.



Requirments:

· Minimum 4 years’ experience in a similar position within a dynamic and fast paced environment.

· In-depth understanding of data management (e.g. permissions, recovery, security and monitoring).

· Knowledge of software development life cycle.

· Hands on experience with .

· Experience with  processing tools and creation of  pipelines (Spark, Hadoop, cloud native solutions, …).

· Experience with  tools (preferably   ).

· Familiarity with relational (preferably ) and non-relational databases.

· Experience with one or more of the major cloud providers ( preferably), knowledge of SaaS/PaaS futures.

· Experience with CI/CD pipelines (e.g. ).

· Familiarity with infrastructure as code software tools (e.g. Terraform).

· Familiarity with  modelling concepts (Inmon, Kimball,  Vault, …).

· Excellent analytical and organization skills.

· An ability to understand front-end users requirements and problem-solving attitude.

· Excellent verbal and written communication skills.

· Very good command of English.



Nice to have: 

· Understanding business needs, experience in cooperation with business, gathering business requirements, creating diagrams and documentation of mappings.

· Experience in performance tuning.

· / experience.

· Knowledge of user interface web applications



What we offer: 

· Contract of employment

· A solid, competitive salaries

· Exposure to new technologies

· Work in multilingual, multinational and multicultural environment on international projects

· Opportunity to join well established team of professionals and the company that is a leader in the industry

· Work in dynamic and friendly environment

· Medical care, life insurance and sport benefits

· Training to raise the qualifications