Position: Data Quality Automation Engineer for Azure Big Data Project
Company: Ciklum
Experience required: 2y
Category: Data Science
English level: intermediate
Published: 2020-04-01T00:00:00+03:00

You will join a highly motivated team and will be working on a modern solution for our existing client. We are looking for technology experts who want to make an impact on new business by applying best practices and taking ownership.

**About the Project:**
●	We are looking for a data quality automation engineer for a challenging E2E Big Data project and it is being developed in Azure PaaS technology.
●	Project is about the delivery of data processing platform, Azure Data Lake gen2, Azure Databricks.
 
**Responsibilities:**
●	Perform data warehouse, dimensional data mart and enterprise report validation and verification
●	Develop and deploy data quality scripts for data consistency, uniqueness, completeness, timeliness, accuracy and validity.
●	Communicate the data quality results and collaborating closely with other teams involved in the development process
●	Analyze, troubleshoot, and document problems/observations, and working with the project teams to identify the root causes and resolutions
●	Contribute to the CI/CD process establishment.

**Requirements:**
You can name examples of use in different contexts. Are guided by best-practices and specifications of such skills:
**General:**
●	Ability to work collaboratively as part of Agile project delivery team
●	Experience of working fully Agile and participating in Agile ceremonies
●	Experience in data management, data integration and data quality verification
●	Experience with Business Intelligence configuration management tools/processes
●	Experience in data profiling
●	Familiar with Data Warehouse design and implementation
●	Obligatory excellent SQL knowledge
●	Obligatory excellent Python knowledge
●	Familiar with CI/CD principles and best practices in data processing
●	Good Microsoft Azure Data Factory, Azure Databricks, Azure Data Lake gen2, Datawarehouse and Power-BI expertise
●	Experience with common file formats (XML, JSON, CSV)
●	Experience in creating automation framework and writing an automation test scripts is must.
●	Experience on embedding test scripts in CI/CD pipeline is must.


**Personal skills (soft skills):**
●	Curious mind and willingness to work with client in consultative manner to find areas to improve;
●	Intermediate +++ English;
●	Good analytical skills;
●	Good team player, motivated to develop and solve complex tasks;
●	Self-motivated, self-disciplined and result-oriented;
●	Strong attention to details and accuracy.
 
**What's in it for you?**
●	Close cooperation with client;
●	Constant flow of new projects;
●	Dynamic and challenging tasks;
●	Ability to influence project technologies;
●	Projects from scratch;
●	Team of professionals: learn from colleagues and gain recognition of your skills;
●	European management style;
●	Continuous self-improvement.

Join Ciklum and “Cross the Borders” together with us!