Project: talenddataquality
Issue TDQ-5690: Ensure the quality of the DQ datamart
Phase 1. Use DQ analyses in order to ensure that the DQ datamart does not contain any data of bad quality. Two projects are required: 1. the first project will populate the datamart with all kinds of analyses (these analyses should apply on the TBI test database) 2. the second project will profile the datamart and apply several thresholds and rules in order to ensure the quality of the data stored in the datamart. These two projects already existed in version 3.2.2. Whenever a data of bad quality appears in the datamart, that means that there is a bug in the code. In phase 1, these 2 projects must be upgraded to the last version: 5.1.1. Phase 2: implement new constraints analyses on the datamart in order to check new indicators and new analyses that did not exist in 3.2. This phase is to be defined more precisely later. Phase 3: Process automation. In order to automate the process, the reports should be executed every day (via the tLaunchDqReport component or the exported script) and an email should be sent as soon as a problem of quality appears. If the component is used, then the job could become a TUJ. This phase is to be defined more precisely later.
Story points: 8