Project: talenddataquality
Issue TDQ-8787: Incremental display of results in the profiler
Currently, when we run an analysis, we display the results only after all indicators are computed. Now, we must display the results in the charts as soon as they are computed. With the SQL engine, each indicator is computed independently. Therefore we can display the results of each indicator in the charts as soon as they arrive. Question: - some charts require several indicators (simple statistics chart for instance). Can we build the chart dynamically? That is add bars to the chart as each indicator result comes. - if not we need to group indicators together. Therefore, only complete charts would appear: The simple stat chart would appear as soon as all simple stat indicators are computed and the frequency table chart would be computed independently as soon as the frequency indicator is computed. Notes: - The user can switch between the settings page and the results page. Therefore, the chart must be incrementally displayed both in the setting page (when the focus is the setting page) and in the results page (when the focus is the results page). - this feature only applies to SQL engine (with Java engine, there is a loop on all rows and all indicators are computed at the same time, so we can't display one indicator before the other). - in column set analysis with SQL engine, there is only one chart with simple statistics => nothing to do (moreover, all indicators are computed together too) - nothing to do for match analysis, all correlation analyses - overview analysis: we won't display the results dynamically in the table. - table display: can we dynamically display the results in a table (simple statistics for instance)? - chart display: can we dynamically display the results in a chart (simple statistics for instance)? - could display each bar dynamically (if possible) for -- functional dependency -- Business rule -- redundancy analysis - no need to refresh charts when we run a report (no direct synchronization exists between report execution and analysis execution) - if there is a focus on the editor and we execute the analysis from the menu (in dq repository or in toolbar), we need to dynamically refresh the charts. - the "refresh" button in the analysis editor keeps the same behavior as before: it only display the charts, there is no computation of the indicators. *Suggestion*: display the chart with empty values at the beginning (while queries are running), then add values into the chart when they are computed.
Story points: 20