Project: talenddataquality
Issue TDQ-11963: Create tDataShuffling component
Function: the component tDataShuffling allows to rearrange the data through the rows in the same column. Description: The input is a table. User choose the groups of columns to be shuffled. If no columns set as partition, the shuffling process will be implemented through the whole table. However, if one or more columns are chosen as the partition group, first the whole table is separated into several sub table who share the same value in the partitioned columns. Then the shuffling process will be implemented independently in each sub table. Finally, all the sub tables are merged as a table as output. Basic settings: shuffling columns, this table has two columns: the first column inherits all the columns' names from the previous step. The second column indicates the shuffling group and the default number is 0 which means these columns do not participate in shuffling (no change is done in these columns). User can replace a number different to 0 to indicate the group. If two or more columns have the same number, it means these columns are shuffled together. Advanced settings: partitioned columns: in this table, the user can add the columns used for partitioning the data. These columns separate the shuffling process into small partitions. Only the rows within a partition can be shuffled together. See also documentation in TDQ-11904
Story points: 3