generate smaller files by omitting duplicates
even more smaller