If the user call this method twice, just generate the vectors twice. We need to keep a small footprint within the aggregator.