Extend gather-scatter optimization with prefetch optimization