Optimizing scoreboard to use prefetch data