Adding the right cached data into dustCache after specialization