Fix some unstable workers tests