Lowering threshold for waiting to restore instruction