Before revision:  Because the MAB algorithms sequentially updates the policy based on past observations, the generated samples are not independent and identically distributed (i. i.d.).
After revision:  Because the MAB algorithms sequentially updates the policy based on past observations, the generated samples are not independent and identically distributed .