tokens: We illustrate our findings by analyzing popular statistical learning algorithms such as the online expectation maximization ( EM ) algorithmpcappe2009line and the average - cost policy - gradient methodpbarto2018reinforcement .