Before revision:  We also show that unbiased gradient estimators of any expected output-dependent quantities can be efficiently obtained by sampling outputs.
After revision:  We also show that unbiased gradient estimators of any expected output-dependent quantities by sampling outputs.