Before revision:  We also show that unbiased gradient estimators of any expected output-dependent quantities can be efficiently obtained by sampling outputs.
After revision:  We also show how to efficiently compute unbiased gradient estimators of any expected output-dependent quantities can be efficiently obtained by sampling outputs.