poll app to be removed before exiting

Signed-off-by: Matthew McNew <mmcnew@pivotal.io>