Remove app from collection and save