Remove app if it already exists