Fix deletion when using app_folder