Remove user_${app}.json file on delete.