nanny: Add delete policy functionality