Cleanup a deleted file