Delete left behind directory