Delete a leftover folder