Fix so directories containg a single directory don't get reported as empty