Bug 1172323 - Only remove unreferenced empty directories from the frontend configuration