Cornbread is a more tender bread, so some light crumbling may naturally happen. To minimize the amount of it, however, always cut the bread when it is fully cooled. When you are tossing the cornbread in the olive oil, do so very gently, folding the cornbread into it so it doesn't break down or fall apart.