Yes, even when cooled at room temperature, a properly cooked cake will be fragile. Cooling it before frosting helps thicken the fat and firm the cake up to be able to handle the pressure of frosting.