Yes, the headings must be assigned to a style sheet. The existing style sheets "Heading 1" (and the following in lower levels) are predestined for this, but your own style sheets will also do the job. However, style sheets can be adapted as you wish (font, color, line spacing and more).