No, it isn't normal for gutters to overflow in heavy rain. If your gutters seem to be overflowing, you might be having trouble with a clog. Clogs can be caused by many things, including leaves, twigs, insects, and more.
This is a good indication that your home can benefit from having a gutter guard installed.