Avoid drawing text when the font size is zero (issue 4484)

Fixes #4484.

Note that the code to update the `textLayer` is needed to prevent errors from `TextLayerBuilder`. It might be better to re-factor `TextLayerBuilder` to avoid this, but that seemed out of scope for this particular issue.