Don't display speaker appearance count if it's 0.

If the speaker appearance count is 0 and they have a positive speech
count that looks a bit odd, so let's just not display appearance count
in this situation.