Don't apply webfonts to special elements with different language

This addresses more issues from downstream bug
https://bugzilla.wikimedia.org/show_bug.cgi?id=53734