Don't treat pointsGrob units (in particular 'char') specially.