ENH: Check size for setting vertex and face colors