Let me tell you a story. I spouted off on the VRML list about one browser not having particularly subtle colors, and someone from that company emailed me saying We know, and we don t know for sure what to do next. I wrote back saying, I m a techie. Something even worse happened the other day.
Some metrics clearly are very important, and others don t seem to matter as much.
Then there s the whole problem of individual differences that nobody can do anything about. Rendering libraries are chosen for business reasons just as often as for technical reasons. Whoever said on the list a couple of weeks ago that our color space is RGB had it exactly right, I think. But if we come up with a set of metrics and testing tools and end up giving high grades to browsers that make worlds look lousy, or that are uncorrelated to perceptions, we do VRML no service.