Honor ClassRelationshipSpec.grid_display.

Previously the option was being accepted, but the column would still
appear on the grid if it was set to false.