Minor speedup to MatrixPreferenceDataModel.build_model