TST/ENH: Change buildColorSelectorTable interface

This also includes a change to the way the elements were added to the
table, they are now added in the sorted "fashion" that we want.

Update test case to reflect these changes.