BUG: maintain order in excluding categories

should fix current travis fails on master branch.

i cannot add tests right now because `test_remove_categories` in `test_categorical.py` does not fail on my machine. it also passes on a number of travis builds, and fails only on a couple.