Try to fix Travis build by requiring rubysl-set directly