Travis fixes

Try building the gem in addition to the tests. And remove some old cruft.