[CI] Run specs and tests

While we move away from rspec and towards minitest, now seems like a good time to start running both to make sure builds don't break.

cc @jch @schaary 

Any downside to changing this?

```ruby
`git ls-files`.split $/
```

What's Manifest.txt used for above? It seems to have the same information as the gemspec.