More gemspec cleanup.

- Remove files we don't actually have or want.
- Add files we do want.