Do not include specs in gemspec

Fixes #313. While shipping specs with the gem is preferable, running the
test suite requires some additonal setup anyway so developers will end
up needing the full source from GitHub.