Don't require the library in the gemspec.