That's what `add_development_dependency` vs `add_runtime_dependency` is for in the gemspec.