Yeah I was considering that but somehow it also needs to be in the gemfile or a runtime dependency for the rails3 test to work.