Use bin stubs for dummy app setup

This avoids warnings from bundler about version mismatches and also
provides quit a speed boost in the test suite over `bundle exec`.