Forgot to run rake rails:update:bin - See https://devcenter.heroku.com/articles/rails4#upgrading-a-rails-3-app