Make sure we have the rake tasks from our dummy app. Needed for build
our gem