Move some dependencies from gem spec to Gemfile