Remove manifest stuff from gemspec