Be more conservative about files in gemspec