Gem cleanup

This is super fragile but it solves https://github.com/opscode/chef-dk/issues/252

Does anybody have any other ideas... I'm fairly sure anything else will be better

cc @opscode/client-engineers