Remove raise on specification removal

The gemspec is removed from the filesystem prior to removing from the
Specification list, so there is an order dependence here.
Merge pull request #698 from tmacedo/remove_raise_on_spec_removal

Remove bogus raise in Specification::remove_spec