Remove empty spec file.

There is no point of having one without any real tests, I will just
forget to update it.