Greatly simplify spec file and build script

I took this oportunity to learn a little bit more about the spec files and I see I could simplify this a lot.

But I don't want to merge this without your approval. I works for me but if you can test with be good.