RFC: libmagic: Remove patches?

I am not sure which versions of `gcc` support these patches. But `libmagic` installation fails with these patches:
https://travis-ci.org/saketkc/brewer/builds/42024371#L1489

I am able to build without a single patch.