libm: These optimizations are only for Krait

* Issues on other chipsets. Resync with CAF and only use on specific
   chipsets (Krait, Sparrow).

Change-Id: I8355818d5deb4682914e1b53b4913472db0e43f9