Only compile musl's implementation of scalb* on x86

Change-Id: Iebf2d30932569f4ebe0bb22c3dafeea57e39aa0a