Directly build external components inside libpkg

That fixes arm and ia64 problems