x86_64/x32: Avoid early fail on x32 or x86_64 build

Change-Id: I30186cfb74467004400a10e79e0fcbf72f876098
Signed-off-by: Pavel Chupin <pavel.v.chupin@intel.com>