Don't bail out if limits.h can't be found

We might be on a system where clang is the system compiler (like FreeBSD >= 10)