Skip CFFI test earlier if it's not installed

The cffi test failed on importing PyAccess if cffi isn't installed.