Build FFI instance when class is created, load library when instantiated
Lazily load the library on first use instead of on import
Fix the import order
Merge pull request #1467 from dstufft/no-implicit-compile

Refactor to avoid the implicit compile when executing setup.py