Lazily load the library upon first use

I was going to make that a separate PR. Was making them small!