Correctly unload non-cryptoki libraries