Fix library loading when the lib directory isn't there