Respect LibraryInfo in populateLTOPassManager and use it. NFC.