Don't add vendor library path if it is unnecessary

Related #116 #117