Only include local perl lib if the directory exists