[setup] remove library_dir, which is not used by distutils/setuptools