Remove more deps and useless lib_dirs