Deal with not having lib_dirs_glob on gem specs