Clear up the libraries in gitignore