Update gitignore to ignore the build directories
Remove all build directories, because you can build them when you need to