Remove tmp and librarian dirs and ignore them