Remove the ignored build and nb directories