Remove unnecessary additions to the load path.