Verify order of load path before requires

Remove extra setup
Add changelog entry for --require regression