Fix various references in late-running tests and things
Remove crates from test list so that we don't waste time building them.