Some small librustc perf improvements

I think this saves a second or so.

r? @nikomatsakis