Activator performance improvement

Shouldn't close the previous PR early. Turns out I did not have to change much of my design.

Pinging previous trackers
@pranavkm
@halter73 
@rynowak
@ipjohnson
@yishaigalatzer 
I saw that @shhsu opened an issue for this: https://github.com/aspnet/DependencyInjection/issues/115