more perf work on shared observations

R=arv
BUG=

Review URL: https://codereview.appspot.com/84840043