Use @Nullable to communicate null tolerance on the ref arg.
Drive-by: ConfigReferenceSet is null tolerant.
Explicit guava dependency so that we get new stuff.
Composition over inheritance.

Also changed it to store to a SetMultimap.