Simplify how AttentionValue is used.

Get rid of the AtteentionValueHolder class, and all the complexity associated with it.