Remove unnecessary complexity in FieldValueCounterHandler

Tiny change really. Just removing a Map that wasn't really used.