can we maybe have a single method that iterates over all `IntsRef` like

```Java
private final IntsRef[] references = new IntsRef[] {...};


private void ensureSize(int size /* that is freq */) {
  if (references[0].ints.length < size) {
     for (int i = 0; i < references.length; i++) {
        references[i].grow(size);
     }
  }

}
```
and call this instead of initMemory()