How about:
```
all_reference_values = defaultdict(list)
```
instead.