Disable HistArray lookup safety checks for filter

This makes the filter 8.9% faster in my testing.