Reduce memory footprint by not caching hash's

Requires only slightly more cpu.