Just have a single cache size, no need to pack the buckets
Fixed all warnings (everything is now a size_t) which also improves struct alignment