CCoinsKeyHasher::operator() should return size_t

It currently returns uint64_t, which on older boost causes failures on 32-bit systems.

Fixes #4634.