Remove metadata in-memory cachesince it doesn't add any noticeable performance
benefit nowadays and thus just adds unnecessary complexity