ValidatorBuilder: remove caching

Same reason as previously: caching is now done at the validator processor level.

Signed-off-by: Francis Galiegue <fgaliegue@gmail.com>