Fix metric with cache dir
The cache_dir provided by the user was concatenated twice and therefore causing FileNotFound errors.
The tests didn't cover the case of providing `cache_dir=` for metrics because of a stupid issue (it was not using the right parameter).

I remove the double concatenation and I fixed the tests

Fix #728 