Adding cache runtime param and fixing perf test