Support warming up before evaluation

- Added warming up phase where throughput or latency are not reflected
to the benchmark results.