| [Step 1/11] Parsing and validating input arguments | |
| [ WARNING ] -nstreams default value is determined automatically for a device. Although the automatic selection usually provides a reasonable performance, but it still may be non-optimal for some cases, for more information look at README. | |
| [Step 2/11] Loading OpenVINO | |
| [ WARNING ] PerformanceMode was not explicitly specified in command line. Device CPU performance hint will be set to THROUGHPUT. | |
| [ INFO ] OpenVINO: | |
| API version............. 2022.1.0-6935-7cd3c8e86e9 | |
| [ INFO ] Device info | |
| CPU | |
| openvino_intel_cpu_plugin version 2022.1 | |
| Build................... 2022.1.0-6935-7cd3c8e86e9 | |
| [Step 3/11] Setting device configuration | |
| [ WARNING ] -nstreams default value is determined automatically for CPU device. Although the automatic selection usually provides a reasonable performance, but it still may be non-optimal for some cases, for more information look at README. | |
| [Step 4/11] Reading network files | |
| [ INFO ] Read model took 64.90 ms | |
| [Step 5/11] Resizing network to match image sizes and given batch | |
| [ WARNING ] Batch dimension is not specified for input 'input.0'. The first dimension will be interpreted as batch size. | |
| [ WARNING ] Batch dimension is not specified for input 'input.1'. The first dimension will be interpreted as batch size. | |
| [ WARNING ] Batch dimension is not specified for input 'input.2'. The first dimension will be interpreted as batch size. | |
| [ INFO ] Reshaping model: 'input.0': {1,384}, 'input.1': {1,384}, 'input.2': {1,384} | |
| [ INFO ] Reshape model took 0.05 ms | |
| [ INFO ] Network batch size: 1 | |
| [Step 6/11] Configuring input of the model | |
| [ INFO ] Model input 'input.0' precision i64, dimensions ([N,...]): 1 384 | |
| [ INFO ] Model input 'input.1' precision i64, dimensions ([N,...]): 1 384 | |
| [ INFO ] Model input 'input.2' precision i64, dimensions ([N,...]): 1 384 | |
| [ INFO ] Model output 'output.0' precision f32, dimensions ([...]): 1 384 | |
| [ INFO ] Model output 'output.1' precision f32, dimensions ([...]): 1 384 | |
| [Step 7/11] Loading the model to the device | |
| [ INFO ] Compile model took 788.57 ms | |
| [Step 8/11] Querying optimal runtime parameters | |
| [ INFO ] DEVICE: CPU | |
| [ INFO ] AVAILABLE_DEVICES , [''] | |
| [ INFO ] RANGE_FOR_ASYNC_INFER_REQUESTS , (1, 1, 1) | |
| [ INFO ] RANGE_FOR_STREAMS , (1, 152) | |
| [ INFO ] FULL_DEVICE_NAME , Intel(R) Xeon(R) Platinum 8368 CPU @ 2.40GHz | |
| [ INFO ] OPTIMIZATION_CAPABILITIES , ['WINOGRAD', 'FP32', 'FP16', 'INT8', 'BIN', 'EXPORT_IMPORT'] | |
| [ INFO ] CACHE_DIR , | |
| [ INFO ] NUM_STREAMS , 19 | |
| [ INFO ] INFERENCE_NUM_THREADS , 0 | |
| [ INFO ] PERF_COUNT , False | |
| [ INFO ] PERFORMANCE_HINT_NUM_REQUESTS , 0 | |
| [Step 9/11] Creating infer requests and preparing input data | |
| [ INFO ] Create 19 infer requests took 1.50 ms | |
| [ WARNING ] No input files were given for input 'input.0'!. This input will be filled with random values! | |
| [ WARNING ] No input files were given for input 'input.1'!. This input will be filled with random values! | |
| [ WARNING ] No input files were given for input 'input.2'!. This input will be filled with random values! | |
| [ INFO ] Fill input 'input.0' with random values | |
| [ INFO ] Fill input 'input.1' with random values | |
| [ INFO ] Fill input 'input.2' with random values | |
| [ WARNING ] Number of iterations was aligned by request number from 10000 to 10013 using number of requests 19 | |
| [Step 10/11] Measuring performance (Start inference asynchronously, 19 inference requests using 19 streams for CPU, inference only: True, limits: 10013 iterations) | |
| [ INFO ] Benchmarking in inference only mode (inputs filling are not included in measurement loop). | |
| [ INFO ] First inference took 37.43 ms | |
| [Step 11/11] Dumping statistics report | |
| Count: 10013 iterations | |
| Duration: 24302.14 ms | |
| Latency: | |
| Median: 43.95 ms | |
| AVG: 45.97 ms | |
| MIN: 39.02 ms | |
| MAX: 126.30 ms | |
| Throughput: 412.02 FPS | |