MLPerf Inference v0.5 - TensorRT plans for NVIDIA Jetson AGX Xavier - int8, linear
Creators: name: Gordon, Leo
name: Lokhmotov, Anton
Publisher: name: Zenodo
Year: 2020
Subjects: MLPerf
Inference
TensorRT
Xavier

description: TensorRT plans generated on a Jetson AGX Xavier Developer Kit using code and instructions from NVIDIA's MLPerf Inference v0.5 submission. The only change was related to the input format: "chw4" -&gt; "linear": <pre>diff --git a/closed/NVIDIA/measurements/Xavier/mobilenet/MultiStream/config.json b/closed/NVIDIA/measurements/Xavier/mobilenet/MultiStream/config.json index 8f576ffd..acf56041 100644 --- a/closed/NVIDIA/measurements/Xavier/mobilenet/MultiStream/config.json +++ b/closed/NVIDIA/measurements/Xavier/mobilenet/MultiStream/config.json @@ -14,10 +14,10 @@ "gpu_inference_streams": 4, "gpu_multi_stream_samples_per_query": 250, "input_dtype": "int8", - "input_format": "chw4", + "input_format": "linear", "map_path": "data_maps/imagenet/val_map.txt", "precision": "int8", - "tensor_path": "${PREPROCESSED_DATA_DIR}/imagenet/MobileNet/int8_chw4", + "tensor_path": "${PREPROCESSED_DATA_DIR}/imagenet/MobileNet/int8_linear", "use_graphs": true }, "scenario": "MultiStream", diff --git a/closed/NVIDIA/measurements/Xavier/mobilenet/Offline/config.json b/closed/NVIDIA/measurements/Xavier/mobilenet/Offline/config.json index a0879ba7..78084cf2 100644 --- a/closed/NVIDIA/measurements/Xavier/mobilenet/Offline/config.json +++ b/closed/NVIDIA/measurements/Xavier/mobilenet/Offline/config.json @@ -14,10 +14,10 @@ "gpu_inference_streams": 1, "gpu_offline_expected_qps": 5635.33, "input_dtype": "int8", - "input_format": "chw4", + "input_format": "linear", "map_path": "data_maps/imagenet/val_map.txt", "precision": "int8", - "tensor_path": "${PREPROCESSED_DATA_DIR}/imagenet/MobileNet/int8_chw4", + "tensor_path": "${PREPROCESSED_DATA_DIR}/imagenet/MobileNet/int8_linear", "use_graphs": true }, "scenario": "Offline", diff --git a/closed/NVIDIA/measurements/Xavier/mobilenet/SingleStream/config.json b/closed/NVIDIA/measurements/Xavier/mobilenet/SingleStream/config.json index 364cd68a..f4668a04 100644 --- a/closed/NVIDIA/measurements/Xavier/mobilenet/SingleStream/config.json +++ b/closed/NVIDIA/measurements/Xavier/mobilenet/SingleStream/config.json @@ -6,10 +6,10 @@ "gpu_batch_size": 1, "gpu_single_stream_expected_latency_ns": 673535, "input_dtype": "int8", - "input_format": "chw4", + "input_format": "linear", "map_path": "data_maps/imagenet/val_map.txt", "precision": "int8", - "tensor_path": "${PREPROCESSED_DATA_DIR}/imagenet/MobileNet/int8_chw4", + "tensor_path": "${PREPROCESSED_DATA_DIR}/imagenet/MobileNet/int8_linear", "use_direct_host_access": true, "use_graphs": false }, diff --git a/closed/NVIDIA/measurements/Xavier/ssd-small/MultiStream/config.json b/closed/NVIDIA/measurements/Xavier/ssd-small/MultiStream/config.json index 4a8738f8..219bb3ad 100644 --- a/closed/NVIDIA/measurements/Xavier/ssd-small/MultiStream/config.json +++ b/closed/NVIDIA/measurements/Xavier/ssd-small/MultiStream/config.json @@ -14,10 +14,10 @@ "gpu_inference_streams": 2, "gpu_multi_stream_samples_per_query": 80, "input_dtype": "int8", - "input_format": "chw4", + "input_format": "linear", "map_path": "data_maps/coco/val_map.txt", "precision": "int8", - "tensor_path": "${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4", + "tensor_path": "${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_linear", "use_graphs": false }, "system_id": "Xavier" diff --git a/closed/NVIDIA/measurements/Xavier/ssd-small/Offline/config.json b/closed/NVIDIA/measurements/Xavier/ssd-small/Offline/config.json index 4d3614e1..8750a4d3 100644 --- a/closed/NVIDIA/measurements/Xavier/ssd-small/Offline/config.json +++ b/closed/NVIDIA/measurements/Xavier/ssd-small/Offline/config.json @@ -12,10 +12,10 @@ "gpu_inference_streams": 1, "gpu_offline_expected_qps": 2116.8, "input_dtype": "int8", - "input_format": "chw4", + "input_format": "linear", "map_path": "data_maps/coco/val_map.txt", "precision": "int8", - "tensor_path": "${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4", + "tensor_path": "${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_linear", "use_graphs": false }, "system_id": "Xavier" diff --git a/closed/NVIDIA/measurements/Xavier/ssd-small/SingleStream/config.json b/closed/NVIDIA/measurements/Xavier/ssd-small/SingleStream/config.json index 0c916dd9..249a14a7 100644 --- a/closed/NVIDIA/measurements/Xavier/ssd-small/SingleStream/config.json +++ b/closed/NVIDIA/measurements/Xavier/ssd-small/SingleStream/config.json @@ -6,10 +6,10 @@ "gpu_batch_size": 1, "gpu_single_stream_expected_latency_ns": 1621000, "input_dtype": "int8", - "input_format": "chw4", + "input_format": "linear", "map_path": "data_maps/coco/val_map.txt", "precision": "int8", - "tensor_path": "${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4", + "tensor_path": "${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_linear", "use_graphs": false }, "system_id": "Xavier" </pre>