[ISOLATED-PROCESS][2024-09-25 18:53:27,439][pytorch][INFO] - Allocating pytorch backend
[ISOLATED-PROCESS][2024-09-25 18:53:27,439][pytorch][INFO] - 	+ Seeding backend with 42
[ISOLATED-PROCESS][2024-09-25 18:53:27,440][pytorch][INFO] - 	+ Benchmarking a Transformers model
[ISOLATED-PROCESS][2024-09-25 18:53:28,549][inference][INFO] - Allocating inference scenario
[ISOLATED-PROCESS][2024-09-25 18:53:28,549][inference][INFO] - 	+ Creating input generator
[ISOLATED-PROCESS][2024-09-25 18:53:28,550][inference][INFO] - 	+ Generating Inference inputs
[ISOLATED-PROCESS][2024-09-25 18:53:28,550][inference][INFO] - 	+ Initializing Inference report
[ISOLATED-PROCESS][2024-09-25 18:53:28,551][inference][INFO] - 	+ Preparing input shapes for Inference
[ISOLATED-PROCESS][2024-09-25 18:53:28,551][inference][INFO] - 	+ Running model loading tracking
[ISOLATED-PROCESS][2024-09-25 18:53:28,551][latency][INFO] - 	+ Tracking latency using CPU performance counter
[ISOLATED-PROCESS][2024-09-25 18:53:28,551][inference][INFO] - 	+ Loading model for Inference
[ISOLATED-PROCESS][2024-09-25 18:53:28,552][pytorch][INFO] - 	+ Creating backend temporary directory
[ISOLATED-PROCESS][2024-09-25 18:53:28,553][pytorch][INFO] - 	+ Loading model with pretrained weights
[ISOLATED-PROCESS][2024-09-25 18:53:28,554][pytorch][INFO] - 	+ Loading Transformers model
[ISOLATED-PROCESS][2024-09-25 18:53:28,881][pytorch][INFO] - 	+ Enabling eval mode
[ISOLATED-PROCESS][2024-09-25 18:53:28,883][pytorch][INFO] - 	+ Cleaning up backend temporary directory
[ISOLATED-PROCESS][2024-09-25 18:53:28,884][inference][INFO] - 	+ Preparing inputs for Inference
[ISOLATED-PROCESS][2024-09-25 18:53:28,885][inference][INFO] - 	+ Warming up backend for Inference
[ISOLATED-PROCESS][2024-09-25 18:53:29,252][inference][INFO] - 	+ Running Inference latency tracking
[ISOLATED-PROCESS][2024-09-25 18:53:29,252][latency][INFO] - 	+ Tracking latency using CPU performance counter
[ISOLATED-PROCESS][2024-09-25 18:53:39,282][latency][INFO] - 		+ load latency:
[ISOLATED-PROCESS][2024-09-25 18:53:39,282][latency][INFO] - 			- count: 1
[ISOLATED-PROCESS][2024-09-25 18:53:39,283][latency][INFO] - 			- total: 0.331631 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,283][latency][INFO] - 			- mean: 0.331631 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,283][latency][INFO] - 			- stdev: 0.000000 s (0.00%)
[ISOLATED-PROCESS][2024-09-25 18:53:39,284][latency][INFO] - 			- p50: 0.331631 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,284][latency][INFO] - 			- p90: 0.331631 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,284][latency][INFO] - 			- p95: 0.331631 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,284][latency][INFO] - 			- p99: 0.331631 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,285][latency][INFO] - 		+ forward latency:
[ISOLATED-PROCESS][2024-09-25 18:53:39,285][latency][INFO] - 			- count: 266
[ISOLATED-PROCESS][2024-09-25 18:53:39,285][latency][INFO] - 			- total: 10.021863 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,285][latency][INFO] - 			- mean: 0.037676 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,286][latency][INFO] - 			- stdev: 0.008922 s (23.68%)
[ISOLATED-PROCESS][2024-09-25 18:53:39,286][latency][INFO] - 			- p50: 0.035970 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,286][latency][INFO] - 			- p90: 0.043994 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,286][latency][INFO] - 			- p95: 0.046884 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,287][latency][INFO] - 			- p99: 0.073021 s
[ISOLATED-PROCESS][2024-09-25 18:53:39,288][latency][INFO] - 		+ forward throughput: 53.083941 samples/s
[ISOLATED-PROCESS][2024-09-25 18:53:39,296][process][INFO] - 	+ Sending report to main process
[ISOLATED-PROCESS][2024-09-25 18:53:39,297][process][INFO] - 	+ Exiting isolated process