Repository: mlcommons/inference
Issue: No such file or directory: /Users/huaminli/.aibench/git/exec/caffe2/host/2019/1/2/eeb14675f12a19822d3a13f3d203c6396ee6cfdd/caffe2_benchmark
Root cause: Configuration Error

When I try to run the shufflenet, I cannot find the file of u'/Users/huaminli/.aibench/git/exec/caffe2/host/2019/1/2/eeb14675f12a19822d3a13f3d203c6396ee6cfdd/caffe2_benchmark'    

@psyhtest 
Good morning!
    Excuse me,how can i find the file as described?

@sf-wind
Good morning!
Excuse me,how can i find the file as described?

that is a cached file and you shouldn't access the cached file from another user. I wonder how you get that error message. Can you pleas send the entire log? 

I cannot successfully run the shufflenetv1 on my linux. I try to find out the mistake. When I add two parameters in run_bench.py, i.e. --info   and   --pre_built_binary. The --info  datas are in the info.json. In the info.json, the file is in the info.json.


Requirement already satisfied: ninja in /home/caffer/Downloads/shuff_tmp/tmp/venv/local/lib/python2.7/site-packages (1.9.0)
+ python /home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/benchmarking/run_bench.py -b /home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/specifications/models/caffe2/shufflenet/shufflenet_accuracy_imagenet.json --string_map '{"IMAGENET_DIR": "", "MODEL_DIR": "/home/caffer/Downloads/mlperf/inference/edge/object_classification/shufflenet/caffe2/model/"}' --config_dir /home/caffer/Downloads/shuff_tmp/tmp/config --root_model_dir /home/caffer/Downloads/mlperf/inference/edge/object_classification/shufflenet/caffe2/model --pre_built_binary '{}' --platform host
{"treatment": {"commit": "eeb14675f12a19822d3a13f3d203c6396ee6cfdd", "program": "/Users/huaminli/.aibench/git/exec/caffe2/host/2019/1/2/eeb14675f12a19822d3a13f3d203c6396ee6cfdd/caffe2_benchmark", "commit_time": 1546417087, "programs": {"program": {"location": "/Users/huaminli/.aibench/git/exec/caffe2/host/2019/1/2/eeb14675f12a19822d3a13f3d203c6396ee6cfdd/caffe2_benchmark"}}}}
INFO 15:43:52 lab_driver.py:  60: Checking benchmark files to download
INFO 15:43:52 lab_driver.py: 129: Running <class 'harness.BenchmarkDriver'> with raw_args [u"--info '", u'{"treatment": {"commit": "-1", "program": "test", "commit_time": 0}}\'', u'--benchmark_file', '/home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/specifications/models/caffe2/shufflenet/shufflenet_accuracy_imagenet.json', u'--root_model_dir', '/home/caffer/Downloads/mlperf/inference/edge/object_classification/shufflenet/caffe2/model', u'--logger_level', u'info', '--remote_repository', 'origin', '--repo_dir', '/home/caffer/Downloads/shuff_tmp/tmp/pytorch', '--platforms', 'host/incremental', '--repo', 'git', '--commit', 'master', '--framework', 'caffe2', '--screen_reporter', u'', '--local_reporter', '/home/caffer/Downloads/shuff_tmp/tmp/config/reporter', '--exec_dir', '/home/caffer/Downloads/shuff_tmp/tmp/config/exec', '--model_cache', '/home/caffer/Downloads/shuff_tmp/tmp/config/model_cache', '--string_map', '{"IMAGENET_DIR": "", "MODEL_DIR": "/home/caffer/Downloads/mlperf/inference/edge/object_classification/shufflenet/caffe2/model/"}', '--platform', 'host', u'--info', '{"treatment": {"commit": "eeb14675f12a19822d3a13f3d203c6396ee6cfdd", "program": "/Users/huaminli/.aibench/git/exec/caffe2/host/2019/1/2/eeb14675f12a19822d3a13f3d203c6396ee6cfdd/caffe2_benchmark", "commit_time": 1546417087, "programs": {"program": {"location": "/Users/huaminli/.aibench/git/exec/caffe2/host/2019/1/2/eeb14675f12a19822d3a13f3d203c6396ee6cfdd/caffe2_benchmark"}}}}']
INFO 15:43:52 harness.py: 194: Temp directory: /var/tmp/tmpzIlqfM
INFO 15:43:52 subprocess_with_logger.py:  24: Running: cat /proc/cpuinfo
INFO 15:43:52 benchmark_driver.py:  30: Running /home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/specifications/models/caffe2/shufflenet/shufflenet_accuracy_imagenet.json
INFO 15:43:52 subprocess_with_logger.py:  24: Running: cat /proc/cpuinfo
INFO 15:43:52 hdb.py:  27: push /Users/huaminli/.aibench/git/exec/caffe2/host/2019/1/2/eeb14675f12a19822d3a13f3d203c6396ee6cfdd/caffe2_benchmark to /var/tmp/tmpzIlqfM/ubuntu/caffe2_benchmark
INFO 15:43:52 benchmark_driver.py:  64: Exception caught when running benchmark
INFO 15:43:52 benchmark_driver.py:  65: [Errno 2] No such file or directory: u'/Users/huaminli/.aibench/git/exec/caffe2/host/2019/1/2/eeb14675f12a19822d3a13f3d203c6396ee6cfdd/caffe2_benchmark'
ERROR 15:43:52 benchmark_driver.py:  69: Traceback (most recent call last):
  File "/home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/benchmarking/driver/benchmark_driver.py", line 38, in runOneBenchmark
    data = _runOnePass(minfo, mbenchmark, framework, platform)
  File "/home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/benchmarking/driver/benchmark_driver.py", line 106, in _runOnePass
    framework.runBenchmark(info, benchmark, platform)
  File "/home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/benchmarking/frameworks/caffe2/caffe2.py", line 38, in runBenchmark
    platform)
  File "/home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/benchmarking/frameworks/framework_base.py", line 73, in runBenchmark
    copy_files = first_iteration)
  File "/home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/benchmarking/platforms/platform_base.py", line 102, in copyFilesToPlatform
    copy_files)
  File "/home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/benchmarking/platforms/platform_base.py", line 90, in copyFilesToPlatform
    self.util.push(files, target_file)
  File "/home/caffer/Downloads/shuff_tmp/tmp/FAI-PEP/benchmarking/platforms/host/hdb.py", line 34, in push
    shutil.copyfile(src, tgt)
  File "/usr/lib/python2.7/shutil.py", line 96, in copyfile
    with open(src, 'rb') as fsrc:
IOError: [Errno 2] No such file or directory: u'/Users/huaminli/.aibench/git/exec/caffe2/host/2019/1/2/eeb14675f12a19822d3a13f3d203c6396ee6cfdd/caffe2_benchmark'

INFO 15:43:52 benchmark_driver.py:  83: No data collected for on Linux-4.18.0-17-generic-x86_64-with-Ubuntu-18.04-bionic--IntelR-CoreTM-i5-8250U-CPU--1.60GHz (ubuntu). The run may be failed for eeb14675f12a19822d3a13f3d203c6396ee6cfdd
INFO 15:43:52 harness.py: 226:  ======= harness error =======


Did you run the script in: https://github.com/mlperf/inference/blob/master/edge/object_classification/shufflenet/caffe2/run.sh?

I see you specify your own --config_dir: --config_dir /home/caffer/Downloads/shuff_tmp/tmp/config

It seems the config.txt file in your config directory is incorrect. 

Yes,I run the script in https://github.com/mlperf/inference/blob/master/edge/object_classification/shufflenet/caffe2/run.sh. However, it didn't run sucessfully. The --config_dir's path is the same to the original, I just move the  tmp file to a new location. 

can you please paste the content of the config.txt? Also the entire run log.

Add argument: "--logger_level info" to the run command: https://github.com/mlperf/inference/blob/master/edge/object_classification/shufflenet/caffe2/run.sh#L94