"--thread=n" switch does not seem to work #293
Description
I am trying to use "--thread=4" to control the number of cores involved during the benchmark, and it does not seem to work and caused the failure. BTW, I have manually disabled 4 cores, and only leave 4 core available on my orangepi plus.
The command I used is as below:
(mlc) orangepi@orangepi5plus:~$ mlcr run-mlperf,inference,_full,_r5.0-dev --model=resnet50 --implementation=reference --framework=onnxruntime --category=edge --scenario=Offline --execution_mode=valid --device=cpu --quiet --test_query_count=1000 --thread=4
And the log is as below
[2025-03-06 16:30:48,427 module.py:558 INFO] - * mlcr run-mlperf,inference,_full,_r5.0-dev
[2025-03-06 16:30:48,468 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:48,496 module.py:5329 INFO] - ! cd /home/orangepi
[2025-03-06 16:30:48,496 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:48,549 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:48,626 module.py:558 INFO] - * mlcr detect,cpu
[2025-03-06 16:30:48,658 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:48,687 module.py:5329 INFO] - ! cd /home/orangepi
[2025-03-06 16:30:48,688 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:48,742 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:48,807 module.py:5329 INFO] - ! cd /home/orangepi
[2025-03-06 16:30:48,808 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-03-06 16:30:48,917 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
[2025-03-06 16:30:49,001 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:30:49,006 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:49,008 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:49,008 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:49,140 module.py:558 INFO] - * mlcr get,mlcommons,inference,src
[2025-03-06 16:30:49,147 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-src_28dca458/mlc-cached-state.json
[2025-03-06 16:30:49,202 module.py:558 INFO] - * mlcr get,sut,description
[2025-03-06 16:30:49,242 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:49,273 module.py:5329 INFO] - ! cd /home/orangepi
[2025-03-06 16:30:49,273 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:49,333 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:49,417 module.py:558 INFO] - * mlcr detect,cpu
[2025-03-06 16:30:49,452 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:49,483 module.py:5329 INFO] - ! cd /home/orangepi
[2025-03-06 16:30:49,483 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:49,543 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:49,613 module.py:5329 INFO] - ! cd /home/orangepi
[2025-03-06 16:30:49,614 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-03-06 16:30:49,732 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
[2025-03-06 16:30:49,814 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:30:49,819 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:49,820 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:49,821 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:49,923 module.py:558 INFO] - * mlcr get,compiler
[2025-03-06 16:30:49,927 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-llvm_2a16eab5/mlc-cached-state.json
[2025-03-06 16:30:50,426 module.py:558 INFO] - * mlcr get,generic-python-lib,_package.dmiparser
[2025-03-06 16:30:50,488 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:30:50,493 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:50,495 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:50,496 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:50,499 module.py:5329 INFO] - ! cd /home/orangepi
[2025-03-06 16:30:50,499 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-03-06 16:30:50,841 module.py:5476 INFO] - ! call "detect_version" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 5.1
[2025-03-06 16:30:50,948 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:30:50,953 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:50,955 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:50,955 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:50,958 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-generic-python-lib_c5ca3e80/mlc-cached-state.json
[2025-03-06 16:30:50,997 module.py:558 INFO] - * mlcr get,cache,dir,_name.mlperf-inference-sut-descriptions
[2025-03-06 16:30:51,002 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-cache-dir_d1147d31/mlc-cached-state.json
Generating SUT description file for orangepi5plus-onnxruntime
[2025-03-06 16:30:51,041 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-sut-description/customize.py
[2025-03-06 16:30:51,119 module.py:558 INFO] - * mlcr get,mlperf,inference,results,dir,_version.r5.0-dev
[2025-03-06 16:30:51,124 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-results-dir_5b5d1028/mlc-cached-state.json
[2025-03-06 16:30:51,151 module.py:558 INFO] - * mlcr install,pip-package,for-mlc-python,_package.tabulate
[2025-03-06 16:30:51,156 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/install-pip-package-for-mlc-python_d13518ce/mlc-cached-state.json
[2025-03-06 16:30:51,187 module.py:558 INFO] - * mlcr get,mlperf,inference,utils
[2025-03-06 16:30:51,323 module.py:558 INFO] - * mlcr get,mlperf,inference,src
[2025-03-06 16:30:51,330 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-src_28dca458/mlc-cached-state.json
[2025-03-06 16:30:51,362 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-utils/customize.py
Using MLCommons Inference source from /home/orangepi/MLC/repos/local/cache/get-git-repo_455c691e/inference
Running loadgen scenario: Offline and mode: performance
[2025-03-06 16:30:52,609 module.py:558 INFO] - * mlcr app,mlperf,inference,generic,_reference,_resnet50,_onnxruntime,_cpu,_valid,_r5.0-dev_default,_offline
[2025-03-06 16:30:52,673 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:52,708 module.py:5329 INFO] - ! cd /home/orangepi
[2025-03-06 16:30:52,709 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:52,771 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:52,860 module.py:558 INFO] - * mlcr get,sys-utils-cm
[2025-03-06 16:30:52,900 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:52,933 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:52,934 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:52,999 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:53,123 module.py:558 INFO] - * mlcr get,python
[2025-03-06 16:30:53,128 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:53,130 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:53,130 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:53,265 module.py:558 INFO] - * mlcr get,mlcommons,inference,src
[2025-03-06 16:30:53,273 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-src_d9661778/mlc-cached-state.json
[2025-03-06 16:30:53,303 module.py:558 INFO] - * mlcr get,mlperf,inference,utils
[2025-03-06 16:30:53,447 module.py:558 INFO] - * mlcr get,mlperf,inference,src
[2025-03-06 16:30:53,455 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-src_d9661778/mlc-cached-state.json
[2025-03-06 16:30:53,488 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-utils/customize.py
[2025-03-06 16:30:53,578 module.py:558 INFO] - * mlcr get,dataset-aux,imagenet-aux
[2025-03-06 16:30:53,584 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-dataset-imagenet-aux_06b55374/mlc-cached-state.json
[2025-03-06 16:30:54,559 module.py:558 INFO] - * mlcr app,mlperf,reference,inference,_offline,_onnxruntime,_cpu,_resnet50,_fp32
[2025-03-06 16:30:54,628 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:54,665 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:54,665 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:54,730 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:54,819 module.py:558 INFO] - * mlcr detect,cpu
[2025-03-06 16:30:54,858 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:54,891 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:54,892 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:54,956 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:55,032 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:55,033 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-03-06 16:30:55,156 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
[2025-03-06 16:30:55,226 module.py:558 INFO] - * mlcr get,sys-utils-cm
[2025-03-06 16:30:55,267 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:55,302 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:55,302 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:55,366 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:55,504 module.py:558 INFO] - * mlcr get,python
[2025-03-06 16:30:55,510 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:55,512 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:55,512 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:56,054 module.py:558 INFO] - * mlcr get,generic-python-lib,_onnxruntime
[2025-03-06 16:30:56,127 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:30:56,132 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:56,134 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:56,134 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:56,138 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:56,138 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-03-06 16:30:56,479 module.py:5476 INFO] - ! call "detect_version" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 1.20.1
[2025-03-06 16:30:56,572 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:30:56,578 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:56,580 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:56,580 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:56,583 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-generic-python-lib_b20ddd59/mlc-cached-state.json
[2025-03-06 16:30:56,779 module.py:558 INFO] - * mlcr get,ml-model,image-classification,resnet50,raw,_onnx,_fp32
[2025-03-06 16:30:56,797 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-ml-model-resnet50_f98cae5e/mlc-cached-state.json
[2025-03-06 16:30:56,800 module.py:2218 INFO] - Path to the ML model: /home/orangepi/MLC/repos/local/cache/download-file_0b874fd8/resnet50_v1.onnx
[2025-03-06 16:30:57,003 module.py:558 INFO] - * mlcr get,dataset,image-classification,imagenet,preprocessed,_-for.mobilenet,_NCHW,_full
[2025-03-06 16:30:57,017 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_ad351e75/mlc-cached-state.json
[2025-03-06 16:30:57,096 module.py:558 INFO] - * mlcr get,dataset-aux,image-classification,imagenet-aux
[2025-03-06 16:30:57,103 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-dataset-imagenet-aux_06b55374/mlc-cached-state.json
[2025-03-06 16:30:57,175 module.py:558 INFO] - * mlcr generate,user-conf,mlperf,inference
[2025-03-06 16:30:57,215 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:57,254 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:57,254 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:57,324 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:57,406 module.py:558 INFO] - * mlcr detect,cpu
[2025-03-06 16:30:57,447 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:30:57,485 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:57,485 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:30:57,555 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:30:57,636 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:57,637 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-03-06 16:30:57,769 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
[2025-03-06 16:30:57,872 module.py:558 INFO] - * mlcr get,python
[2025-03-06 16:30:57,878 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:57,880 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:57,881 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:58,018 module.py:558 INFO] - * mlcr get,mlcommons,inference,src
[2025-03-06 16:30:58,028 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-src_d9661778/mlc-cached-state.json
[2025-03-06 16:30:58,085 module.py:558 INFO] - * mlcr get,sut,configs
[2025-03-06 16:30:58,126 module.py:558 INFO] - * mlcr get,cache,dir,_name.mlperf-inference-sut-configs
[2025-03-06 16:30:58,133 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-cache-dir_8203c130/mlc-cached-state.json
[2025-03-06 16:30:58,142 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-sut-configs/customize.py
Using MLCommons Inference source from '/home/orangepi/MLC/repos/local/cache/get-git-repo_455c691e/inference'
Original configuration value 1.0 target_qps
Adjusted configuration value 1.01 target_qps
Output Dir: '/home/orangepi/MLC/repos/local/cache/get-mlperf-inference-results-dir_5b5d1028/valid_results/orangepi5plus-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1'
resnet50.Offline.target_qps = 1.01
[2025-03-06 16:30:58,420 module.py:558 INFO] - * mlcr get,loadgen
[2025-03-06 16:30:58,429 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-loadgen_2eabbbbb/mlc-cached-state.json
[2025-03-06 16:30:58,433 module.py:2218 INFO] - Path to the tool: /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-loadgen_2eabbbbb/install
[2025-03-06 16:30:58,577 module.py:558 INFO] - * mlcr get,mlcommons,inference,src
[2025-03-06 16:30:58,587 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-src_d9661778/mlc-cached-state.json
[2025-03-06 16:30:58,733 module.py:558 INFO] - * mlcr get,mlcommons,inference,src
[2025-03-06 16:30:58,742 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-mlperf-inference-src_28dca458/mlc-cached-state.json
[2025-03-06 16:30:59,244 module.py:558 INFO] - * mlcr get,generic-python-lib,_package.psutil
[2025-03-06 16:30:59,312 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:30:59,318 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:59,320 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:59,320 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:59,326 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:30:59,326 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-03-06 16:30:59,681 module.py:5476 INFO] - ! call "detect_version" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 7.0.0
[2025-03-06 16:30:59,796 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:30:59,802 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:30:59,805 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:30:59,805 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:30:59,809 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-generic-python-lib_d389aaea/mlc-cached-state.json
[2025-03-06 16:31:00,311 module.py:558 INFO] - * mlcr get,generic-python-lib,_opencv-python
[2025-03-06 16:31:00,379 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:31:00,385 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:31:00,387 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:31:00,388 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:31:00,393 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:31:00,393 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-03-06 16:31:00,747 module.py:5476 INFO] - ! call "detect_version" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 4.11.0.86
[2025-03-06 16:31:00,860 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:31:00,866 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:31:00,869 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:31:00,869 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:31:00,873 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-generic-python-lib_b5037291/mlc-cached-state.json
[2025-03-06 16:31:01,371 module.py:558 INFO] - * mlcr get,generic-python-lib,_numpy
[2025-03-06 16:31:01,440 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:31:01,445 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:31:01,448 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:31:01,448 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:31:01,454 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:31:01,454 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-03-06 16:31:01,831 module.py:5476 INFO] - ! call "detect_version" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 1.26.4
[2025-03-06 16:31:01,941 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:31:01,947 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:31:01,950 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:31:01,950 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:31:01,954 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-generic-python-lib_cd082116/mlc-cached-state.json
[2025-03-06 16:31:02,453 module.py:558 INFO] - * mlcr get,generic-python-lib,_pycocotools
[2025-03-06 16:31:02,520 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:31:02,526 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:31:02,528 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:31:02,529 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:31:02,534 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:31:02,534 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-03-06 16:31:02,885 module.py:5476 INFO] - ! call "detect_version" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 2.0.8
[2025-03-06 16:31:03,001 module.py:558 INFO] - * mlcr get,python3
[2025-03-06 16:31:03,007 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-python3_b40f8788/mlc-cached-state.json
[2025-03-06 16:31:03,010 module.py:2218 INFO] - Path to Python: /home/orangepi/mlc/bin/python3
[2025-03-06 16:31:03,010 module.py:2218 INFO] - Python version: 3.10.12
[2025-03-06 16:31:03,014 module.py:1270 INFO] - ! load /home/orangepi/MLC/repos/local/cache/get-generic-python-lib_e2e50d3c/mlc-cached-state.json
Using MLCommons Inference source from '/home/orangepi/MLC/repos/local/cache/get-git-repo_455c691e/inference'
[2025-03-06 16:31:03,075 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/app-mlperf-inference-mlcommons-python/customize.py
[2025-03-06 16:31:03,127 module.py:558 INFO] - * mlcr benchmark-mlperf
[2025-03-06 16:31:03,175 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/benchmark-program-mlperf/customize.py
[2025-03-06 16:31:03,261 module.py:558 INFO] - * mlcr benchmark-program,program
[2025-03-06 16:31:03,305 module.py:558 INFO] - * mlcr detect,cpu
[2025-03-06 16:31:03,354 module.py:558 INFO] - * mlcr detect,os
[2025-03-06 16:31:03,407 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:31:03,408 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-03-06 16:31:03,496 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-03-06 16:31:03,594 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:31:03,594 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-03-06 16:31:03,755 module.py:5476 INFO] - ! call "postprocess" from /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
***************************************************************************
CM script::benchmark-program/run.sh
Run Directory: /home/orangepi/MLC/repos/local/cache/get-git-repo_455c691e/inference/vision/classification_and_detection
CMD: ./run_local.sh onnxruntime resnet50 cpu --scenario Offline --threads 8 --user_conf '/home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/954c6df540524a85923ad4060ad036bc.conf' --use_preprocessed_dataset --cache_dir /home/orangepi/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_ad351e75 --dataset-list /home/orangepi/MLC/repos/local/cache/extract-file_b98bd951/val.txt 2>&1 | tee '/home/orangepi/MLC/repos/local/cache/get-mlperf-inference-results-dir_5b5d1028/valid_results/orangepi5plus-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1/console.out'; echo \${PIPESTATUS[0]} > exitstatus
[2025-03-06 16:31:03,836 module.py:5329 INFO] - ! cd /home/orangepi/MLC/repos/local/cache/get-sys-utils-cm_ba8cc059
[2025-03-06 16:31:03,837 module.py:5330 INFO] - ! call /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/benchmark-program/run-ubuntu.sh from tmp-run.sh
./run_local.sh onnxruntime resnet50 cpu --scenario Offline --threads 8 --user_conf '/home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/954c6df540524a85923ad4060ad036bc.conf' --use_preprocessed_dataset --cache_dir /home/orangepi/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_ad351e75 --dataset-list /home/orangepi/MLC/repos/local/cache/extract-file_b98bd951/val.txt 2>&1 | tee '/home/orangepi/MLC/repos/local/cache/get-mlperf-inference-results-dir_5b5d1028/valid_results/orangepi5plus-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1/console.out'; echo ${PIPESTATUS[0]} > exitstatus
python3 python/main.py --profile resnet50-onnxruntime --model "/home/orangepi/MLC/repos/local/cache/download-file_0b874fd8/resnet50_v1.onnx" --dataset-path /home/orangepi/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_ad351e75 --output "/home/orangepi/MLC/repos/local/cache/get-mlperf-inference-results-dir_5b5d1028/valid_results/orangepi5plus-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1" --scenario Offline --threads 8 --user_conf /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/954c6df540524a85923ad4060ad036bc.conf --use_preprocessed_dataset --cache_dir /home/orangepi/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_ad351e75 --dataset-list /home/orangepi/MLC/repos/local/cache/extract-file_b98bd951/val.txt
INFO:main:Namespace(dataset='imagenet', dataset_path='/home/orangepi/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_ad351e75', dataset_list='/home/orangepi/MLC/repos/local/cache/extract-file_b98bd951/val.txt', data_format=None, profile='resnet50-onnxruntime', scenario='Offline', max_batchsize=32, model='/home/orangepi/MLC/repos/local/cache/download-file_0b874fd8/resnet50_v1.onnx', output='/home/orangepi/MLC/repos/local/cache/get-mlperf-inference-results-dir_5b5d1028/valid_results/orangepi5plus-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1', inputs=None, outputs=['ArgMax:0'], backend='onnxruntime', device=None, model_name='resnet50', threads=8, qps=None, cache=0, cache_dir='/home/orangepi/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_ad351e75', preprocessed_dir=None, use_preprocessed_dataset=True, accuracy=False, find_peak_performance=False, debug=False, user_conf='/home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/954c6df540524a85923ad4060ad036bc.conf', audit_conf='audit.config', time=None, count=None, performance_sample_count=None, max_latency=None, samples_per_query=8)
INFO:imagenet:Loading 50000 preprocessed images using 8 threads
INFO:imagenet:loaded 50000 images, cache=0, already_preprocessed=True, took=3.7sec
2025-03-06 16:31:08.749502348 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 8002, index: 0, mask: {6, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-03-06 16:31:08.749659848 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 8003, index: 1, mask: {5, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-03-06 16:31:08.749984765 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 8004, index: 2, mask: {4, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
/opt/rh/gcc-toolset-12/root/usr/include/c++/12/bits/stl_vector.h:1123: std::vector<_Tp, _Alloc>::reference std::vector<_Tp, _Alloc>::operator[](size_type) [with _Tp = unsigned int; _Alloc = std::allocator<unsigned int>; reference = unsigned int&; size_type = long unsigned int]: Assertion '__n < this->size()' failed.
./run_local.sh: line 30: 7990 Aborted (core dumped) python3 python/main.py --profile resnet50-onnxruntime --model "/home/orangepi/MLC/repos/local/cache/download-file_0b874fd8/resnet50_v1.onnx" --dataset-path /home/orangepi/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_ad351e75 --output "/home/orangepi/MLC/repos/local/cache/get-mlperf-inference-results-dir_5b5d1028/valid_results/orangepi5plus-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1" --scenario Offline --threads 8 --user_conf /home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/954c6df540524a85923ad4060ad036bc.conf --use_preprocessed_dataset --cache_dir /home/orangepi/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_ad351e75 --dataset-list /home/orangepi/MLC/repos/local/cache/extract-file_b98bd951/val.txt
Traceback (most recent call last):
File "/home/orangepi/mlc/bin/mlcr", line 8, in <module>
sys.exit(mlcr())
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/main.py", line 73, in mlcr
main()
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/main.py", line 160, in main
res = method(run_args)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 141, in run
return self.call_script_module_function("run", run_args)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 121, in call_script_module_function
result = automation_instance.run(run_args) # Pass args to the run method
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run
r = self._run(i)
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1770, in _run
r = customize_code.preprocess(ii)
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-app/customize.py", line 284, in preprocess
r = mlc.access(ii)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/action.py", line 56, in access
result = method(options)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 141, in run
return self.call_script_module_function("run", run_args)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 121, in call_script_module_function
result = automation_instance.run(run_args) # Pass args to the run method
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run
r = self._run(i)
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1840, in _run
r = self._call_run_deps(prehook_deps, self.local_env_keys, local_env_keys_from_meta, env, state, const, const_state, add_deps_recursive,
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3527, in _call_run_deps
r = script._run_deps(deps, local_env_keys, env, state, const, const_state, add_deps_recursive, recursion_spaces,
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3697, in _run_deps
r = self.action_object.access(ii)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/action.py", line 56, in access
result = method(options)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 141, in run
return self.call_script_module_function("run", run_args)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 121, in call_script_module_function
result = automation_instance.run(run_args) # Pass args to the run method
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run
r = self._run(i)
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1856, in _run
r = prepare_and_run_script_with_postprocessing(
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 5483, in prepare_and_run_script_with_postprocessing
r = script_automation._call_run_deps(posthook_deps, local_env_keys, local_env_keys_from_meta, env, state, const, const_state,
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3527, in _call_run_deps
r = script._run_deps(deps, local_env_keys, env, state, const, const_state, add_deps_recursive, recursion_spaces,
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3697, in _run_deps
r = self.action_object.access(ii)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/action.py", line 56, in access
result = method(options)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 141, in run
return self.call_script_module_function("run", run_args)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 121, in call_script_module_function
result = automation_instance.run(run_args) # Pass args to the run method
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run
r = self._run(i)
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1883, in _run
r = self._run_deps(post_deps, clean_env_keys_post_deps, env, state, const, const_state, add_deps_recursive, recursion_spaces,
File "/home/orangepi/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3697, in _run_deps
r = self.action_object.access(ii)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/action.py", line 56, in access
result = method(options)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 141, in run
return self.call_script_module_function("run", run_args)
File "/home/orangepi/mlc/lib/python3.10/site-packages/mlc/script_action.py", line 131, in call_script_module_function
raise ScriptExecutionError(f"Script {function_name} execution failed. Error : {error}")
mlc.script_action.ScriptExecutionError: Script run execution failed. Error : MLC script failed (name = benchmark-program, return code = 34304)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Please file an issue at https://github.com/mlcommons/mlperf-automations/issues along with the full MLC command being run and the relevant
or full console log.