no devices found when trying to run a demo using the option -d HDDL
I have been having this issue since around a week and still have no idea how to solve it.
Here is the last part of the output I get when I run any one of the demos by running sudo -E ./demo_squeezenet_download_convert_run.sh -d HDDL
:
Run Inference Engine classification sample Run ./classification_sample_async -d HDDL -i /opt/intel/openvino_2020.2.120/deployment_tools/demo/car.png -m /home/nvr/openvino_models/ir/public/squeezenet1.1/FP16/squeezenet1.1.xml [ INFO ] InferenceEngine: API version ............ 2.1 Build .................. 42025 Description ....... API [ INFO ] Parsing input parameters [ INFO ] Parsing input parameters [ INFO ] Files were added: 1 [ INFO ] /opt/intel/openvino_2020.2.120/deployment_tools/demo/car.png [ INFO ] Creating Inference Engine HDDL HDDLPlugin version ......... 2.1 Build ........... custom_releases/2020/2_d8830cd2bfe6199444299be1d92b281e5459f195 [ INFO ] Loading network files [ INFO ] Preparing input blobs [ WARNING ] Image is resized from (787, 259) to (227, 227) [ INFO ] Batch size is 1 [ INFO ] Loading model to the device [14:12:30.8923][24788]I[main.cpp:243] ## HDDL_INSTALL_DIR: /opt/intel/openvino_2020.2.120/deployment_tools/inference_engine/external/hddl [14:12:30.8927][24788]I[main.cpp:245] Config file '/opt/intel/openvino_2020.2.120/deployment_tools/inference_engine/external/hddl/config/hddl_service.config' has been loaded [14:12:30.8947][24788]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_service_alive.mutex owner: user-'no_change', group-'users', mode-'0660' [14:12:30.8949][24788]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_service_ready.mutex owner: user-'no_change', group-'users', mode-'0660' [14:12:30.8951][24788]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_start_exit.mutex owner: user-'no_change', group-'users', mode-'0660' [14:12:30.8994][24788]I[AutobootStarter.cpp:156] Info: No running autoboot process. Start autoboot daemon... [14:12:30.9794][24792]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_autoboot_alive.mutex owner: user-'no_change', group-'users', mode-'0660' [14:12:30.9802][24792]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_autoboot_ready.mutex owner: user-'no_change', group-'users', mode-'0660' [14:12:30.9807][24792]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_autoboot_start_exit.mutex owner: user-'no_change', group-'users', mode-'0660' [14:12:30.9812][24792]I[FileHelper.cpp:272] Set file:/tmp/hddl_autoboot_device.map owner: user-'no_change', group-'users', mode-'0660' [14:12:30.9838][24792]I[AutoBoot.cpp:308] [Firmware Config] deviceName=default deviceNum=0 firmwarePath=/opt/intel/openvino_2020.2.120/deployment_tools/inference_engine/external/hddl/lib/mvnc/usb-ma2x8x.mvcmd [14:12:51.3108][24788]I[AutobootStarter.cpp:85] Info: Autoboot is running. [14:12:51.3492][24788]I[TaskSchedulerFactory.cpp:45] Info: ## TaskSchedulerFactory ## Created Polling Task-Scheduler. [14:12:51.3514][24788]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_snapshot.sock owner: user-'no_change', group-'users', mode-'0660' [14:12:51.3557][24788]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_service.sock owner: user-'no_change', group-'users', mode-'0660' [14:12:51.3564][24788]I[MessageDispatcher.cpp:87] Message Dispatcher initialization finished [14:12:51.3567][24788]I[main.cpp:103] SERVICE IS READY ... [14:12:51.4492][24847]I[ClientManager.cpp:159] client(id:1) registered: clientName=HDDLPlugin socket=2 [14:12:51.4813][24847]I[ClientManager.cpp:189] client(id:1) unregistered: clientName=HDDLPlugin socket=2 [ ERROR ] no devices found Error on or near line 217; exiting with status 1
when I run the python script hello_query_device.py, both the CPU and HDDL devices appear:
/opt/intel/openvino_2020.2.120/deployment_tools/inference_engine/samples/python/hello_query_device$ python3 hello_query_device.py Available devices: Device: CPU Metrics: AVAILABLE_DEVICES: SUPPORTED_METRICS: AVAILABLE_DEVICES, SUPPORTED_METRICS, FULL_DEVICE_NAME, OPTIMIZATION_CAPABILITIES, SUPPORTED_CONFIG_KEYS, RANGE_FOR_ASYNC_INFER_REQUESTS, RANGE_FOR_STREAMS FULL_DEVICE_NAME: Intel(R) Celeron(R) CPU J1900 @ 1.99GHz OPTIMIZATION_CAPABILITIES: FP32, INT8, BIN SUPPORTED_CONFIG_KEYS: CPU_BIND_THREAD, CPU_THREADS_NUM, CPU_THROUGHPUT_STREAMS, DUMP_EXEC_GRAPH_AS_DOT, DYN_BATCH_ENABLED, DYN_BATCH_LIMIT, EXCLUSIVE_ASYNC_REQUESTS, PERF_COUNT RANGE_FOR_ASYNC_INFER_REQUESTS: 1, 1, 1 RANGE_FOR_STREAMS: 1, 4 Default values for device configuration keys: CPU_BIND_THREAD: YES CPU_THREADS_NUM: 0 CPU_THROUGHPUT_STREAMS: 1 DUMP_EXEC_GRAPH_AS_DOT: DYN_BATCH_ENABLED: NO DYN_BATCH_LIMIT: 0 EXCLUSIVE_ASYNC_REQUESTS: NO PERF_COUNT: NO Device: HDDL Metrics: AVAILABLE_DEVICES: SUPPORTED_METRICS: AVAILABLE_DEVICES, SUPPORTED_METRICS, SUPPORTED_CONFIG_KEYS, FULL_DEVICE_NAME, OPTIMIZATION_CAPABILITIES, RANGE_FOR_ASYNC_INFER_REQUESTS, VPU_HDDL_DEVICE_NUM, VPU_HDDL_DEVICE_NAME, VPU_HDDL_DEVICE_THERMAL, VPU_HDDL_DEVICE_ID, VPU_HDDL_DEVICE_SUBCLASS, VPU_HDDL_DEVICE_MEMORY_TOTAL, VPU_HDDL_DEVICE_MEMORY_USED, VPU_HDDL_DEVICE_UTILIZATION, VPU_HDDL_DEVICE_TAG, VPU_HDDL_STREAM_ID SUPPORTED_CONFIG_KEYS: PERF_COUNT, VPU_INPUT_NORM, VPU_INPUT_BIAS, VPU_HDDL_GRAPH_TAG, VPU_HDDL_STREAM_ID, VPU_HDDL_DEVICE_TAG, VPU_HDDL_BIND_DEVICE, VPU_HDDL_RUNTIME_PRIORITY, VPU_HDDL_USE_SGAD, VPU_COPY_OPTIMIZATION, LOG_LEVEL, VPU_IGNORE_UNKNOWN_LAYERS, VPU_HW_STAGES_OPTIMIZATION, VPU_NONE_LAYERS, VPU_NUMBER_OF_SHAVES, VPU_NUMBER_OF_CMX_SLICES, VPU_HW_INJECT_STAGES, VPU_HW_POOL_CONV_MERGE, VPU_HW_STAGES_OPTIMIZATION, EXCLUSIVE_ASYNC_REQUESTS FULL_DEVICE_NAME: Intel Vision Accelerator Design with Intel Movidius VPUs OPTIMIZATION_CAPABILITIES: FP16 RANGE_FOR_ASYNC_INFER_REQUESTS: 0, 2000, 1 VPU_HDDL_DEVICE_NUM: 0 VPU_HDDL_DEVICE_NAME: VPU_HDDL_DEVICE_THERMAL: VPU_HDDL_DEVICE_ID: VPU_HDDL_DEVICE_SUBCLASS: VPU_HDDL_DEVICE_MEMORY_TOTAL: VPU_HDDL_DEVICE_MEMORY_USED: VPU_HDDL_DEVICE_UTILIZATION: VPU_HDDL_DEVICE_TAG: VPU_HDDL_STREAM_ID: Default values for device configuration keys: PERF_COUNT: VPU_INPUT_NORM: VPU_INPUT_BIAS: VPU_HDDL_GRAPH_TAG: VPU_HDDL_STREAM_ID: VPU_HDDL_DEVICE_TAG: VPU_HDDL_BIND_DEVICE: VPU_HDDL_RUNTIME_PRIORITY: VPU_HDDL_USE_SGAD: VPU_COPY_OPTIMIZATION: LOG_LEVEL: VPU_IGNORE_UNKNOWN_LAYERS: VPU_HW_STAGES_OPTIMIZATION: VPU_NONE_LAYERS: VPU_NUMBER_OF_SHAVES: VPU_NUMBER_OF_CMX_SLICES: VPU_HW_INJECT_STAGES: VPU_HW_POOL_CONV_MERGE: VPU_HW_STAGES_OPTIMIZATION: EXCLUSIVE_ASYNC_REQUESTS:
and the process 'hddldaemon' logs the following two lines:
[09:33:45.7696][24847]I[ClientManager.cpp:159] client(id:6) registered: clientName=HDDLPluginForQuery socket=2 [09:33:45.7955][24847]I[ClientManager.cpp:189] client(id:6) unregistered: clientName=HDDLPluginForQuery socket=2
When I run lsusb, the mpcie does not appear. I have the mpcie connected
to the mpcie slot on the motherboard.
The demo runs successfully using the option -d CPU (intel J1900)
The demo also runs successfully using the option -d MYRIAD, as I have a
neural compute stick 2 (NCS2)
I am using ubuntu 18.04 and openvino 2020.2.120
One last note: I was able to run the demo successfully on the HDDL only
once, and immediately after that, I ran the same command and the same
error above came back.
Comments
-
Try to remove the power completely and then apply power again and start the system.
Then run lsusb with only the MiniPCIe AI Core-X connected and check if you can see the device.
Then run again the sample
Also please consider that, even if it should most likely work, only OpenVINO 2019.3 and 2020.3 LTS have been tested and we don't know if other bugs may be present in other revisions which makes the module not work correctly.
-
I tried to remove the power completely multiple times and no change.
So you suggest to upgrade openvino to a newer version? Did you mean 2020.3 instead of 2019.3?
-
you can use one or the other.
Follow the instructions to setup OpenVINO on Linux and then install the HDDL drivers:
1. https://docs.openvinotoolkit.org/latest/_docs_install_guides_installing_openvino_linux.html
2. https://docs.openvinotoolkit.org/latest/_docs_install_guides_installing_openvino_linux_ivad_vpu.html -
It turned out to be a motherboard issue. I tried on similar motherboard and it worked.
Thanks.