Compile BiseNetv2 model for NPU

Developer Software Tools Intel® Distribution of OpenVINO™ Toolkit
1

Hello,

I try to use the benchmark_app on a BiseNetv2 model and on NPU device, but the compilation process never ends.

If I choose CPU or NPU every think works fine. I also try with a mobilenet model and it works for all devices.

It seems related to this model on this device…

How could I get more information why the compilation failed ?

Here are my configuration:

System : Intel Core Ultra7 155H

Operating System : Windows 11 (I also try on Ubuntu 22.04)

OpenVino 2024.5.0

NPU driver : 2024.5.0

Thanks for your answer.

2

Hi Maick,

Thanks for reaching out. Can you reconfirm again which plugin is working fine with the BiseNetv2 model? For further checking, you may share the model files (.xml and .bin).

Regards,

Aznie

3

Hi Azine,

Thanks for your answer.

Sorry for the typo, it works fine with CPU and GPU.

I attached the .xml and .bin of the model.

Regards,

Maïck

bisnetv2.zip (5.82 MB)

4

Hi Maick,

Thanks for the model files. We are checking this with the engineering team and will get back to you once the information is available.

Regards,

Aznie

5

Hi, Maick,

Could you please share your NPU driver version with us? OpenVINO developers have reproduced the case without any compilation or inference problems, neither for fp16 nor for quantized (fp16-int8) model version. So our recommendation would be to upgrade to the latest available driver version ( Release Linux NPU Driver v1.10.0 · intel/linux-npu-driver · GitHub ). By the way, is your setup MTL or LNL?

6

Hi, Thanks for your answer ! Here is what I just tried :

I still have the same behavior,  the script is blocked on step 7, it cannot build the model. I don’t understand what you mean by MTL or LNL ?

7

Thank you for your feedback. MTL is short for Meteor Lake and LNL for Lunar Lake chip family.

8

Please bear with us. I relayed your results to the developers but there has been no response yet.

9

Thank you for your patience. I haven’t received any follow-up from the developers yet. I will try to obtain more information before our next planned meeting on January 15th.

10

I don’t have any response from the developers yet. I will try to contact them directly.

11

As of now, developer response is still pending. Please bear with us.

12

Hello, thank you for your patience. There’s a new developer looking at your issue. Just a small follow-up question - are NPU driver versions identical in your Windows and Ubuntu instances?

13

Hello,

Thanks for your feedback, yes I try with 2024.5 on Ubuntu and Windows.

Best regards,

Maïck

14

Thank you very much for your response, I will relay this to the developer.

15

Hi Maick,

Thank you for your patience. I don’t have a response from the developers yet but i will highlight your issue during our sync meeting on Wednesday. Hopefully, I will be able to provide more assistance by then.

16

Hi Maick,

in a meeting with developers I learnt that your OpenVINO version is a bit special. 2024.5 requires NPU driver 32.0.100.3052/3053 on Windows but doesn’t have a Linux equivalent driver. One option would be to upgrade to OpenVINO 2024.6 or 2025.0 (compatible with 1.10.1 Linux driver). Another one to downgrade to 2024.4 (Linux driver 1.8). Would one of those solve your issue?

17

Hi,

I try with OpenVIno 2024.6 and 1.10.1 linux driver but the issue is still the same.

I also try with the same model but with a smaller input shape and it works fine. Maybe it could be helpful for you.

Best regards,

Maïck

18

Thank you for your feedback. Can you share the smaller model’s name and source? I would consult it with the developers then.

19

Please find attached the smaller model.

bisenetv2_256x512_cityscapes.zip (12 MB)

20

Thank you for the smaller model, we will try it out and get back to you.