Vtune Injector error

Developer Software Tools Analyzers
1

I have an MPI Fortran program that I want to profile. It runs on small mpif90 programs like matrix addition perfectly but throws the following error when I run the actual program I want to profile. I ran it using the following command, it runs the program till the end and throws the following error before compiling the profile results

command: mpirun -np 4 vtune -collect hotspots -r results ./exe

Error: vtune: Error: [Instrumentation Engine]: ParentExecAppWithInjectorControl(injector launcher): Injector (44383) was terminated by a signal: 11
vtune: Collection failed.
vtune: Internal Error

Alternatively I also tried launching the mpi program directly from vtune which also resulted in the following error.

command: vtune -collect hotspots mpirun -np 4 ./exe

Error: [proxy:0:0@cfdlab5] HYD_spawn (../../../../../src/pm/i_hydra/libhydra/spawn/intel/hydra_spawn.c:91): dup2 error (Device or resource busy)
[proxy:0:0@cfdlab5] launch_processes (../../../../../src/pm/i_hydra/proxy/proxy.c:727): error creating process
[proxy:0:0@cfdlab5] main (../../../../../src/pm/i_hydra/proxy/proxy.c:1060): error launching_processes
[proxy:0:0@cfdlab5] HYD_spawn (../../../../../src/pm/i_hydra/libhydra/spawn/intel/hydra_spawn.c:91): dup2 error (Device or resource busy)
[proxy:0:0@cfdlab5] launch_processes (../../../../../src/pm/i_hydra/proxy/proxy.c:727): error creating process
[proxy:0:0@cfdlab5] main (../../../../../src/pm/i_hydra/proxy/proxy.c:1060): error launching_processes
[proxy:0:0@cfdlab5] HYD_spawn (../../../../../src/pm/i_hydra/libhydra/spawn/intel/hydra_spawn.c:98): dup2 error (Device or resource busy)
[proxy:0:0@cfdlab5] launch_processes (../../../../../src/pm/i_hydra/proxy/proxy.c:727): error creating process
[proxy:0:0@cfdlab5] main (../../../../../src/pm/i_hydra/proxy/proxy.c:1060): error launching_processes

2

Just to clarify, this runs correctly when you run it outside of VTune? What if you run the following:

vtune -collect hotspots -knob sampling-mode=hw -knob enable-stack-collection=true -- mpirun -np 4 ,/exe

If you are using Intel MPI, you can try the following command:

mpirun -np 4 -gtool “vtune -collect hotspots:0-3” ./exe

I will keep investigating the error. It looks like one of the processes terminates unexpectedly and the instrumentation injector can’t properly detach.