Repository: spack/spack

Issue:
openblas: fix link error in dependent packages.
fixed #21500 
Fujitsu Compiler dose not add  Fortran runtime in rpath.
This PR add LDFLAGS to fortan rantime libraries to add rpath on libopenblas.so.



Discussion:
Thank you for your contribution!
I'm sorry I am still getting build error on A64FX.
> I'm sorry I am still getting build error on A64FX.

Uh oh.  Should this PR be reverted or a new PR be created with the necessary fix?
```

$ spack install eigenexa
==> Warning: Missing a source id for fujitsu-mpi@3.0.0
[+] /vol0001/apps/oss/spack-v0.15.4/opt/spack/linux-rhel8-a64fx/fj-4.3.1/libsigsegv-2.12-2qhyocuw5rawo6tpqegh2xdaf623424q
[+] /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/berkeley-db-18.1.40-7dknf2wwpxx46qs4my6ahjivwozjzko3
[+] /vol0001/apps/oss/spack-v0.15.4/opt/spack/linux-rhel8-a64fx/fj-4.3.1/pkgconf-1.7.3-tkl6xodj7b7z63l7vmdakcknxo5ryend
==> fujitsu-mpi@3.0.0 : has external module in ['lang/tcsds-1.2.29']
[+] /opt/FJSVxtclanga/tcsds-1.2.29 (external fujitsu-mpi-3.0.0-nxj276sc2a4ppyq4wzew367ozc66agrh)
[+] /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/zlib-1.2.11-4cjuefhcsr5mnrfuxk7umqxhm5wwmtqf
[+] /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3
[+] /vol0001/apps/oss/spack-v0.15.4/opt/spack/linux-rhel8-a64fx/fj-4.3.1/m4-1.4.18-tajkcerbik3rbijuxty6rgp6dxk2qlvc
[+] /vol0001/apps/oss/spack-v0.15.4/opt/spack/linux-rhel8-a64fx/fj-4.3.1/ncurses-6.2-guk7ofvdpkdnrrhrannhuaji565i7buz
[+] /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/libtool-2.4.6-4iab5ptr3vmwfswxmz47irl7lgf35umt
[+] /vol0001/apps/oss/spack-v0.15.4/opt/spack/linux-rhel8-a64fx/fj-4.3.1/readline-8.0-n6urhogkjprjmdc7ivkh6bm7jb5xoi46
[+] /vol0001/apps/oss/spack-v0.15.4/opt/spack/linux-rhel8-a64fx/fj-4.3.1/gdbm-1.18.1-f5oceq4pkvekl6kaiplma2j75oiywr6q
[+] /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/perl-5.32.1-iami2xygpu2b4vbjzqqrlhkzzpnu33cz
[+] /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/openssl-1.1.1i-aybeapnv4ig4pw55ylgs6czo35sy4ygg
[+] /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/autoconf-2.69-hwhwi3lfeoc4rg3ffcybtgrhnkredbew
[+] /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/cmake-3.19.4-zwpel7jxqlt55fuhgzg2ui2wje34egwz
[+] /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/automake-1.16.3-k33afq3yuurzfhwu64a5cyyo6fag2yqe
==> Installing netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf
==> No binary for netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf found: installing from source
==> Using cached archive: /vol0004/hp200139/data/u00444/projects/spack/var/spack/cache/_source-cache/archive/61/61d9216cf81d246944720cfce96255878a3f85dec13b9351f1fa0fd6768220a6.tgz
==> Applied patch /vol0004/hp200139/data/u00444/projects/spack/var/spack/repos/builtin/packages/netlib-scalapack/int_overflow.patch
==> Applied patch /vol0004/hp200139/data/u00444/projects/spack/var/spack/repos/builtin/packages/netlib-scalapack/gcc10-compatibility.patch
==> netlib-scalapack: Executing phase: 'cmake'
==> netlib-scalapack: Executing phase: 'build'
==> Error: ProcessError: Command exited with status 2:
    'make' '-j16'

259 errors found in build log:
     5493    /data/hp200139/u00444/u00444/spack-stage/spack-stage-netlib-scalap
             ack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-src/REDIST/TESTIN
             G/pdtrmrdrv.c:489:7: warning: add explicit braces to avoid danglin
             g else [-Wdangling-else]
     5494          else
     5495          ^
     5496    Fortran diagnostic messages: program name(PILAENV)
     5497      jwd2008i-i  "/data/hp200139/u00444/u00444/spack-stage/spack-stag
             e-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-sr
             c/PBLAS/TIMING/pblastim.f", line 4452: Dummy argument 'PREC' not u
             sed in this subprogram.
     5498      jwd2008i-i  "/data/hp200139/u00444/u00444/spack-stage/spack-stag
             e-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-sr
             c/PBLAS/TIMING/pblastim.f", line 4452: Dummy argument 'ICTXT' not
             used in this subprogram.
  >> 5499    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_atan2'
  >> 5500    ../../lib/libscalapack.so: undefined reference to `__f_scmov'
  >> 5501    ../../lib/libscalapack.so: undefined reference to `__g_log10'
  >> 5502    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__f_aixi'
  >> 5503    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_datan2'
  >> 5504    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_csin'
  >> 5505    ../../lib/libscalapack.so: undefined reference to `__g_dlog'
  >> 5506    ../../lib/libscalapack.so: undefined reference to `__g_adxi'
  >> 5507    ../../lib/libscalapack.so: undefined reference to `__pkvla_cdexp'
  >> 5508    ../../lib/libscalapack.so: undefined reference to `__g_cexp'
  >> 5509    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_acxi'
  >> 5510    ../../lib/libscalapack.so: undefined reference to `__f_ccomp'
  >> 5511    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_axxi'
  >> 5512    ../../lib/libscalapack.so: undefined reference to `__g_arxr'
  >> 5513    ../../lib/libscalapack.so: undefined reference to `__g_dlog10'
  >> 5514    ../../lib/libscalapack.so: undefined reference to `__g_arxi'
  >> 5515    ../../lib/libscalapack.so: undefined reference to `__g_adxd'
  >> 5516    ../../lib/libscalapack.so: undefined reference to `__g_scns'
  >> 5517    ../../lib/libscalapack.so: undefined reference to `__jwe_isfm'
  >> 5518    ../../lib/libscalapack.so: undefined reference to `__g_csqrt'
  >> 5519    ../../lib/libscalapack.so: undefined reference to `__jwe_iocf'
  >> 5520    ../../lib/libscalapack.so: undefined reference to `__g_dexp'
  >> 5521    ../../lib/libscalapack.so: undefined reference to `__g_dcos'
  >> 5522    ../../lib/libscalapack.so: undefined reference to `__g_cdexp'
  >> 5523    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_cdsin'
  >> 5524    ../../lib/libscalapack.so: undefined reference to `__g_cdsqrt'
  >> 5525    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_sin'
  >> 5526    ../../lib/libscalapack.so: undefined reference to `__g_log'
  >> 5527    ../../lib/libscalapack.so: undefined reference to `__jwe_ilst'
  >> 5528    ../../lib/libscalapack.so: undefined reference to `__g_exp'
  >> 5529    ../../lib/libscalapack.so: undefined reference to `__g_dscn'
  >> 5530    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_dsin'
  >> 5531    ../../lib/libscalapack.so: undefined reference to `__pkvla_cexp'
     5532    /data/hp200139/u00444/u00444/spack-stage/spack-stage-netlib-scalap
             ack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-src/REDIST/TESTIN
             G/pstrmrdrv.c:154:9: warning: 'NDEBUG' macro redefined [-Wmacro-re
             defined]
     5533    #define NDEBUG
     5534            ^
     5535    <command line>:2:9: note: previous definition is here
     5536    #define NDEBUG 1
     5537            ^
  >> 5538    ../../lib/libscalapack.so: undefined reference to `__g_cos'
  >> 5539    clang-7: error: linker command failed with exit code 1 (use -v to
             see invocation)
  >> 5540    make[2]: *** [REDIST/TESTING/CMakeFiles/xitrmr.dir/build.make:108:
              scalapack/REDIST/TESTING/xitrmr] Error 1
     5541    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
  >> 5542    make[1]: *** [CMakeFiles/Makefile2:2199: REDIST/TESTING/CMakeFiles
             /xitrmr.dir/all] Error 2
     5543    make[1]: *** Waiting for unfinished jobs....
     5544    [ 70%] Building Fortran object PBLAS/TIMING/CMakeFiles/cpb1tim.dir
             /pcblastim.f.o
     5545    cd /vol0004/hp200139/data/u00444/u00444/spack-stage/spack-stage-ne
             tlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-build-
             g6pr6ui/PBLAS/TIMING && /opt/FJSVxtclanga/tcsds-1.2.29/bin/mpifrt
             -DAdd_ -I/opt/FJSVxtclanga/.common/MECA022/include/mpi/fujitsu  -c
              /data/hp200139/u00444/u00444/spack-stage/spack-stage-netlib-scala
             pack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-src/PBLAS/TIMING
             /pcblastim.f -o CMakeFiles/cpb1tim.dir/pcblastim.f.o
     5546    /data/hp200139/u00444/u00444/spack-stage/spack-stage-netlib-scalap
             ack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-src/REDIST/TESTIN
             G/pctrmrdrv.c:158:9: warning: 'NDEBUG' macro redefined [-Wmacro-re
             defined]
     5547    #define NDEBUG
     5548            ^

     ...

     5571    cd /vol0004/hp200139/data/u00444/u00444/spack-stage/spack-stage-ne
             tlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-build-
             g6pr6ui/PBLAS/TIMING && /opt/FJSVxtclanga/tcsds-1.2.29/bin/mpifcc
             -DAdd_ -DTestingPblas -I/opt/FJSVxtclanga/.common/MECA022/include/
             mpi/fujitsu -O3 -DNDEBUG -o CMakeFiles/cpb1tim.dir/PB_Cwarn.c.o -c
              /data/hp200139/u00444/u00444/spack-stage/spack-stage-netlib-scala
             pack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-src/PBLAS/TIMING
             /PB_Cwarn.c
     5572    [ 70%] Linking C executable ../../scalapack/REDIST/TESTING/xdtrmr
     5573    cd /vol0004/hp200139/data/u00444/u00444/spack-stage/spack-stage-ne
             tlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-build-
             g6pr6ui/REDIST/TESTING && /vol0004/hp200139/data/u00444/projects/s
             pack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/cmake-3.19.4-zwpel7jxqlt
             55fuhgzg2ui2wje34egwz/bin/cmake -E cmake_link_script CMakeFiles/xd
             trmr.dir/link.txt --verbose=1
     5574    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
     5575    /opt/FJSVxtclanga/tcsds-1.2.29/bin/mpifcc -O3 -DNDEBUG -rdynamic C
             MakeFiles/xdtrmr.dir/pdtrmrdrv.c.o -o ../../scalapack/REDIST/TESTI
             NG/xdtrmr  -Wl,-rpath,/vol0004/hp200139/data/u00444/u00444/spack-s
             tage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4u
             uloplf/spack-build-g6pr6ui/lib:/vol0004/hp200139/data/u00444/proje
             cts/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/openblas-0.3.13-p25
             uejlm4zj6shfftneop7adgpbbvvh3/lib ../../lib/libscalapack.so /vol00
             04/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx
             /fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/lib/lib
             openblas.so
     5576    [ 70%] Built target dpb1tim
  >> 5577    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_atan2'
  >> 5578    ../../lib/libscalapack.so: undefined reference to `__f_scmov'
  >> 5579    ../../lib/libscalapack.so: undefined reference to `__g_log10'
  >> 5580    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__f_aixi'
  >> 5581    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_datan2'
  >> 5582    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_csin'
  >> 5583    ../../lib/libscalapack.so: undefined reference to `__g_dlog'
  >> 5584    ../../lib/libscalapack.so: undefined reference to `__g_adxi'
  >> 5585    ../../lib/libscalapack.so: undefined reference to `__pkvla_cdexp'
  >> 5586    ../../lib/libscalapack.so: undefined reference to `__g_cexp'
  >> 5587    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_acxi'
  >> 5588    ../../lib/libscalapack.so: undefined reference to `__f_ccomp'
  >> 5589    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_axxi'
  >> 5590    ../../lib/libscalapack.so: undefined reference to `__g_arxr'
  >> 5591    ../../lib/libscalapack.so: undefined reference to `__g_dlog10'
  >> 5592    ../../lib/libscalapack.so: undefined reference to `__g_arxi'
  >> 5593    ../../lib/libscalapack.so: undefined reference to `__g_adxd'
  >> 5594    ../../lib/libscalapack.so: undefined reference to `__g_scns'
  >> 5595    ../../lib/libscalapack.so: undefined reference to `__jwe_isfm'
  >> 5596    ../../lib/libscalapack.so: undefined reference to `__g_csqrt'
  >> 5597    ../../lib/libscalapack.so: undefined reference to `__jwe_iocf'
  >> 5598    ../../lib/libscalapack.so: undefined reference to `__g_dexp'
  >> 5599    ../../lib/libscalapack.so: undefined reference to `__g_dcos'
  >> 5600    ../../lib/libscalapack.so: undefined reference to `__g_cdexp'
  >> 5601    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_cdsin'
  >> 5602    ../../lib/libscalapack.so: undefined reference to `__g_cdsqrt'
  >> 5603    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_sin'
  >> 5604    ../../lib/libscalapack.so: undefined reference to `__g_log'
  >> 5605    ../../lib/libscalapack.so: undefined reference to `__jwe_ilst'
  >> 5606    ../../lib/libscalapack.so: undefined reference to `__g_exp'
  >> 5607    ../../lib/libscalapack.so: undefined reference to `__g_dscn'
  >> 5608    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_dsin'
  >> 5609    ../../lib/libscalapack.so: undefined reference to `__pkvla_cexp'
  >> 5610    ../../lib/libscalapack.so: undefined reference to `__g_cos'
     5611    [ 70%] Building C object PBLAS/TIMING/CMakeFiles/cpb1tim.dir/PB_Ca
             bort.c.o
     5612    cd /vol0004/hp200139/data/u00444/u00444/spack-stage/spack-stage-ne
             tlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-build-
             g6pr6ui/PBLAS/TIMING && /opt/FJSVxtclanga/tcsds-1.2.29/bin/mpifcc
             -DAdd_ -DTestingPblas -I/opt/FJSVxtclanga/.common/MECA022/include/
             mpi/fujitsu -O3 -DNDEBUG -o CMakeFiles/cpb1tim.dir/PB_Cabort.c.o -
             c /data/hp200139/u00444/u00444/spack-stage/spack-stage-netlib-scal
             apack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-src/PBLAS/TIMIN
             G/PB_Cabort.c
  >> 5613    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_atan2'
  >> 5614    ../../lib/libscalapack.so: undefined reference to `__f_scmov'
  >> 5615    ../../lib/libscalapack.so: undefined reference to `__g_log10'
  >> 5616    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__f_aixi'
  >> 5617    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_datan2'
  >> 5618    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_csin'
  >> 5619    ../../lib/libscalapack.so: undefined reference to `__g_dlog'
  >> 5620    ../../lib/libscalapack.so: undefined reference to `__g_adxi'
  >> 5621    ../../lib/libscalapack.so: undefined reference to `__pkvla_cdexp'
  >> 5622    ../../lib/libscalapack.so: undefined reference to `__g_cexp'
  >> 5623    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_acxi'
  >> 5624    ../../lib/libscalapack.so: undefined reference to `__f_ccomp'
  >> 5625    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_axxi'
  >> 5626    ../../lib/libscalapack.so: undefined reference to `__g_arxr'
  >> 5627    ../../lib/libscalapack.so: undefined reference to `__g_dlog10'
  >> 5628    ../../lib/libscalapack.so: undefined reference to `__g_arxi'
  >> 5629    ../../lib/libscalapack.so: undefined reference to `__g_adxd'
  >> 5630    ../../lib/libscalapack.so: undefined reference to `__g_scns'
  >> 5631    ../../lib/libscalapack.so: undefined reference to `__jwe_isfm'
  >> 5632    ../../lib/libscalapack.so: undefined reference to `__g_csqrt'
  >> 5633    ../../lib/libscalapack.so: undefined reference to `__jwe_iocf'
  >> 5634    ../../lib/libscalapack.so: undefined reference to `__g_dexp'
  >> 5635    ../../lib/libscalapack.so: undefined reference to `__g_dcos'
  >> 5636    ../../lib/libscalapack.so: undefined reference to `__g_cdexp'
  >> 5637    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_cdsin'
  >> 5638    ../../lib/libscalapack.so: undefined reference to `__g_cdsqrt'
  >> 5639    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_sin'
  >> 5640    ../../lib/libscalapack.so: undefined reference to `__g_log'
  >> 5641    ../../lib/libscalapack.so: undefined reference to `__jwe_ilst'
  >> 5642    ../../lib/libscalapack.so: undefined reference to `__g_exp'
  >> 5643    ../../lib/libscalapack.so: undefined reference to `__g_dscn'
  >> 5644    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_dsin'
  >> 5645    ../../lib/libscalapack.so: undefined reference to `__pkvla_cexp'
  >> 5646    ../../lib/libscalapack.so: undefined reference to `__g_cos'
     5647    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
     5648    [ 70%] Built target cpb3tim
  >> 5649    clang-7: error: linker command failed with exit code 1 (use -v to
             see invocation)
  >> 5650    make[2]: *** [REDIST/TESTING/CMakeFiles/xdgemr.dir/build.make:108:
              scalapack/REDIST/TESTING/xdgemr] Error 1
     5651    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
  >> 5652    make[1]: *** [CMakeFiles/Makefile2:2226: REDIST/TESTING/CMakeFiles
             /xdgemr.dir/all] Error 2
     5653    2 warnings generated.
  >> 5654    clang-7: error: linker command failed with exit code 1 (use -v to
             see invocation)
     5655    [ 71%] Linking C executable ../../scalapack/REDIST/TESTING/xstrmr
     5656    cd /vol0004/hp200139/data/u00444/u00444/spack-stage/spack-stage-ne
             tlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-build-
             g6pr6ui/REDIST/TESTING && /vol0004/hp200139/data/u00444/projects/s
             pack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/cmake-3.19.4-zwpel7jxqlt
             55fuhgzg2ui2wje34egwz/bin/cmake -E cmake_link_script CMakeFiles/xs
             trmr.dir/link.txt --verbose=1
  >> 5657    make[2]: *** [REDIST/TESTING/CMakeFiles/xigemr.dir/build.make:108:
              scalapack/REDIST/TESTING/xigemr] Error 1
     5658    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
  >> 5659    make[1]: *** [CMakeFiles/Makefile2:2253: REDIST/TESTING/CMakeFiles
             /xigemr.dir/all] Error 2
     5660    2 warnings generated.
     5661    /opt/FJSVxtclanga/tcsds-1.2.29/bin/mpifcc -O3 -DNDEBUG -rdynamic C
             MakeFiles/xstrmr.dir/pstrmrdrv.c.o -o ../../scalapack/REDIST/TESTI
             NG/xstrmr  -Wl,-rpath,/vol0004/hp200139/data/u00444/u00444/spack-s
             tage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4u
             uloplf/spack-build-g6pr6ui/lib:/vol0004/hp200139/data/u00444/proje
             cts/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/openblas-0.3.13-p25
             uejlm4zj6shfftneop7adgpbbvvh3/lib ../../lib/libscalapack.so /vol00
             04/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx
             /fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/lib/lib
             openblas.so
     5662    [ 71%] Linking C executable ../../scalapack/REDIST/TESTING/xctrmr
     5663    cd /vol0004/hp200139/data/u00444/u00444/spack-stage/spack-stage-ne
             tlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-build-
             g6pr6ui/REDIST/TESTING && /vol0004/hp200139/data/u00444/projects/s
             pack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/cmake-3.19.4-zwpel7jxqlt
             55fuhgzg2ui2wje34egwz/bin/cmake -E cmake_link_script CMakeFiles/xc
             trmr.dir/link.txt --verbose=1
     5664    /opt/FJSVxtclanga/tcsds-1.2.29/bin/mpifcc -O3 -DNDEBUG -rdynamic C
             MakeFiles/xctrmr.dir/pctrmrdrv.c.o -o ../../scalapack/REDIST/TESTI
             NG/xctrmr  -Wl,-rpath,/vol0004/hp200139/data/u00444/u00444/spack-s
             tage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4u
             uloplf/spack-build-g6pr6ui/lib:/vol0004/hp200139/data/u00444/proje
             cts/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/openblas-0.3.13-p25
             uejlm4zj6shfftneop7adgpbbvvh3/lib ../../lib/libscalapack.so /vol00
             04/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx
             /fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/lib/lib
             openblas.so
     5665    Fortran diagnostic messages: program name(PB_DRAN)
     5666      jwd2008i-i  "/data/hp200139/u00444/u00444/spack-stage/spack-stag
             e-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-sr
             c/PBLAS/TIMING/pzblastim.f", line 2631: Dummy argument 'IDUMM' not
              used in this subprogram.
     5667    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
     5668    [ 71%] Built target dpb2tim
     5669    [ 71%] Linking Fortran executable zpb2tim
     5670    cd /vol0004/hp200139/data/u00444/u00444/spack-stage/spack-stage-ne
             tlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-build-
             g6pr6ui/PBLAS/TIMING && /vol0004/hp200139/data/u00444/projects/spa
             ck/opt/spack/linux-rhel8-a64fx/fj-4.3.1/cmake-3.19.4-zwpel7jxqlt55
             fuhgzg2ui2wje34egwz/bin/cmake -E cmake_link_script CMakeFiles/zpb2
             tim.dir/link.txt --verbose=1
     5671    /opt/FJSVxtclanga/tcsds-1.2.29/bin/mpifrt -rdynamic CMakeFiles/zpb
             2tim.dir/pzblas2tim.f.o CMakeFiles/zpb2tim.dir/pzblastim.f.o CMake
             Files/zpb2tim.dir/pblastim.f.o CMakeFiles/zpb2tim.dir/PB_Cwarn.c.o
              CMakeFiles/zpb2tim.dir/PB_Cabort.c.o -o zpb2tim   -L/opt/FJSVxtcl
             anga/tcsds-1.2.29/clang-comp/lib64  -L/usr/lib/gcc/aarch64-redhat-
             linux/8  -L/opt/FJSVxtclanga/tcsds-1.2.29/lib64  -L/opt/FJSVxos/mm
             m/lib64  -L/opt/FJSVxtclanga/tcsds-1.2.29/lib64/nofjobj  -Wl,-rpat
             h,/vol0004/hp200139/data/u00444/u00444/spack-stage/spack-stage-net
             lib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-build-g
             6pr6ui/lib:/vol0004/hp200139/data/u00444/projects/spack/opt/spack/
             linux-rhel8-a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7a
             dgpbbvvh3/lib ../../lib/libscalapack.so /vol0004/hp200139/data/u00
             444/projects/spack/opt/spack/linux-rhel8-a64fx/fj-4.3.1/openblas-0
             .3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/lib/libopenblas.so /vol0004
             /hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8-a64fx/f
             j-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/lib/libop
             enblas.so -lfjprofcore -lfjprofomp -lmpg -lm -lrt -lpthread -lelf
             -lz -ldl -lgcc -lgcc_s -lc -lgcc -lgcc_s
  >> 5672    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_atan2'
  >> 5673    ../../lib/libscalapack.so: undefined reference to `__f_scmov'
  >> 5674    ../../lib/libscalapack.so: undefined reference to `__g_log10'
  >> 5675    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__f_aixi'
  >> 5676    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_datan2'
  >> 5677    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_csin'
  >> 5678    ../../lib/libscalapack.so: undefined reference to `__g_dlog'
  >> 5679    ../../lib/libscalapack.so: undefined reference to `__g_adxi'
  >> 5680    ../../lib/libscalapack.so: undefined reference to `__pkvla_cdexp'
  >> 5681    ../../lib/libscalapack.so: undefined reference to `__g_cexp'
  >> 5682    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_acxi'
  >> 5683    ../../lib/libscalapack.so: undefined reference to `__f_ccomp'
  >> 5684    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_axxi'
  >> 5685    ../../lib/libscalapack.so: undefined reference to `__g_arxr'
  >> 5686    ../../lib/libscalapack.so: undefined reference to `__g_dlog10'
  >> 5687    ../../lib/libscalapack.so: undefined reference to `__g_arxi'
  >> 5688    ../../lib/libscalapack.so: undefined reference to `__g_adxd'
  >> 5689    ../../lib/libscalapack.so: undefined reference to `__g_scns'
  >> 5690    ../../lib/libscalapack.so: undefined reference to `__jwe_isfm'
  >> 5691    ../../lib/libscalapack.so: undefined reference to `__g_csqrt'
  >> 5692    ../../lib/libscalapack.so: undefined reference to `__jwe_iocf'
  >> 5693    ../../lib/libscalapack.so: undefined reference to `__g_dexp'
  >> 5694    ../../lib/libscalapack.so: undefined reference to `__g_dcos'
  >> 5695    ../../lib/libscalapack.so: undefined reference to `__g_cdexp'
  >> 5696    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_cdsin'
  >> 5697    ../../lib/libscalapack.so: undefined reference to `__g_cdsqrt'
  >> 5698    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_sin'
  >> 5699    ../../lib/libscalapack.so: undefined reference to `__g_log'
  >> 5700    ../../lib/libscalapack.so: undefined reference to `__jwe_ilst'
  >> 5701    ../../lib/libscalapack.so: undefined reference to `__g_exp'
  >> 5702    ../../lib/libscalapack.so: undefined reference to `__g_dscn'
  >> 5703    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_dsin'
  >> 5704    ../../lib/libscalapack.so: undefined reference to `__pkvla_cexp'
  >> 5705    ../../lib/libscalapack.so: undefined reference to `__g_cos'
  >> 5706    clang-7: error: linker command failed with exit code 1 (use -v to
             see invocation)
  >> 5707    make[2]: *** [REDIST/TESTING/CMakeFiles/xsgemr.dir/build.make:108:
              scalapack/REDIST/TESTING/xsgemr] Error 1
     5708    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
  >> 5709    make[1]: *** [CMakeFiles/Makefile2:2307: REDIST/TESTING/CMakeFiles
             /xsgemr.dir/all] Error 2
  >> 5710    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_atan2'
  >> 5711    ../../lib/libscalapack.so: undefined reference to `__f_scmov'
  >> 5712    ../../lib/libscalapack.so: undefined reference to `__g_log10'
  >> 5713    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__f_aixi'
  >> 5714    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_datan2'
  >> 5715    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_csin'
  >> 5716    ../../lib/libscalapack.so: undefined reference to `__g_dlog'
  >> 5717    ../../lib/libscalapack.so: undefined reference to `__g_adxi'
  >> 5718    ../../lib/libscalapack.so: undefined reference to `__pkvla_cdexp'
  >> 5719    ../../lib/libscalapack.so: undefined reference to `__g_cexp'
  >> 5720    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_acxi'
  >> 5721    ../../lib/libscalapack.so: undefined reference to `__f_ccomp'
  >> 5722    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_axxi'
  >> 5723    ../../lib/libscalapack.so: undefined reference to `__g_arxr'
  >> 5724    ../../lib/libscalapack.so: undefined reference to `__g_dlog10'
  >> 5725    ../../lib/libscalapack.so: undefined reference to `__g_arxi'
  >> 5726    ../../lib/libscalapack.so: undefined reference to `__g_adxd'
  >> 5727    ../../lib/libscalapack.so: undefined reference to `__g_scns'
  >> 5728    ../../lib/libscalapack.so: undefined reference to `__jwe_isfm'
  >> 5729    ../../lib/libscalapack.so: undefined reference to `__g_csqrt'
  >> 5730    ../../lib/libscalapack.so: undefined reference to `__jwe_iocf'
  >> 5731    ../../lib/libscalapack.so: undefined reference to `__g_dexp'
  >> 5732    ../../lib/libscalapack.so: undefined reference to `__g_dcos'
  >> 5733    ../../lib/libscalapack.so: undefined reference to `__g_cdexp'
  >> 5734    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_cdsin'
  >> 5735    ../../lib/libscalapack.so: undefined reference to `__g_cdsqrt'
  >> 5736    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_sin'
  >> 5737    ../../lib/libscalapack.so: undefined reference to `__g_log'
  >> 5738    ../../lib/libscalapack.so: undefined reference to `__jwe_ilst'
  >> 5739    ../../lib/libscalapack.so: undefined reference to `__g_exp'
  >> 5740    ../../lib/libscalapack.so: undefined reference to `__g_dscn'
  >> 5741    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_dsin'
  >> 5742    ../../lib/libscalapack.so: undefined reference to `__pkvla_cexp'
  >> 5743    ../../lib/libscalapack.so: undefined reference to `__g_cos'
  >> 5744    clang-7: error: linker command failed with exit code 1 (use -v to
             see invocation)
  >> 5745    make[2]: *** [REDIST/TESTING/CMakeFiles/xstrmr.dir/build.make:108:
              scalapack/REDIST/TESTING/xstrmr] Error 1
     5746    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
  >> 5747    make[1]: *** [CMakeFiles/Makefile2:2334: REDIST/TESTING/CMakeFiles
             /xstrmr.dir/all] Error 2
  >> 5748    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_atan2'
  >> 5749    ../../lib/libscalapack.so: undefined reference to `__f_scmov'
  >> 5750    ../../lib/libscalapack.so: undefined reference to `__g_log10'
  >> 5751    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__f_aixi'
  >> 5752    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_datan2'
  >> 5753    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_csin'
  >> 5754    ../../lib/libscalapack.so: undefined reference to `__g_dlog'
  >> 5755    ../../lib/libscalapack.so: undefined reference to `__g_adxi'
  >> 5756    ../../lib/libscalapack.so: undefined reference to `__pkvla_cdexp'
  >> 5757    ../../lib/libscalapack.so: undefined reference to `__g_cexp'
  >> 5758    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_acxi'
  >> 5759    ../../lib/libscalapack.so: undefined reference to `__f_ccomp'
  >> 5760    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_axxi'
  >> 5761    ../../lib/libscalapack.so: undefined reference to `__g_arxr'
  >> 5762    ../../lib/libscalapack.so: undefined reference to `__g_dlog10'
  >> 5763    ../../lib/libscalapack.so: undefined reference to `__g_arxi'
  >> 5764    ../../lib/libscalapack.so: undefined reference to `__g_adxd'
  >> 5765    ../../lib/libscalapack.so: undefined reference to `__g_scns'
  >> 5766    ../../lib/libscalapack.so: undefined reference to `__jwe_isfm'
  >> 5767    ../../lib/libscalapack.so: undefined reference to `__g_csqrt'
  >> 5768    ../../lib/libscalapack.so: undefined reference to `__jwe_iocf'
  >> 5769    ../../lib/libscalapack.so: undefined reference to `__g_dexp'
  >> 5770    ../../lib/libscalapack.so: undefined reference to `__g_dcos'
  >> 5771    ../../lib/libscalapack.so: undefined reference to `__g_cdexp'
  >> 5772    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_cdsin'
  >> 5773    ../../lib/libscalapack.so: undefined reference to `__g_cdsqrt'
  >> 5774    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_sin'
  >> 5775    ../../lib/libscalapack.so: undefined reference to `__g_log'
  >> 5776    ../../lib/libscalapack.so: undefined reference to `__jwe_ilst'
  >> 5777    ../../lib/libscalapack.so: undefined reference to `__g_exp'
  >> 5778    ../../lib/libscalapack.so: undefined reference to `__g_dscn'
  >> 5779    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_dsin'
  >> 5780    ../../lib/libscalapack.so: undefined reference to `__pkvla_cexp'
  >> 5781    ../../lib/libscalapack.so: undefined reference to `__g_cos'
  >> 5782    clang-7: error: linker command failed with exit code 1 (use -v to
             see invocation)
  >> 5783    make[2]: *** [REDIST/TESTING/CMakeFiles/xctrmr.dir/build.make:108:
              scalapack/REDIST/TESTING/xctrmr] Error 1
     5784    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
  >> 5785    make[1]: *** [CMakeFiles/Makefile2:2361: REDIST/TESTING/CMakeFiles
             /xctrmr.dir/all] Error 2
  >> 5786    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_atan2'
  >> 5787    ../../lib/libscalapack.so: undefined reference to `__f_scmov'
  >> 5788    ../../lib/libscalapack.so: undefined reference to `__g_log10'
  >> 5789    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__f_aixi'
  >> 5790    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_datan2'
  >> 5791    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_csin'
  >> 5792    ../../lib/libscalapack.so: undefined reference to `__g_dlog'
  >> 5793    ../../lib/libscalapack.so: undefined reference to `__g_adxi'
  >> 5794    ../../lib/libscalapack.so: undefined reference to `__pkvla_cdexp'
  >> 5795    ../../lib/libscalapack.so: undefined reference to `__g_cexp'
  >> 5796    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_acxi'
  >> 5797    ../../lib/libscalapack.so: undefined reference to `__f_ccomp'
  >> 5798    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_axxi'
  >> 5799    ../../lib/libscalapack.so: undefined reference to `__g_arxr'
  >> 5800    ../../lib/libscalapack.so: undefined reference to `__g_dlog10'
  >> 5801    ../../lib/libscalapack.so: undefined reference to `__g_arxi'
  >> 5802    ../../lib/libscalapack.so: undefined reference to `__g_adxd'
  >> 5803    ../../lib/libscalapack.so: undefined reference to `__g_scns'
  >> 5804    ../../lib/libscalapack.so: undefined reference to `__jwe_isfm'
  >> 5805    ../../lib/libscalapack.so: undefined reference to `__g_csqrt'
  >> 5806    ../../lib/libscalapack.so: undefined reference to `__jwe_iocf'
  >> 5807    ../../lib/libscalapack.so: undefined reference to `__g_dexp'
  >> 5808    ../../lib/libscalapack.so: undefined reference to `__g_dcos'
  >> 5809    ../../lib/libscalapack.so: undefined reference to `__g_cdexp'
  >> 5810    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_cdsin'
  >> 5811    ../../lib/libscalapack.so: undefined reference to `__g_cdsqrt'
  >> 5812    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_sin'
  >> 5813    ../../lib/libscalapack.so: undefined reference to `__g_log'
  >> 5814    ../../lib/libscalapack.so: undefined reference to `__jwe_ilst'
  >> 5815    ../../lib/libscalapack.so: undefined reference to `__g_exp'
  >> 5816    ../../lib/libscalapack.so: undefined reference to `__g_dscn'
  >> 5817    /vol0004/hp200139/data/u00444/projects/spack/opt/spack/linux-rhel8
             -a64fx/fj-4.3.1/openblas-0.3.13-p25uejlm4zj6shfftneop7adgpbbvvh3/l
             ib/libopenblas.so: undefined reference to `__g_dsin'
  >> 5818    ../../lib/libscalapack.so: undefined reference to `__pkvla_cexp'
  >> 5819    ../../lib/libscalapack.so: undefined reference to `__g_cos'
  >> 5820    clang-7: error: linker command failed with exit code 1 (use -v to
             see invocation)
  >> 5821    make[2]: *** [REDIST/TESTING/CMakeFiles/xdtrmr.dir/build.make:108:
              scalapack/REDIST/TESTING/xdtrmr] Error 1
     5822    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
  >> 5823    make[1]: *** [CMakeFiles/Makefile2:2280: REDIST/TESTING/CMakeFiles
             /xdtrmr.dir/all] Error 2
     5824    make[2]: Leaving directory '/vol0004/hp200139/data/u00444/u00444/s
             pack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3b
             eq2u4uuloplf/spack-build-g6pr6ui'
     5825    [ 71%] Built target zpb2tim
     5826    Fortran diagnostic messages: program name(PILAENV)
     5827      jwd2008i-i  "/data/hp200139/u00444/u00444/spack-stage/spack-stag
             e-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-sr
             c/PBLAS/TIMING/pblastim.f", line 4452: Dummy argument 'PREC' not u
             sed in this subprogram.
     5828      jwd2008i-i  "/data/hp200139/u00444/u00444/spack-stage/spack-stag
             e-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-sr
             c/PBLAS/TIMING/pblastim.f", line 4452: Dummy argument 'ICTXT' not
             used in this subprogram.
     5829    Fortran diagnostic messages: program name(PB_SRAN)

See build log for details:
  /data/hp200139/u00444/u00444/spack-stage/spack-stage-netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf/spack-build-out.txt

==> Warning: Skipping build of eigenexa-2.6-4pjwuvqx7lbyaaqacxncaibekrehjkhi since netlib-scalapack-2.1.0-g6pr6uih4fbm5f36ql3beq2u4uuloplf failed
```
Note that I am using the latest version of Spack as of this writing.
Am I correct that this is not a backport, but a fix to the develop branch?
> Am I correct that this is not a backport, but a fix to the develop branch?

Yes.

>  Fujitsu Compiler dose not add Fortran runtime in rpath.

You're adding libraries to link to (system libraries?), what does that have to do with `rpath`?

Should we just revert for now?
I’m just reporting here, the work seems to be done by Kameyama san.

On Wed, Feb 10, 2021 at 8:14 Harmen Stoppels <notifications@github.com>
wrote:

> Am I correct that this is not a backport, but a fix to the develop branch?
>
> Yes.
>
> Fujitsu Compiler dose not add Fortran runtime in rpath.
>
> You're adding libraries to link to (system libraries?), what does that
> have to do with rpath?
>
> Should we just revert for now?
>
> —
> You are receiving this because you commented.
> Reply to this email directly, view it on GitHub
> <https://github.com/spack/spack/pull/21561#issuecomment-776308135>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AAHLBZ25447UTVPI2GN5YD3S6G6U5ANCNFSM4XKQ7Q3A>
> .
>

May be openblas is not updated.

Please execute `spack uninstall --all --depend openblas` , then execute `spack install eigenexa`.
It'll take a while on a Fugaku node; I'll report back when it is done.
No, not working still:

```

==> Installing eigenexa-2.6-4pjwuvqx7lbyaaqacxncaibekrehjkhi
==> No binary for eigenexa-2.6-4pjwuvqx7lbyaaqacxncaibekrehjkhi found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/a1/a1a4e571a8051443f28e7ea4889272993452a4babd036d2b4dd6b28154302f95.tgz
######################################################################### 100.0%
==> Applied patch /vol0004/hp200139/data/u00444/projects/spack/var/spack/repos/builtin/packages/eigenexa/fj_compiler.patch
==> eigenexa: Executing phase: 'autoreconf'
==> eigenexa: Executing phase: 'configure'
==> eigenexa: Executing phase: 'build'
==> Error: ProcessError: Command exited with status 2:
    'make'

1 error found in build log:
     43    checking for a BSD-compatible install... /usr/bin/install -c
     44    checking whether build environment is sane... yes
     45    checking for a thread-safe mkdir -p... /usr/bin/mkdir -p
     46    checking for gawk... gawk
     47    checking whether make sets $(MAKE)... yes
     48    checking whether make supports nested variables... yes
  >> 49    configure: error: source directory already configured; run "make dis
           tclean" there first
     50    make: *** [Makefile:379: config.status] Error 1

See build log for details:
  /data/hp200139/u00444/u00444/spack-stage/spack-stage-eigenexa-2.6-4pjwuvqx7lbyaaqacxncaibekrehjkhi/spack-build-out.txt
```
I might be offline today, so I'll come back on Friday (tomorrow is a holiday).
> No, not working still:

I think at least netlib-scalapack is build for this PR.
The current problem seems to be eigenexa itself.
I think this issue is outside the scope of this PR.
Okay, will reopen the Issue I opened.

On Wed, Feb 10, 2021 at 11:07 Toyohisa Kameyama <notifications@github.com>
wrote:

> No, not working still:
>
> I think at least netlib-scalapack is build for this PR.
> The current problem seems to be eigenexa itself.
> I think this issue is outside the scope of this PR.
>
> —
> You are receiving this because you commented.
> Reply to this email directly, view it on GitHub
> <https://github.com/spack/spack/pull/21561#issuecomment-776384744>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AAHLBZ7S73ZCSPWHWZEMOXDS6HS77ANCNFSM4XKQ7Q3A>
> .
>

I'm not sure if reverting this change will re-open issue #21500 but we'll see shortly.
> I'm not sure if reverting this change will re-open issue #21500 but we'll see shortly.

Okay.  So it creates another PR that undoes the change of this PR.  (Can you tell this is my first `revert`? :))
> > I'm not sure if reverting this change will re-open issue #21500 but we'll see shortly.
> 
> Okay. So it creates another PR that undoes the change of this PR. (Can you tell this is my first `revert`? :))

Guess I should've checked #21500 first as I see @haampie already re-opened it.

Let me know what  I should do with #21596.

Resolving patch:
diff --git a/var/spack/repos/builtin/packages/eigenexa/package.py b/var/spack/repos/builtin/packages/eigenexa/package.py
--- a/var/spack/repos/builtin/packages/eigenexa/package.py
+++ b/var/spack/repos/builtin/packages/eigenexa/package.py
@@ -1,4 +1,4 @@
-# Copyright 2013-2020 Lawrence Livermore National Security, LLC and other
+# Copyright 2013-2021 Lawrence Livermore National Security, LLC and other
 # Spack Project Developers. See the top-level COPYRIGHT file for details.
 #
 # SPDX-License-Identifier: (Apache-2.0 OR MIT)
@@ -25,8 +25,10 @@ class Eigenexa(AutotoolsPackage):
     depends_on("scalapack")
 
     patch("fj_compiler.patch", when="%fj")
+    patch("gcc_compiler.patch", when="%gcc")
 
     parallel = False
+    force_autoreconf = True
 
     def setup_build_environment(self, env):
         env.set("FC", self.spec["mpi"].mpifc, force=True)
@@ -47,3 +49,21 @@ def setup_build_environment(self, env):
                 )
             ),
         )
+
+    @run_after('install')
+    def cache_test_sources(self):
+        self.cache_extra_test_sources("benchmark")
+
+    def test(self):
+        test_dir = self.test_suite.current_test_data_dir
+        exe_name = join_path(test_dir, "run-test.sh")
+        mpi_name = self.spec["mpi"].prefix.bin.mpirun
+        test_file = join_path(
+            self.install_test_root, "benchmark", "eigenexa_benchmark"
+        )
+        input_file = join_path(self.install_test_root, "benchmark", "IN")
+        opts = [exe_name, mpi_name, '-n', '1', test_file, '-f', input_file]
+        env["OMP_NUM_THREADS"] = "1"
+        self.run_test(
+            "sh", options=opts, expected="EigenExa Test Passed !", work_dir=test_dir
+        )


Test patch:
diff --git a/var/spack/repos/builtin/packages/eigenexa/test/result-check.sh b/var/spack/repos/builtin/packages/eigenexa/test/result-check.sh
new file mode 100644
--- /dev/null
+++ b/var/spack/repos/builtin/packages/eigenexa/test/result-check.sh
@@ -0,0 +1,36 @@
+#!/bin/bash
+
+grep -q "Benchmark completed" $@
+if [ $? -eq 1 ]; then
+  echo "EigenExa Test Failed !"
+  exit 1
+fi
+
+while read line;do
+  case $line in
+    *'Eigenvalue Relative Error'* )
+      tmp=$line
+      read line
+      if [[ "$line" != '|w| is too small, so it is not severe.' ]]; then
+        echo "${tmp}" >> output.txt
+      fi
+      ;;
+    *'Eigenvalue Absolute Error'* )
+      tmp=$line
+      read line
+      if [ "$line" != 'Do not mind it. Condition number is too large.' ] && \
+         [ "$line" != 'Do not mind it. Relative error is small enough' ]; then
+         echo "${tmp}" >> output.txt
+      fi
+      ;;
+    *'Residual Error Test'* | *'Orthogonality  Test'* ) 
+      echo "${line}" >> output.txt ;;
+  esac
+done < $@
+
+grep -q "FAILED" output.txt
+if [ $? -eq 1 ]; then
+  echo "EigenExa Test Passed !"
+elif [ $? -eq 0 ]; then
+  echo "EigenExa Test Failed !"
+fi
diff --git a/var/spack/repos/builtin/packages/eigenexa/test/run-test.sh b/var/spack/repos/builtin/packages/eigenexa/test/run-test.sh
new file mode 100644
--- /dev/null
+++ b/var/spack/repos/builtin/packages/eigenexa/test/run-test.sh
@@ -0,0 +1,4 @@
+#!/bin/bash
+
+$@ 2>&1 | tee  run_test_results.txt
+result-check.sh run_test_results.txt