Spack will be used to manage open source software packages on Fugaku.
Fugaku users can easily use pre-installed packages and built packages based on Spack recipes.
The following list shows the results of building/compiling packages for aarch64 according to the Spack recipes.
Note that the results in this list do not guarantee that each package will work properly.
On the other hand, Fujitsu will provide the following packages compiled with Fujitsu compiler on Fugaku as "external" packages, of which Spack can be aware.
|
Compiler | Fujitsu Compiler Fujitsu C/C++ Compiler 4.10.0 tcsds-1.2.38 |
---|---|
Result | Dependency Error |
Failed to install dependency package :
------------------------------------------------
==> No patches needed for htslib
==> htslib: Executing phase: 'autoreconf'
==> htslib: Executing phase: 'configure'
==> htslib: Executing phase: 'build'
==> Error: ProcessError: Command exited with status 2:
'make' '-j16' 'V=1'
1 error found in build log:
84 ==> [2024-03-09-00:10:14.681179] Find (recursive): /data/rccs-sdt/a0
1008/tmpdir/spack-stage/spack-stage-htslib-1.16-6n5zcm7iofcvxaebwu2q
5yztkqh66y7j/spack-src ['libtool']
85 ==> [2024-03-09-00:10:14.753226] Find complete: /data/rccs-sdt/a0100
8/tmpdir/spack-stage/spack-stage-htslib-1.16-6n5zcm7iofcvxaebwu2q5yz
tkqh66y7j/spack-src ['libtool']
86 ==> htslib: Executing phase: 'build'
87 ==> [2024-03-09-00:10:14.800455] 'make' '-j16' 'V=1'
88 make: Makefile: Too many levels of symbolic links
89 make: stat: Makefile: Too many levels of symbolic links
>> 90 make: *** No rule to make target 'Makefile'. Stop.
See build log for details:
/data/rccs-sdt/a01008/tmpdir/spack-stage/spack-stage-htslib-1.16-6n5zcm7iofcvxaebwu2q5yztkqh66y7j/spack-build-out.txt
==> Warning: Skipping build of bcftools-1.16-kus44edq22dsvhax7jb4qfand5uuzbqt since htslib-1.16-6n5zcm7iofcvxaebwu2q5yztkqh66y7j failed
==> Warning: Skipping build of augustus-3.3.2-beudgnk2w5awyyrfx5uyxojlsnk6yz5d since bcftools-1.16-kus44edq22dsvhax7jb4qfand5uuzbqt failed
==> Warning: Skipping build of samtools-1.16.1-fetxy3tvmw24a2b5yghpvc4rtk7lq2t7 since htslib-1.16-6n5zcm7iofcvxaebwu2q5yztkqh66y7j failed
==> Installing py-cppy-1.1.0-m6whhgemcvpki3sy6qiy7zcdxipuijno [31/46]
==> No binary for py-cppy-1.1.0-m6whhgemcvpki3sy6qiy7zcdxipuijno found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/4e/4eda6f1952054a270f32dc11df7c5e24b259a09fddf7bfaa5f33df9fb4a29642.tar.gz
==> No patches needed for py-cppy
==> py-cppy: Executing phase: 'install'
==> py-cppy: Successfully installed py-cppy-1.1.0-m6whhgemcvpki3sy6qiy7zcdxipuijno
Stage: 1.64s. Install: 23.16s. Post-install: 0.87s. Total: 26.34s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-cppy-1.1.0-m6whhgemcvpki3sy6qiy7zcdxipuijno
==> Installing py-certifi-2023.7.22-ozdat7skdtwlgvqa3izx45wdprkhcdm6 [32/46]
==> No binary for py-certifi-2023.7.22-ozdat7skdtwlgvqa3izx45wdprkhcdm6 found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/53/539cc1d13202e33ca466e88b2807e29f4c13049d6d87031a3c110744495cb082.tar.gz
==> No patches needed for py-certifi
==> py-certifi: Executing phase: 'install'
==> py-certifi: Successfully installed py-certifi-2023.7.22-ozdat7skdtwlgvqa3izx45wdprkhcdm6
Stage: 1.70s. Install: 7.09s. Post-install: 0.82s. Total: 10.08s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-certifi-2023.7.22-ozdat7skdtwlgvqa3izx45wdprkhcdm6
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-cython-3.0.4-7sdgkmtvjntri7top7bfm2hd5u7drmyc
==> Installing py-cycler-0.11.0-fiqjq76lja3xb3m3kgjwbptkuripevdx [34/46]
==> No binary for py-cycler-0.11.0-fiqjq76lja3xb3m3kgjwbptkuripevdx found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/9c/9c87405839a19696e837b3b818fed3f5f69f16f1eec1a1ad77e043dcea9c772f.tar.gz
==> No patches needed for py-cycler
==> py-cycler: Executing phase: 'install'
==> py-cycler: Successfully installed py-cycler-0.11.0-fiqjq76lja3xb3m3kgjwbptkuripevdx
Stage: 1.42s. Install: 6.68s. Post-install: 0.76s. Total: 9.33s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-cycler-0.11.0-fiqjq76lja3xb3m3kgjwbptkuripevdx
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-tomli-2.0.1-jsxdxnw7umod72hqs44hg5bn5n6dc7ri
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-pyproject-metadata-0.7.1-fs3vme4uqputh5py6ykygic6maqw3tlh
==> Installing py-pyparsing-3.0.9-x5syhgdsq2rgfco4tamxymq5hxzr2z42 [37/46]
==> No binary for py-pyparsing-3.0.9-x5syhgdsq2rgfco4tamxymq5hxzr2z42 found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/2b/2b020ecf7d21b687f219b71ecad3631f644a47f01403fa1d1036b0c6416d70fb.tar.gz
==> No patches needed for py-pyparsing
==> py-pyparsing: Executing phase: 'install'
==> py-pyparsing: Successfully installed py-pyparsing-3.0.9-x5syhgdsq2rgfco4tamxymq5hxzr2z42
Stage: 11.86s. Install: 7.24s. Post-install: 0.92s. Total: 20.59s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-pyparsing-3.0.9-x5syhgdsq2rgfco4tamxymq5hxzr2z42
==> Installing py-six-1.16.0-ztq6x5ahyilyk723qkmrff772hjcllpa [38/46]
==> No binary for py-six-1.16.0-ztq6x5ahyilyk723qkmrff772hjcllpa found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/1e/1e61c37477a1626458e36f7b1d82aa5c9b094fa4802892072e49de9c60c4c926.tar.gz
==> No patches needed for py-six
==> py-six: Executing phase: 'install'
==> py-six: Successfully installed py-six-1.16.0-ztq6x5ahyilyk723qkmrff772hjcllpa
Stage: 1.41s. Install: 6.60s. Post-install: 0.77s. Total: 9.25s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-six-1.16.0-ztq6x5ahyilyk723qkmrff772hjcllpa
==> Installing py-pillow-10.0.0-ywh46f5x74warwd5tthvjqvzvtanusm5 [39/46]
==> No binary for py-pillow-10.0.0-ywh46f5x74warwd5tthvjqvzvtanusm5 found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/9c/9c82b5b3e043c7af0d95792d0d20ccf68f61a1fec6b3530e718b688422727396.tar.gz
==> Ran patch() for py-pillow
==> py-pillow: Executing phase: 'install'
==> py-pillow: Successfully installed py-pillow-10.0.0-ywh46f5x74warwd5tthvjqvzvtanusm5
Stage: 36.00s. Install: 2m 31.97s. Post-install: 2.37s. Total: 3m 12.15s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-pillow-10.0.0-ywh46f5x74warwd5tthvjqvzvtanusm5
==> Installing py-kiwisolver-1.3.2-opt7cium5krzk2oimmyz6dh543lha72x [40/46]
==> No binary for py-kiwisolver-1.3.2-opt7cium5krzk2oimmyz6dh543lha72x found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/fc/fc4453705b81d03568d5b808ad8f09c77c47534f6ac2e72e733f9ca4714aa75c.tar.gz
==> No patches needed for py-kiwisolver
==> py-kiwisolver: Executing phase: 'install'
==> py-kiwisolver: Successfully installed py-kiwisolver-1.3.2-opt7cium5krzk2oimmyz6dh543lha72x
Stage: 2.42s. Install: 58.89s. Post-install: 0.82s. Total: 1m 2.71s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-kiwisolver-1.3.2-opt7cium5krzk2oimmyz6dh543lha72x
==> Installing py-numpy-1.26.1-brmrviclbqnhu4f3swabbqjwk5pjz3yw [41/46]
==> No binary for py-numpy-1.26.1-brmrviclbqnhu4f3swabbqjwk5pjz3yw found: installing from source
==> Using cached archive: /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/cache/_source-cache/archive/c8/c8c6c72d4a9f831f328efb1312642a1cafafaa88981d9ab76368d50d07d93cbe.tar.gz
==> Applied patch /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/repos/builtin/packages/py-numpy/check_executables.patch
==> py-numpy: Executing phase: 'install'
==> Error: ProcessError: Command exited with status 1:
'/vol0004/apps/oss/spack-v0.19/opt/spack/linux-rhel8-a64fx/fj-4.8.1/python-3.10.8-7q66snjvhvy7im57hncbgpirmddrb5sk/bin/python3.10' '-m' 'pip' '-vvv' '--no-input' '--no-cache-dir' '--disable-pip-version-check' 'install' '--no-deps' '--ignore-installed' '--no-build-isolation' '--no-warn-script-location' '--no-index' '--prefix=/vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-numpy-1.26.1-brmrviclbqnhu4f3swabbqjwk5pjz3yw' '--config-settings=builddir=build' '--config-settings=compile-args=-j16' '--config-settings=setup-args=-Dblas=fjlapackexsve' '--config-settings=setup-args=-Dlapack=fjlapackexsve' '.'
2 errors found in build log:
64
65 Library m found: YES
66 Found CMake: /usr/bin/cmake (3.20.2)
67 WARNING: CMake Toolchain: Failed to determine CMake compilers stat
e
68 Run-time dependency fjlapackexsve found: NO (tried pkgconfig and c
make)
69
>> 70 ../numpy/meson.build:169:4: ERROR: Problem encountered: No BLAS libr
ary detected! Install one, or use the `allow-noblas` build option (n
ote, this may be up to 100x slower for some linear algebra operation
s).
71
72 A full log can be found at /vol0003/rccs-sdt/data/a01008/tmpdir/sp
ack-stage/spack-stage-py-numpy-1.26.1-brmrviclbqnhu4f3swabbqjwk5pjz3
yw/spack-src/build/meson-logs/meson-log.txt
73 error: subprocess-exited-with-error
74
75 × Preparing metadata (pyproject.toml) did not run successfully.
76 │ exit code: 1
77 ╰─> See above for output.
78
79 note: This error originates from a subprocess, and is likely not a
problem with pip.
80 full command: /vol0004/apps/oss/spack-v0.19/opt/spack/linux-rhel8-
a64fx/fj-4.8.1/python-3.10.8-7q66snjvhvy7im57hncbgpirmddrb5sk/bin/py
thon3.10 /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/s
pack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-pip-23.1.2-e5mqkkojghz
4zpl6zboxzql3mko55ccd/lib/python3.10/site-packages/pip/_vendor/pypro
ject_hooks/_in_process/_in_process.py prepare_metadata_for_build_whe
el /data/rccs-sdt/a01008/tmpdir/tmpf6gs0wgp
81 cwd: /vol0003/rccs-sdt/data/a01008/tmpdir/spack-stage/spack-stage-
py-numpy-1.26.1-brmrviclbqnhu4f3swabbqjwk5pjz3yw/spack-src
82 Preparing metadata (pyproject.toml): finished with status 'error'
>> 83 error: metadata-generation-failed
84
85 × Encountered error while generating package metadata.
86 ╰─> See above for output.
87
88 note: This is an issue with the package mentioned above, not pip.
89 hint: See above for details.
See build log for details:
/data/rccs-sdt/a01008/tmpdir/spack-stage/spack-stage-py-numpy-1.26.1-brmrviclbqnhu4f3swabbqjwk5pjz3yw/spack-build-out.txt
==> Warning: Skipping build of py-matplotlib-3.3.4-uvahwxwwhsx7vox3nce33czaojh3nai6 since py-numpy-1.26.1-brmrviclbqnhu4f3swabbqjwk5pjz3yw failed
==> Installing py-python-dateutil-2.5.2-hnnnls4s3lrlztmuojqkwkrylheinba2 [42/46]
==> No binary for py-python-dateutil-2.5.2-hnnnls4s3lrlztmuojqkwkrylheinba2 found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/06/063907ef47f6e187b8fe0728952e4effb587a34f2dc356888646f9b71fbb2e4b.tar.gz
==> No patches needed for py-python-dateutil
==> py-python-dateutil: Executing phase: 'install'
==> py-python-dateutil: Successfully installed py-python-dateutil-2.5.2-hnnnls4s3lrlztmuojqkwkrylheinba2
Stage: 2.23s. Install: 14.24s. Post-install: 1.16s. Total: 1m 36.30s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-python-dateutil-2.5.2-hnnnls4s3lrlztmuojqkwkrylheinba2
==> Error: augustus-3.3.2-beudgnk2w5awyyrfx5uyxojlsnk6yz5d: Package was not installed
==> Error: Installation request failed. Refer to reported errors for failing package(s).