Spack will be used to manage open source software packages on Fugaku.
Fugaku users can easily use pre-installed packages and built packages based on Spack recipes.
The following list shows the results of building/compiling packages for aarch64 according to the Spack recipes.
Note that the results in this list do not guarantee that each package will work properly.
On the other hand, Fujitsu will provide the following packages compiled with Fujitsu compiler on Fugaku as "external" packages, of which Spack can be aware.
|
Compiler | Fujitsu Compiler Fujitsu C/C++ Compiler 4.10.0 tcsds-1.2.38 |
---|---|
Result | Dependency Error |
Failed to install dependency package :
------------------------------------------------
==> No binary for py-mock-2.0.0-kqzjvubnojkjy5svps6noz3afxrvihy5 found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/b1/b158b6df76edd239b8208d481dc46b6afd45a846b7812ff0ce58971cf5bc8bba.tar.gz
==> No patches needed for py-mock
==> py-mock: Executing phase: 'install'
==> py-mock: Successfully installed py-mock-2.0.0-kqzjvubnojkjy5svps6noz3afxrvihy5
Stage: 2.59s. Install: 10.48s. Post-install: 1.12s. Total: 15.06s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-mock-2.0.0-kqzjvubnojkjy5svps6noz3afxrvihy5
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-rsa-4.9-ymc7y3oy73eechoq5saxkxgl2b35puxx
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-pyasn1-modules-0.2.8-ct7gsi7nkxci4g6j5olorvqwfsbj7cb7
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-grpcio-1.52.0-c463wfryibdqeytmwglwffbzlpmednp4
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/git-2.42.0-dwkradysco77qa5hmcp5ciqvhb3sfcuu
==> Installing py-numpy-1.26.1-lfjg3fewnwt3u4cqwndtt7mluq3bz7yw [70/83]
==> No binary for py-numpy-1.26.1-lfjg3fewnwt3u4cqwndtt7mluq3bz7yw found: installing from source
==> Using cached archive: /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/cache/_source-cache/archive/c8/c8c6c72d4a9f831f328efb1312642a1cafafaa88981d9ab76368d50d07d93cbe.tar.gz
==> Applied patch /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/repos/builtin/packages/py-numpy/check_executables.patch
==> py-numpy: Executing phase: 'install'
==> Error: ProcessError: Command exited with status 1:
'/vol0004/apps/oss/spack-v0.19/opt/spack/linux-rhel8-a64fx/fj-4.8.1/python-3.10.8-7q66snjvhvy7im57hncbgpirmddrb5sk/bin/python3.10' '-m' 'pip' '-vvv' '--no-input' '--no-cache-dir' '--disable-pip-version-check' 'install' '--no-deps' '--ignore-installed' '--no-build-isolation' '--no-warn-script-location' '--no-index' '--prefix=/vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-numpy-1.26.1-lfjg3fewnwt3u4cqwndtt7mluq3bz7yw' '--config-settings=builddir=build' '--config-settings=compile-args=-j16' '--config-settings=setup-args=-Dblas=fjlapackexsve' '--config-settings=setup-args=-Dlapack=fjlapackexsve' '.'
2 errors found in build log:
64
65 Library m found: YES
66 Found CMake: /usr/bin/cmake (3.20.2)
67 WARNING: CMake Toolchain: Failed to determine CMake compilers stat
e
68 Run-time dependency fjlapackexsve found: NO (tried pkgconfig and c
make)
69
>> 70 ../numpy/meson.build:169:4: ERROR: Problem encountered: No BLAS libr
ary detected! Install one, or use the `allow-noblas` build option (n
ote, this may be up to 100x slower for some linear algebra operation
s).
71
72 A full log can be found at /vol0003/rccs-sdt/data/a01008/tmpdir/sp
ack-stage/spack-stage-py-numpy-1.26.1-lfjg3fewnwt3u4cqwndtt7mluq3bz7
yw/spack-src/build/meson-logs/meson-log.txt
73 error: subprocess-exited-with-error
74
75 × Preparing metadata (pyproject.toml) did not run successfully.
76 │ exit code: 1
77 ╰─> See above for output.
78
79 note: This error originates from a subprocess, and is likely not a
problem with pip.
80 full command: /vol0004/apps/oss/spack-v0.19/opt/spack/linux-rhel8-
a64fx/fj-4.8.1/python-3.10.8-7q66snjvhvy7im57hncbgpirmddrb5sk/bin/py
thon3.10 /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/s
pack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-pip-23.1.2-e5mqkkojghz
4zpl6zboxzql3mko55ccd/lib/python3.10/site-packages/pip/_vendor/pypro
ject_hooks/_in_process/_in_process.py prepare_metadata_for_build_whe
el /data/rccs-sdt/a01008/tmpdir/tmp749k6g80
81 cwd: /vol0003/rccs-sdt/data/a01008/tmpdir/spack-stage/spack-stage-
py-numpy-1.26.1-lfjg3fewnwt3u4cqwndtt7mluq3bz7yw/spack-src
82 Preparing metadata (pyproject.toml): finished with status 'error'
>> 83 error: metadata-generation-failed
84
85 × Encountered error while generating package metadata.
86 ╰─> See above for output.
87
88 note: This is an issue with the package mentioned above, not pip.
89 hint: See above for details.
See build log for details:
/data/rccs-sdt/a01008/tmpdir/spack-stage/spack-stage-py-numpy-1.26.1-lfjg3fewnwt3u4cqwndtt7mluq3bz7yw/spack-build-out.txt
==> Warning: Skipping build of arrow-0.17.1-kmr7cp2oqzfuhdarlby2slbfpbaq23op since py-numpy-1.26.1-lfjg3fewnwt3u4cqwndtt7mluq3bz7yw failed
==> Warning: Skipping build of py-pyarrow-0.17.1-z3fzsy7vbniy276c3axl2fj4iiodvexf since arrow-0.17.1-kmr7cp2oqzfuhdarlby2slbfpbaq23op failed
==> Warning: Skipping build of py-apache-beam-2.24.0-764cudwfezzzz5fug3kwny5ddnzm5lzp since py-pyarrow-0.17.1-z3fzsy7vbniy276c3axl2fj4iiodvexf failed
==> Installing py-oauth2client-3.0.0-erc767pevf6z7kxp3u4hmlcs2qwnukiu [71/83]
==> No binary for py-oauth2client-3.0.0-erc767pevf6z7kxp3u4hmlcs2qwnukiu found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/5b/5b5b056ec6f2304e7920b632885bd157fa71d1a7f3ddd00a43b1541a8d1a2460.tar.gz
==> No patches needed for py-oauth2client
==> py-oauth2client: Executing phase: 'install'
==> py-oauth2client: Successfully installed py-oauth2client-3.0.0-erc767pevf6z7kxp3u4hmlcs2qwnukiu
Stage: 3.38s. Install: 15.31s. Post-install: 1.92s. Total: 22.07s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-oauth2client-3.0.0-erc767pevf6z7kxp3u4hmlcs2qwnukiu
==> Installing py-setuptools-scm-7.1.0-lspwtkz6sqrdqgivqfsosstau7erqmpv [72/83]
==> No binary for py-setuptools-scm-7.1.0-lspwtkz6sqrdqgivqfsosstau7erqmpv found: installing from source
==> Using cached archive: /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/cache/_source-cache/archive/6c/6c508345a771aad7d56ebff0e70628bf2b0ec7573762be9960214730de278f27.tar.gz
==> No patches needed for py-setuptools-scm
==> py-setuptools-scm: Executing phase: 'install'
==> py-setuptools-scm: Successfully installed py-setuptools-scm-7.1.0-lspwtkz6sqrdqgivqfsosstau7erqmpv
Stage: 1.70s. Install: 24.10s. Post-install: 2.48s. Total: 48.28s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-setuptools-scm-7.1.0-lspwtkz6sqrdqgivqfsosstau7erqmpv
==> Installing py-python-dateutil-2.8.2-6c5nnyxmjtxmacw4z3fvkojq4ev6yix5 [73/83]
==> No binary for py-python-dateutil-2.8.2-6c5nnyxmjtxmacw4z3fvkojq4ev6yix5 found: installing from source
==> Using cached archive: /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/cache/_source-cache/archive/01/0123cacc1627ae19ddf3c27a5de5bd67ee4586fbdd6440d9748f8abb483d3e86.tar.gz
==> No patches needed for py-python-dateutil
==> py-python-dateutil: Executing phase: 'install'
==> py-python-dateutil: Successfully installed py-python-dateutil-2.8.2-6c5nnyxmjtxmacw4z3fvkojq4ev6yix5
Stage: 2.63s. Install: 15.20s. Post-install: 2.57s. Total: 23.23s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-python-dateutil-2.8.2-6c5nnyxmjtxmacw4z3fvkojq4ev6yix5
==> Installing py-lz4-4.0.2-cmhlxaj2tpqafaomjc5mwiepr3jvvn42 [74/83]
==> No binary for py-lz4-4.0.2-cmhlxaj2tpqafaomjc5mwiepr3jvvn42 found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/08/083b7172c2938412ae37c3a090250bfdd9e4a6e855442594f86c3608ed12729b.tar.gz
==> No patches needed for py-lz4
==> py-lz4: Executing phase: 'install'
==> py-lz4: Successfully installed py-lz4-4.0.2-cmhlxaj2tpqafaomjc5mwiepr3jvvn42
Stage: 3.58s. Install: 21.24s. Post-install: 2.33s. Total: 30.34s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-lz4-4.0.2-cmhlxaj2tpqafaomjc5mwiepr3jvvn42
==> Installing py-pluggy-1.0.0-kut4pmgdiypzcngvxsxvzfhonuo7lpqa [75/83]
==> No binary for py-pluggy-1.0.0-kut4pmgdiypzcngvxsxvzfhonuo7lpqa found: installing from source
==> Using cached archive: /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/cache/_source-cache/archive/42/4224373bacce55f955a878bf9cfa763c1e360858e330072059e10bad68531159.tar.gz
==> No patches needed for py-pluggy
==> py-pluggy: Executing phase: 'install'
==> py-pluggy: Successfully installed py-pluggy-1.0.0-kut4pmgdiypzcngvxsxvzfhonuo7lpqa
Stage: 1.59s. Install: 13.11s. Post-install: 1.77s. Total: 19.31s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-pluggy-1.0.0-kut4pmgdiypzcngvxsxvzfhonuo7lpqa
==> Installing py-fastavro-0.23.6-fj3garq66qiskfs67drup7okj3mlil5s [76/83]
==> No binary for py-fastavro-0.23.6-fj3garq66qiskfs67drup7okj3mlil5s found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/b5/b511dc55a9514205765f96b4d964f1d74fca9696dbac91229cef6100a028a29f.tar.gz
==> No patches needed for py-fastavro
==> py-fastavro: Executing phase: 'install'
==> py-fastavro: Successfully installed py-fastavro-0.23.6-fj3garq66qiskfs67drup7okj3mlil5s
Stage: 5.06s. Install: 1m 56.26s. Post-install: 2.51s. Total: 2m 11.01s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-fastavro-0.23.6-fj3garq66qiskfs67drup7okj3mlil5s
==> Installing py-hatchling-1.18.0-nkxjwk6oyiekwcyp56c33dyndmncnrrj [77/83]
==> No binary for py-hatchling-1.18.0-nkxjwk6oyiekwcyp56c33dyndmncnrrj found: installing from source
==> Using cached archive: /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/cache/_source-cache/archive/50/50e99c3110ce0afc3f7bdbadff1c71c17758e476731c27607940cfa6686489ca.tar.gz
==> No patches needed for py-hatchling
==> py-hatchling: Executing phase: 'install'
==> py-hatchling: Successfully installed py-hatchling-1.18.0-nkxjwk6oyiekwcyp56c33dyndmncnrrj
Stage: 1.86s. Install: 14.92s. Post-install: 4.28s. Total: 28.73s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-hatchling-1.18.0-nkxjwk6oyiekwcyp56c33dyndmncnrrj
==> Installing py-urllib3-2.0.6-bjgb3cymbb2i7w6oonod5l5eqgc3npqb [78/83]
==> No binary for py-urllib3-2.0.6-bjgb3cymbb2i7w6oonod5l5eqgc3npqb found: installing from source
==> Using cached archive: /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/cache/_source-cache/archive/b1/b19e1a85d206b56d7df1d5e683df4a7725252a964e3993648dd0fb5a1c157564.tar.gz
==> No patches needed for py-urllib3
==> py-urllib3: Executing phase: 'install'
==> py-urllib3: Successfully installed py-urllib3-2.0.6-bjgb3cymbb2i7w6oonod5l5eqgc3npqb
Stage: 3.37s. Install: 9.46s. Post-install: 2.68s. Total: 18.63s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-urllib3-2.0.6-bjgb3cymbb2i7w6oonod5l5eqgc3npqb
==> Installing py-requests-2.31.0-vnmcpoyfgy7lpoux3dw5dumbhbwkkvhn [79/83]
==> No binary for py-requests-2.31.0-vnmcpoyfgy7lpoux3dw5dumbhbwkkvhn found: installing from source
==> Using cached archive: /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/var/spack/cache/_source-cache/archive/94/942c5a758f98d790eaed1a29cb6eefc7ffb0d1cf7af05c3d2791656dbd6ad1e1.tar.gz
==> No patches needed for py-requests
==> py-requests: Executing phase: 'install'
==> py-requests: Successfully installed py-requests-2.31.0-vnmcpoyfgy7lpoux3dw5dumbhbwkkvhn
Stage: 1.57s. Install: 13.88s. Post-install: 2.56s. Total: 21.87s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-requests-2.31.0-vnmcpoyfgy7lpoux3dw5dumbhbwkkvhn
==> Installing py-hdfs-2.1.0-neok2es7ytf2gjvormakua6cwq3cjagf [80/83]
==> No binary for py-hdfs-2.1.0-neok2es7ytf2gjvormakua6cwq3cjagf found: installing from source
==> Fetching https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/_source-cache/archive/a4/a40fe99ccb03b5c3247b33a4110eb21b57405dd7c3f1b775e362e66c19b44bc6.tar.gz
==> No patches needed for py-hdfs
==> py-hdfs: Executing phase: 'install'
==> py-hdfs: Successfully installed py-hdfs-2.1.0-neok2es7ytf2gjvormakua6cwq3cjagf
Stage: 2.18s. Install: 9.54s. Post-install: 2.44s. Total: 21.26s
[+] /vol0003/rccs-sdt/data/a01008/spack-all-test/env-20240227/spack/opt/spack/linux-rhel8-a64fx/fj-4.10.0/py-hdfs-2.1.0-neok2es7ytf2gjvormakua6cwq3cjagf
==> Error: py-apache-beam-2.24.0-764cudwfezzzz5fug3kwny5ddnzm5lzp: Package was not installed
==> Error: Installation request failed. Refer to reported errors for failing package(s).