pkg/58941: pkgsrc-2024Q4 python3.12 + 3.13 build hangs

To: pkg-manager%netbsd.org@localhost,gnats-admin%netbsd.org@localhost,pkgsrc-bugs%netbsd.org@localhost
Subject: pkg/58941: pkgsrc-2024Q4 python3.12 + 3.13 build hangs
From: mlelstv%netbsd.org@localhost
Date: Sat, 28 Dec 2024 09:10:00 +0000 (UTC)
>Number:         58941
>Category:       pkg
>Synopsis:       pkgsrc-2024Q4 python3.12 + 3.13 build hangs in infinite loop for 32bit arm
>Confidential:   no
>Severity:       critical
>Priority:       high
>Responsible:    pkg-manager
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Sat Dec 28 09:10:00 +0000 2024
>Originator:     Michael van Elst
>Release:        NetBSD 10.0_STABLE
>Organization:
	
>Environment:
	
	
System: NetBSD victory.netbsd.org 10.0_STABLE NetBSD 10.0_STABLE (VICTORY) #11: Sat Nov 2 21:22:53 UTC 2024 spz%franklin.NetBSD.org@localhost:/home/netbsd/10/evbarm-aarch64/obj/sys/arch/evbarm/compile/VICTORY evbarm
Architecture: aarch64
Machine: evbarm
>Description:
Building python3.12 or 3.13 from pkgsrc-2024Q4 in a 32bit arm chroot gets
stuck in an infinite loop in the installation phase.

29513 pts/0 I+     0:00.00 | `-- /bin/sh /usr/pkgbulk/libexec/pbulk/pkg-build 
 3815 pts/0 I+     0:00.10 |   `-- /usr/bin/make stage-install BATCH=1 DEPENDS_TARGET=/nonexistent WRKLOG=/pbulk/bulklog/python312-3.12.8nb1/work.log 
15519 pts/0 I+     0:00.00 |     `-- /bin/sh -c set -e;\t\t\t\t\t if test -n "" &&  /usr/sbin/pkg_info -K /usr/pkg/pkgdb -qe python312-3.12.8nb1; then  echo ===\\>\\ barrier\\ \\[python312-3.12.8nb1\\]\\ ===\\> "Skipping installation of already handled package";  else  cd /usr/pkgsrc/lang/python312\t\t\t\t\t\t\t && /usr/bin/env MAKECONF=/etc/mk.conf PATH=/pbulk/work/lang/python312/work/.cwrapper/bin:/pbulk/work/lang/python312/work/.buildlink/bin:/pbulk/work/lang/python312/work/.gcc/bin:/pbulk/work/lang/python312/work/.tools/bin:/usr/pkg/bin:/home/mlelstv/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R7/bin:/usr/pkg/bin:/usr/pkg/sbin:/usr/games:/usr/local/bin:/usr/local/sbin /usr/bin/make _MAKE=/usr/bin/make NATIVE_OPSYS=NetBSD OPSYS=NetBSD NATIVE_OS_VERSION=10.0 OS_VERSION=10.0 NATIVE_OPSYS_VERSION=100000 OPSYS_VERSION=100000 HOST_MACHINE_ARCH=evbarm NATIVE_LOWER_OPSYS=netbsd LOWER_OPSYS=netbsd _PKGSRCDIR=/usr/pkgsrc PKGTOOLS_VERSION=20210410 UNPRIVILEGED_USER=pbulk UNPRIVILEGED_GROUP=us
 ers UNPRIVILEGED_GROUPS=users _CC=/usr/bin/gcc _PATH_ORIG=/home/mlelstv/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R7/bin:/usr/pkg/bin:/usr/pkg/sbin:/usr/games:/usr/local/bin:/usr/local/sbin _PKGSRC_BARRIER=yes ALLOW_VULNERABLE_PACKAGES= stage-install  || {\t\t\t\t\t\t\t\t exitcode="$?";\t\t\t\t\t\t /usr/bin/env MAKECONF=/etc/mk.conf PATH=/pbulk/work/lang/python312/work/.cwrapper/bin:/pbulk/work/lang/python312/work/.buildlink/bin:/pbulk/work/lang/python312/work/.gcc/bin:/pbulk/work/lang/python312/work/.tools/bin:/usr/pkg/bin:/home/mlelstv/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R7/bin:/usr/pkg/bin:/usr/pkg/sbin:/usr/games:/usr/local/bin:/usr/local/sbin /usr/bin/make _MAKE=/usr/bin/make NATIVE_OPSYS=NetBSD OPSYS=NetBSD NATIVE_OS_VERSION=10.0 OS_VERSION=10.0 NATIVE_OPSYS_VERSION=100000 OPSYS_VERSION=100000 HOST_MACHINE_ARCH=evbarm NATIVE_LOWER_OPSYS=netbsd LOWER_OPSYS=netbsd _PKGSRCDIR=/usr/pkgsrc PKGTOOLS_VERSION=20210410 UNPRIVILEGED_USER=pbulk UNPRIVILEGED_GROUP=users UNPRIVILEGED
 _GROUPS=users _CC=/usr/bin/gcc _PATH_ORIG=/home/mlelstv/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R7/bin:/usr/pkg/bin:/usr/pkg/sbin:/usr/games:/usr/local/bin:/usr/local/sbin _PKGSRC_BARRIER=yes barrier-error-check;  exit "$exitcode";\t\t\t\t\t };  fi 
13304 pts/0 I+     0:00.10 |       `-- /usr/bin/make _MAKE=/usr/bin/make NATIVE_OPSYS=NetBSD OPSYS=NetBSD NATIVE_OS_VERSION=10.0 OS_VERSION=10.0 NATIVE_OPSYS_VERSION=100000 OPSYS_VERSION=100000 HOST_MACHINE_ARCH=evbarm NATIVE_LOWER_OPSYS=netbsd LOWER_OPSYS=netbsd _PKGSRCDIR=/usr/pkgsrc PKGTOOLS_VERSION=20210410 UNPRIVILEGED_USER=pbulk UNPRIVILEGED_GROUP=users UNPRIVILEGED_GROUPS=users _CC=/usr/bin/gcc _PATH_ORIG=/home/mlelstv/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R7/bin:/usr/pkg/bin:/usr/pkg/sbin:/usr/games:/usr/local/bin:/usr/local/sbin _PKGSRC_BARRIER=yes ALLOW_VULNERABLE_PACKAGES= stage-install 
 5965 pts/0 I+     0:00.13 |         `-- /usr/bin/make DESTDIR=/pbulk/work/lang/python312/work/.destdir -f Makefile altinstall 
24662 pts/0 Il+    0:01.75 |           `-- ./python -E -Wi /pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12/compileall.py -o 0 -o 1 -j0 -d /usr/pkg/lib/python3.12 -f -x bad_coding|badsyntax|site-packages|test/test_lib2to3/data /pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12 
15312 pts/0 I+     0:00.13 |             |-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.resource_tracker import main;main(14) 
26103 pts/0 I+     0:00.17 |             `-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.forkserver import main; main(21, 22, ['__main__'], **{'sys_path': ['/pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12', '/usr/pkg/lib/python312.zip', '/pbulk/work/lang/python312/work/Python-3.12.8/Lib', '/pbulk/work/lang/python312/work/Python-3.12.8/build/lib.netbsd-10.0-evbarm-3.12']}) 
 2293 pts/0 O+     6:11.10 |               |-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.forkserver import main; main(21, 22, ['__main__'], **{'sys_path': ['/pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12', '/usr/pkg/lib/python312.zip', '/pbulk/work/lang/python312/work/Python-3.12.8/Lib', '/pbulk/work/lang/python312/work/Python-3.12.8/build/lib.netbsd-10.0-evbarm-3.12']}) 
 2601 pts/0 O+     6:17.93 |               |-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.forkserver import main; main(21, 22, ['__main__'], **{'sys_path': ['/pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12', '/usr/pkg/lib/python312.zip', '/pbulk/work/lang/python312/work/Python-3.12.8/Lib', '/pbulk/work/lang/python312/work/Python-3.12.8/build/lib.netbsd-10.0-evbarm-3.12']}) 
 8530 pts/0 O+     6:17.57 |               |-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.forkserver import main; main(21, 22, ['__main__'], **{'sys_path': ['/pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12', '/usr/pkg/lib/python312.zip', '/pbulk/work/lang/python312/work/Python-3.12.8/Lib', '/pbulk/work/lang/python312/work/Python-3.12.8/build/lib.netbsd-10.0-evbarm-3.12']}) 
12746 pts/0 O+     6:17.65 |               |-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.forkserver import main; main(21, 22, ['__main__'], **{'sys_path': ['/pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12', '/usr/pkg/lib/python312.zip', '/pbulk/work/lang/python312/work/Python-3.12.8/Lib', '/pbulk/work/lang/python312/work/Python-3.12.8/build/lib.netbsd-10.0-evbarm-3.12']}) 
23887 pts/0 O+     6:17.60 |               |-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.forkserver import main; main(21, 22, ['__main__'], **{'sys_path': ['/pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12', '/usr/pkg/lib/python312.zip', '/pbulk/work/lang/python312/work/Python-3.12.8/Lib', '/pbulk/work/lang/python312/work/Python-3.12.8/build/lib.netbsd-10.0-evbarm-3.12']}) 
24709 pts/0 O+     6:17.76 |               |-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.forkserver import main; main(21, 22, ['__main__'], **{'sys_path': ['/pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12', '/usr/pkg/lib/python312.zip', '/pbulk/work/lang/python312/work/Python-3.12.8/Lib', '/pbulk/work/lang/python312/work/Python-3.12.8/build/lib.netbsd-10.0-evbarm-3.12']}) 
25061 pts/0 O+     6:17.92 |               |-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.forkserver import main; main(21, 22, ['__main__'], **{'sys_path': ['/pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12', '/usr/pkg/lib/python312.zip', '/pbulk/work/lang/python312/work/Python-3.12.8/Lib', '/pbulk/work/lang/python312/work/Python-3.12.8/build/lib.netbsd-10.0-evbarm-3.12']}) 
28192 pts/0 R+     6:17.34 |               `-- /pbulk/work/lang/python312/work/Python-3.12.8/python -E -Wi -c from multiprocessing.forkserver import main; main(21, 22, ['__main__'], **{'sys_path': ['/pbulk/work/lang/python312/work/.destdir/usr/pkg/lib/python3.12', '/usr/pkg/lib/python312.zip', '/pbulk/work/lang/python312/work/Python-3.12.8/Lib', '/pbulk/work/lang/python312/work/Python-3.12.8/build/lib.netbsd-10.0-evbarm-3.12']}) 



Here is a backtrace of one of the busy looping python processes:

(gdb) bt
#0  0xf4686604 in lshift () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#1  0xf468715c in _Py_dg_strtod () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#2  0xf4684c9c in PyOS_string_to_double () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#3  0xf44c9d80 in parsenumber_raw () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#4  0xf44cafd8 in _PyPegen_number_token () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#5  0xf44e2d78 in atom_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#6  0xf44e93d4 in primary_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#7  0xf44e96a4 in await_primary_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#8  0xf44e9a14 in factor_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#9  0xf44d3ae0 in term_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#10 0xf44d3e38 in sum_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#11 0xf44d41a0 in shift_expr_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#12 0xf44d4468 in bitwise_and_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#13 0xf44d4730 in bitwise_xor_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#14 0xf44d49f8 in bitwise_or_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#15 0xf44d4c98 in inversion_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#16 0xf44d576c in conjunction_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#17 0xf44d5b68 in disjunction_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#18 0xf44d6140 in expression_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#19 0xf44d77d8 in named_expression_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#20 0xf44d7da0 in star_named_expression_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#21 0xf44d7edc in star_named_expressions_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#22 0xf44d8080 in list_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#23 0xf44e2f1c in atom_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#24 0xf44e4394 in t_primary_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#25 0xf44e4664 in target_with_star_atom_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#26 0xf44e51e4 in star_target_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#27 0xf44e5dac in star_targets_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#28 0xf44ea0e0 in simple_stmt_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#29 0xf44ec538 in simple_stmts_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#30 0xf44ef2dc in statements_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#31 0xf44ef504 in block_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#32 0xf44efc44 in function_def_raw_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#33 0xf44ecd34 in compound_stmt_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#34 0xf44ef2bc in statements_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#35 0xf44ef504 in block_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#36 0xf44f0574 in class_def_raw_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#37 0xf44f09e0 in class_def_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#38 0xf44ecce8 in compound_stmt_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#39 0xf44ef2bc in statements_rule () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#40 0xf44f19c0 in _PyPegen_parse () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#41 0xf44cb3cc in _PyPegen_run_parser () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#42 0xf44cb6fc in _PyPegen_run_parser_from_string () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#43 0xf466d474 in Py_CompileStringObject () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#44 0xf4610e00 in builtin_compile () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#45 0xf4566a60 in cfunction_vectorcall_FASTCALL_KEYWORDS () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#46 0xf451a2a0 in _PyVectorcall_Call () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#47 0xf451a46c in _PyObject_Call () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#48 0xf47051e0 in _PyEval_EvalFrameDefault () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#49 0xf45181c8 in _PyFunction_Vectorcall () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#50 0xf451a2a0 in _PyVectorcall_Call () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#51 0xf451a46c in _PyObject_Call () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#52 0xf46f65b4 in partial_call () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#53 0xf4518280 in _PyObject_MakeTpCall () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#54 0xf46f6860 in partial_vectorcall () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#55 0xf451a46c in _PyObject_Call () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#56 0xf47051e0 in _PyEval_EvalFrameDefault () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#57 0xf45181c8 in _PyFunction_Vectorcall () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#58 0xf46f67ec in partial_vectorcall () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#59 0xf451a46c in _PyObject_Call () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#60 0xf47051e0 in _PyEval_EvalFrameDefault () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#61 0xf46130b8 in PyEval_EvalCode () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#62 0xf4669674 in run_eval_code_obj () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#63 0xf4669770 in run_mod () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#64 0xf466d2e4 in PyRun_StringFlags () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#65 0xf466d344 in PyRun_SimpleStringFlags () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#66 0xf469104c in Py_RunMain () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#67 0xf4691c8c in Py_BytesMain () from /pbulk/work/lang/python312/work/Python-3.12.8/libpython3.12.so.1.0
#68 0x0ace0864 in ___start (cleanup=<optimized out>, ps_strings=0xfffd6ff0) at /usr/src/lib/csu/common/crt0-common.c:350
#69 0xf49977e4 in _rtld () from /usr/libexec/ld.elf_so
#70 0xfffd52ec in ?? ()




Building python3.12 from pkgsrc-2024Q3 was successful. There is a tiny
version difference:

2024Q3: python312-3.12.6
2024Q4: python312-3.12.8nb1

>How-To-Repeat:
	
>Fix:
	

>Unformatted:
Prev by Date: Re: bin/58809: pkg_add gets confused with -P and library installs
Next by Date: Re: pkg/46577 (Old PAM problem with -DNO_STATIC_MODULES has come back.)
Previous by Thread: Re: bin/58809: pkg_add gets confused with -P and library installs
Next by Thread: Re: pkg/58941: pkgsrc-2024Q4 python3.12 + 3.13 build hangs
Indexes:
Home | Main Index | Thread Index | Old Index