NetBSD Problem Report #57378
From beceeh@shaw.ca Tue Apr 25 05:32:01 2023
Return-Path: <beceeh@shaw.ca>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
by mollari.NetBSD.org (Postfix) with ESMTPS id 67AA01A9239
for <gnats-bugs@gnats.NetBSD.org>; Tue, 25 Apr 2023 05:32:01 +0000 (UTC)
Message-Id: <20230425041537.A370936DC4@katy.localdomain>
Date: Mon, 24 Apr 2023 21:15:37 -0700 (PDT)
From: Bch <beceeh@shaw.ca>
Reply-To: brad.harder@gmail.com
To: gnats-bugs@NetBSD.org
Cc: brad.harder@gmail.com
Subject: Issue with set/checkflist
X-Send-Pr-Version: 3.95
>Number: 57378
>Category: toolchain
>Synopsis: issue w/ set/checkflist, ... since compiler update this winter
>Confidential: no
>Severity: non-critical
>Priority: medium
>Responsible: toolchain-manager
>State: open
>Class: support
>Submitter-Id: net
>Arrival-Date: Tue Apr 25 05:35:00 +0000 2023
>Last-Modified: Thu May 25 01:35:01 +0000 2023
>Originator: Bch
>Release: NetBSD 10.99.4
>Organization:
method logic digital
>Environment:
System: NetBSD katy 10.99.4 NetBSD 10.99.4 (GENERIC) #745: Sun Apr 23 14:10:05 PDT 2023 root@katy:/usr/obj/sys/arch/amd64/compile/GENERIC amd64
Architecture: x86_64
Machine: amd64
>Description:
katy# ./build.sh -j4 -u -x distribution
[...]
checkflist ===> distrib/sets
--- check_DESTDIR ---
--- sanitise_METALOG ---
--- checkflist ---
cd /usr/src/distrib/sets && DESTDIR=/usr/src/obj/destdir.amd64 MACHINE=amd64 MACHINE_ARCH=x86_64 AWK=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbawk CKSUM=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbcksum DB=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbdb EGREP=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbgrep\ -E HOST_SH=/bin/sh MAKE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmake MKTEMP=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmktemp MTREE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmtree PAX=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbpax COMPRESS_PROGRAM=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbxz GZIP=-n XZ_OPT=-9 TAR_SUFF=tar.xz PKG_CREATE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbpkg_create SED=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbsed TSORT=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbtsort\ -q /bin/sh /usr/src/distrib/sets/checkflist -L base,x
======= 1 extra files in DESTDIR =========
Files in DESTDIR but missing from flist.
File is obsolete or flist is out of date ?
------------------------------------------
./usr/libexec/ld.elf_so
========= end of 1 extra files ===========
*** Failed target: checkflist
*** Failed commands:
${SETSCMD} ${.CURDIR}/checkflist ${MAKEFLIST_FLAGS} ${CHECKFLIST_FLAGS} ${METALOG.unpriv}
=> cd /usr/src/distrib/sets && DESTDIR=/usr/src/obj/destdir.amd64 MACHINE=amd64 MACHINE_ARCH=x86_64 AWK=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbawk CKSUM=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbcksum DB=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbdb EGREP=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbgrep\ -E HOST_SH=/bin/sh MAKE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmake MKTEMP=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmktemp MTREE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmtree PAX=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbpax COMPRESS_PROGRAM=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbxz GZIP=-n XZ_OPT=-9 TAR_SUFF=tar.xz PKG_CREATE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbpkg_create SED=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbsed TSORT=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbtsort\ -q /bin/sh /usr/src/distrib/sets/checkflist -L base,x
*** [checkflist] Error code 1
nbmake[1]: stopped in /usr/src/distrib/sets
1 error
nbmake[1]: stopped in /usr/src/distrib/sets
nbmake: stopped in /usr/src
ERROR: Failed to make distribution
*** BUILD ABORTED ***
>How-To-Repeat:
./build.sh [...] distriubtion, w/ or w/o -u, multiple jobs, ...
>Fix:
>Audit-Trail:
From: Taylor R Campbell <riastradh@NetBSD.org>
To: gnats-bugs@netbsd.org
Cc: toolchain-manager@netbsd.org, gnats-admin@netbsd.org, netbsd-bugs@netbsd.org
Subject: Re: toolchain/57378: Issue with set/checkflist
Date: Tue, 25 Apr 2023 11:34:52 +0000
> Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)
> From: Bch <beceeh@shaw.ca>
>
> ======= 1 extra files in DESTDIR =========
> Files in DESTDIR but missing from flist.
> File is obsolete or flist is out of date ?
> ------------------------------------------
> ./usr/libexec/ld.elf_so
I haven't seen this and it hasn't turned up in the autobuilds. Is
this from a clean objdir? If not, can you try that?
From: bch <brad.harder@gmail.com>
To: gnats-bugs@netbsd.org
Cc: gnats-admin@netbsd.org, netbsd-bugs@netbsd.org,
toolchain-manager@netbsd.org
Subject: Re: toolchain/57378: Issue with set/checkflist
Date: Wed, 24 May 2023 12:37:36 -0700
--000000000000703d6305fc75a3b8
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
On Tue, Apr 25, 2023 at 04:40 Taylor R Campbell <riastradh@netbsd.org>
wrote:
> The following reply was made to PR toolchain/57378; it has been noted by
> GNATS.
>
> From: Taylor R Campbell <riastradh@NetBSD.org>
> To: gnats-bugs@netbsd.org
> Cc: toolchain-manager@netbsd.org, gnats-admin@netbsd.org,
> netbsd-bugs@netbsd.org
> Subject: Re: toolchain/57378: Issue with set/checkflist
> Date: Tue, 25 Apr 2023 11:34:52 +0000
>
> > Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)
> > From: Bch <beceeh@shaw.ca>
> >
> > =3D=3D=3D=3D=3D=3D=3D 1 extra files in DESTDIR =3D=3D=3D=3D=3D=3D=3D=
=3D=3D
> > Files in DESTDIR but missing from flist.
> > File is obsolete or flist is out of date ?
> > ------------------------------------------
> > ./usr/libexec/ld.elf_so
>
> I haven't seen this and it hasn't turned up in the autobuilds. Is
> this from a clean objdir? If not, can you try that?
Hey riastradh - I think I=E2=80=99ve isolated it to MKDYNAMICROOT =3D no.
Happy to take instruction to test this further - I=E2=80=99m interested in
understanding our flist facilities more, this might be a good opportunity.
Kind regards,
-bch
>
>
--000000000000703d6305fc75a3b8
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
<div><br></div><div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=
=3D"gmail_attr">On Tue, Apr 25, 2023 at 04:40 Taylor R Campbell <<a href=
=3D"mailto:riastradh@netbsd.org">riastradh@netbsd.org</a>> wrote:<br></d=
iv><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left=
:1px #ccc solid;padding-left:1ex">The following reply was made to PR toolch=
ain/57378; it has been noted by GNATS.<br>
<br>
From: Taylor R Campbell <riastradh@NetBSD.org><br>
To: <a href=3D"mailto:gnats-bugs@netbsd.org" target=3D"_blank">gnats-bugs@n=
etbsd.org</a><br>
Cc: <a href=3D"mailto:toolchain-manager@netbsd.org" target=3D"_blank">toolc=
hain-manager@netbsd.org</a>, <a href=3D"mailto:gnats-admin@netbsd.org" targ=
et=3D"_blank">gnats-admin@netbsd.org</a>, <a href=3D"mailto:netbsd-bugs@net=
bsd.org" target=3D"_blank">netbsd-bugs@netbsd.org</a><br>
Subject: Re: toolchain/57378: Issue with set/checkflist<br>
Date: Tue, 25 Apr 2023 11:34:52 +0000<br>
<br>
=C2=A0> Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)<br>
=C2=A0> From: Bch <<a href=3D"mailto:beceeh@shaw.ca" target=3D"_blank=
">beceeh@shaw.ca</a>><br>
=C2=A0> <br>
=C2=A0> =3D=3D=3D=3D=3D=3D=3D=C2=A0 1 extra files in DESTDIR=C2=A0 =3D=
=3D=3D=3D=3D=3D=3D=3D=3D<br>
=C2=A0> Files in DESTDIR but missing from flist.<br>
=C2=A0> File is obsolete or flist is out of date ?<br>
=C2=A0> ------------------------------------------<br>
=C2=A0> ./usr/libexec/ld.elf_so<br>
<br>
=C2=A0I haven't seen this and it hasn't turned up in the autobuilds=
.=C2=A0 Is<br>
=C2=A0this from a clean objdir?=C2=A0 If not, can you try that?</blockquote=
><div dir=3D"auto"><br></div><div dir=3D"auto"><br></div><div dir=3D"auto">=
Hey riastradh - I think I=E2=80=99ve isolated it to MKDYNAMICROOT =3D no.</=
div><div dir=3D"auto"><br></div><div dir=3D"auto">Happy to take instruction=
to test this further - I=E2=80=99m interested in understanding our flist f=
acilities more, this might be a good opportunity.</div><div dir=3D"auto"><b=
r></div><div dir=3D"auto">Kind regards,</div><div dir=3D"auto">-bch=C2=A0</=
div><div dir=3D"auto"><br></div><blockquote class=3D"gmail_quote" style=3D"=
margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" dir=3D"auto"=
><br>
<br>
</blockquote></div></div>
--000000000000703d6305fc75a3b8--
From: Taylor R Campbell <riastradh@NetBSD.org>
To: bch <brad.harder@gmail.com>
Cc: gnats-bugs@netbsd.org, gnats-admin@netbsd.org,
netbsd-bugs@netbsd.org, toolchain-manager@netbsd.org
Subject: Re: toolchain/57378: Issue with set/checkflist
Date: Wed, 24 May 2023 19:51:16 +0000
> Date: Wed, 24 May 2023 12:37:36 -0700
> From: bch <brad.harder@gmail.com>
>=20
> On Tue, Apr 25, 2023 at 04:40 Taylor R Campbell <riastradh@netbsd.org>
> wrote:
>=20
> > > Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)
> > > From: Bch <beceeh@shaw.ca>
> > >
> > > =3D=3D=3D=3D=3D=3D=3D 1 extra files in DESTDIR =3D=3D=3D=3D=3D=3D=
=3D=3D=3D
> > > Files in DESTDIR but missing from flist.
> > > File is obsolete or flist is out of date ?
> > > ------------------------------------------
> > > ./usr/libexec/ld.elf_so
> >
> > I haven't seen this and it hasn't turned up in the autobuilds. Is
> > this from a clean objdir? If not, can you try that?
>=20
> Hey riastradh - I think I've isolated it to MKDYNAMICROOT =3D no.
>=20
> Happy to take instruction to test this further - I'm interested in
> understanding our flist facilities more, this might be a good opportunity.
It looks like there is a spurious `dynamicroot' condition on the
/usr/libexec/ld.elf_so entry, which should instead be unconditional.
The condition may have been added by mistake by scole@ in 2016 for
this PR to fix various ia64 build issues:
https://gnats.netbsd.org/51261
The PR has a comment about it suggesting it was intentional:
M distrib/sets/lists/base/shl.mi # change dynamicroot for ./lib/npf*, usr=
/libexec/ld.elf_so
But I don't think that makes sense, because /usr/libexec/ld.elf_so is
always there (it's a regular file with MKDYNAMICROOT=3Dno, a symlink
with MKDYNAMICROOT=3Dyes), whereas /libexec/ld.elf_so is correctly
conditioned on `dynamicroot'.
From: Sean Cole <scole@NetBSD.org>
To: Taylor R Campbell <riastradh@NetBSD.org>
Cc: bch <brad.harder@gmail.com>, gnats-bugs@netbsd.org, gnats-admin@netbsd.org,
netbsd-bugs@netbsd.org, toolchain-manager@netbsd.org
Subject: Re: toolchain/57378: Issue with set/checkflist
Date: Thu, 25 May 2023 08:34:28 +0700
Taylor R Campbell <riastradh@NetBSD.org> writes:
>> Date: Wed, 24 May 2023 12:37:36 -0700
>> From: bch <brad.harder@gmail.com>
>>
>> On Tue, Apr 25, 2023 at 04:40 Taylor R Campbell <riastradh@netbsd.org>
>> wrote:
>>
>> > > Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)
>> > > From: Bch <beceeh@shaw.ca>
>> > >
>> > > ======= 1 extra files in DESTDIR =========
>> > > Files in DESTDIR but missing from flist.
>> > > File is obsolete or flist is out of date ?
>> > > ------------------------------------------
>> > > ./usr/libexec/ld.elf_so
>> >
>> > I haven't seen this and it hasn't turned up in the autobuilds. Is
>> > this from a clean objdir? If not, can you try that?
>>
>> Hey riastradh - I think I've isolated it to MKDYNAMICROOT = no.
>>
>> Happy to take instruction to test this further - I'm interested in
>> understanding our flist facilities more, this might be a good opportunity.
>
> It looks like there is a spurious `dynamicroot' condition on the
> /usr/libexec/ld.elf_so entry, which should instead be unconditional.
>
> The condition may have been added by mistake by scole@ in 2016 for
> this PR to fix various ia64 build issues:
>
> https://gnats.netbsd.org/51261
>
> The PR has a comment about it suggesting it was intentional:
>
> M distrib/sets/lists/base/shl.mi # change dynamicroot for ./lib/npf*,
> usr/libexec/ld.elf_so
>
> But I don't think that makes sense, because /usr/libexec/ld.elf_so is
> always there (it's a regular file with MKDYNAMICROOT=no, a symlink
> with MKDYNAMICROOT=yes), whereas /libexec/ld.elf_so is correctly
> conditioned on `dynamicroot'.
Feel free to change to whatever makes sense.
I am not sure of the exact details for this particular change anymore,
but have a vague recollection of ld.elf not yet being implemented for
ia64 and trying to work around that.
Also, it might be helpful to understand why the issue is showing up
now. I think I committed this about 7 years ago.
Thanks
(Contact us)
$NetBSD: query-full-pr,v 1.47 2022/09/11 19:34:41 kim Exp $
$NetBSD: gnats_config.sh,v 1.9 2014/08/02 14:16:04 spz Exp $
Copyright © 1994-2023
The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.