NetBSD Problem Report #57378

From beceeh@shaw.ca  Tue Apr 25 05:32:01 2023
Return-Path: <beceeh@shaw.ca>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 67AA01A9239
	for <gnats-bugs@gnats.NetBSD.org>; Tue, 25 Apr 2023 05:32:01 +0000 (UTC)
Message-Id: <20230425041537.A370936DC4@katy.localdomain>
Date: Mon, 24 Apr 2023 21:15:37 -0700 (PDT)
From: Bch <beceeh@shaw.ca>
Reply-To: brad.harder@gmail.com
To: gnats-bugs@NetBSD.org
Cc: brad.harder@gmail.com
Subject: Issue with set/checkflist
X-Send-Pr-Version: 3.95

>Number:         57378
>Category:       toolchain
>Synopsis:       issue w/ set/checkflist, ... since compiler update this winter
>Confidential:   no
>Severity:       non-critical
>Priority:       medium
>Responsible:    toolchain-manager
>State:          open
>Class:          support
>Submitter-Id:   net
>Arrival-Date:   Tue Apr 25 05:35:00 +0000 2023
>Last-Modified:  Thu May 25 01:35:01 +0000 2023
>Originator:     Bch
>Release:        NetBSD 10.99.4
>Organization:
	method logic digital
>Environment:
System: NetBSD katy 10.99.4 NetBSD 10.99.4 (GENERIC) #745: Sun Apr 23 14:10:05 PDT 2023 root@katy:/usr/obj/sys/arch/amd64/compile/GENERIC amd64
Architecture: x86_64
Machine: amd64
>Description:

katy# ./build.sh -j4 -u -x distribution

[...]
checkflist ===> distrib/sets
--- check_DESTDIR ---
--- sanitise_METALOG ---
--- checkflist ---
cd /usr/src/distrib/sets &&  DESTDIR=/usr/src/obj/destdir.amd64  MACHINE=amd64  MACHINE_ARCH=x86_64  AWK=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbawk  CKSUM=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbcksum  DB=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbdb  EGREP=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbgrep\ -E  HOST_SH=/bin/sh  MAKE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmake  MKTEMP=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmktemp  MTREE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmtree  PAX=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbpax  COMPRESS_PROGRAM=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbxz  GZIP=-n  XZ_OPT=-9  TAR_SUFF=tar.xz  PKG_CREATE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbpkg_create  SED=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbsed  TSORT=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbtsort\ -q  /bin/sh /usr/src/distrib/sets/checkflist  -L base,x
=======  1 extra files in DESTDIR  =========
Files in DESTDIR but missing from flist.
File is obsolete or flist is out of date ?
------------------------------------------
./usr/libexec/ld.elf_so
=========  end of 1 extra files  ===========
*** Failed target: checkflist
*** Failed commands:
        ${SETSCMD} ${.CURDIR}/checkflist  ${MAKEFLIST_FLAGS} ${CHECKFLIST_FLAGS} ${METALOG.unpriv}
        => cd /usr/src/distrib/sets &&  DESTDIR=/usr/src/obj/destdir.amd64  MACHINE=amd64  MACHINE_ARCH=x86_64  AWK=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbawk  CKSUM=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbcksum  DB=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbdb  EGREP=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbgrep\ -E  HOST_SH=/bin/sh  MAKE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmake  MKTEMP=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmktemp  MTREE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbmtree  PAX=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbpax  COMPRESS_PROGRAM=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbxz  GZIP=-n  XZ_OPT=-9  TAR_SUFF=tar.xz  PKG_CREATE=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbpkg_create  SED=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbsed  TSORT=/usr/src/obj/tooldir.NetBSD-10.99.4-amd64/bin/nbtsort\ -q  /bin/sh /usr/src/distrib/sets/checkflist  -L base,x
*** [checkflist] Error code 1
nbmake[1]: stopped in /usr/src/distrib/sets
1 error
nbmake[1]: stopped in /usr/src/distrib/sets

nbmake: stopped in /usr/src

ERROR: Failed to make distribution

*** BUILD ABORTED ***

>How-To-Repeat:
	./build.sh [...] distriubtion, w/ or w/o -u, multiple jobs, ...
>Fix:

>Audit-Trail:
From: Taylor R Campbell <riastradh@NetBSD.org>
To: gnats-bugs@netbsd.org
Cc: toolchain-manager@netbsd.org, gnats-admin@netbsd.org, netbsd-bugs@netbsd.org
Subject: Re: toolchain/57378: Issue with set/checkflist
Date: Tue, 25 Apr 2023 11:34:52 +0000

 > Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)
 > From: Bch <beceeh@shaw.ca>
 > 
 > =======  1 extra files in DESTDIR  =========
 > Files in DESTDIR but missing from flist.
 > File is obsolete or flist is out of date ?
 > ------------------------------------------
 > ./usr/libexec/ld.elf_so

 I haven't seen this and it hasn't turned up in the autobuilds.  Is
 this from a clean objdir?  If not, can you try that?

From: bch <brad.harder@gmail.com>
To: gnats-bugs@netbsd.org
Cc: gnats-admin@netbsd.org, netbsd-bugs@netbsd.org, 
	toolchain-manager@netbsd.org
Subject: Re: toolchain/57378: Issue with set/checkflist
Date: Wed, 24 May 2023 12:37:36 -0700

 --000000000000703d6305fc75a3b8
 Content-Type: text/plain; charset="UTF-8"
 Content-Transfer-Encoding: quoted-printable

 On Tue, Apr 25, 2023 at 04:40 Taylor R Campbell <riastradh@netbsd.org>
 wrote:

 > The following reply was made to PR toolchain/57378; it has been noted by
 > GNATS.
 >
 > From: Taylor R Campbell <riastradh@NetBSD.org>
 > To: gnats-bugs@netbsd.org
 > Cc: toolchain-manager@netbsd.org, gnats-admin@netbsd.org,
 > netbsd-bugs@netbsd.org
 > Subject: Re: toolchain/57378: Issue with set/checkflist
 > Date: Tue, 25 Apr 2023 11:34:52 +0000
 >
 >  > Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)
 >  > From: Bch <beceeh@shaw.ca>
 >  >
 >  > =3D=3D=3D=3D=3D=3D=3D  1 extra files in DESTDIR  =3D=3D=3D=3D=3D=3D=3D=
 =3D=3D
 >  > Files in DESTDIR but missing from flist.
 >  > File is obsolete or flist is out of date ?
 >  > ------------------------------------------
 >  > ./usr/libexec/ld.elf_so
 >
 >  I haven't seen this and it hasn't turned up in the autobuilds.  Is
 >  this from a clean objdir?  If not, can you try that?



 Hey riastradh - I think I=E2=80=99ve isolated it to MKDYNAMICROOT =3D no.

 Happy to take instruction to test this further - I=E2=80=99m interested in
 understanding our flist facilities more, this might be a good opportunity.

 Kind regards,
 -bch


 >
 >

 --000000000000703d6305fc75a3b8
 Content-Type: text/html; charset="UTF-8"
 Content-Transfer-Encoding: quoted-printable

 <div><br></div><div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=
 =3D"gmail_attr">On Tue, Apr 25, 2023 at 04:40 Taylor R Campbell &lt;<a href=
 =3D"mailto:riastradh@netbsd.org">riastradh@netbsd.org</a>&gt; wrote:<br></d=
 iv><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left=
 :1px #ccc solid;padding-left:1ex">The following reply was made to PR toolch=
 ain/57378; it has been noted by GNATS.<br>
 <br>
 From: Taylor R Campbell &lt;riastradh@NetBSD.org&gt;<br>
 To: <a href=3D"mailto:gnats-bugs@netbsd.org" target=3D"_blank">gnats-bugs@n=
 etbsd.org</a><br>
 Cc: <a href=3D"mailto:toolchain-manager@netbsd.org" target=3D"_blank">toolc=
 hain-manager@netbsd.org</a>, <a href=3D"mailto:gnats-admin@netbsd.org" targ=
 et=3D"_blank">gnats-admin@netbsd.org</a>, <a href=3D"mailto:netbsd-bugs@net=
 bsd.org" target=3D"_blank">netbsd-bugs@netbsd.org</a><br>
 Subject: Re: toolchain/57378: Issue with set/checkflist<br>
 Date: Tue, 25 Apr 2023 11:34:52 +0000<br>
 <br>
 =C2=A0&gt; Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)<br>
 =C2=A0&gt; From: Bch &lt;<a href=3D"mailto:beceeh@shaw.ca" target=3D"_blank=
 ">beceeh@shaw.ca</a>&gt;<br>
 =C2=A0&gt; <br>
 =C2=A0&gt; =3D=3D=3D=3D=3D=3D=3D=C2=A0 1 extra files in DESTDIR=C2=A0 =3D=
 =3D=3D=3D=3D=3D=3D=3D=3D<br>
 =C2=A0&gt; Files in DESTDIR but missing from flist.<br>
 =C2=A0&gt; File is obsolete or flist is out of date ?<br>
 =C2=A0&gt; ------------------------------------------<br>
 =C2=A0&gt; ./usr/libexec/ld.elf_so<br>
 <br>
 =C2=A0I haven&#39;t seen this and it hasn&#39;t turned up in the autobuilds=
 .=C2=A0 Is<br>
 =C2=A0this from a clean objdir?=C2=A0 If not, can you try that?</blockquote=
 ><div dir=3D"auto"><br></div><div dir=3D"auto"><br></div><div dir=3D"auto">=
 Hey riastradh - I think I=E2=80=99ve isolated it to MKDYNAMICROOT =3D no.</=
 div><div dir=3D"auto"><br></div><div dir=3D"auto">Happy to take instruction=
  to test this further - I=E2=80=99m interested in understanding our flist f=
 acilities more, this might be a good opportunity.</div><div dir=3D"auto"><b=
 r></div><div dir=3D"auto">Kind regards,</div><div dir=3D"auto">-bch=C2=A0</=
 div><div dir=3D"auto"><br></div><blockquote class=3D"gmail_quote" style=3D"=
 margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" dir=3D"auto"=
 ><br>
 <br>
 </blockquote></div></div>

 --000000000000703d6305fc75a3b8--

From: Taylor R Campbell <riastradh@NetBSD.org>
To: bch <brad.harder@gmail.com>
Cc: gnats-bugs@netbsd.org, gnats-admin@netbsd.org,
	netbsd-bugs@netbsd.org, toolchain-manager@netbsd.org
Subject: Re: toolchain/57378: Issue with set/checkflist
Date: Wed, 24 May 2023 19:51:16 +0000

 > Date: Wed, 24 May 2023 12:37:36 -0700
 > From: bch <brad.harder@gmail.com>
 >=20
 > On Tue, Apr 25, 2023 at 04:40 Taylor R Campbell <riastradh@netbsd.org>
 > wrote:
 >=20
 > > > Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)
 > > > From: Bch <beceeh@shaw.ca>
 > > >
 > > > =3D=3D=3D=3D=3D=3D=3D  1 extra files in DESTDIR  =3D=3D=3D=3D=3D=3D=
 =3D=3D=3D
 > > > Files in DESTDIR but missing from flist.
 > > > File is obsolete or flist is out of date ?
 > > > ------------------------------------------
 > > > ./usr/libexec/ld.elf_so
 > >
 > >  I haven't seen this and it hasn't turned up in the autobuilds.  Is
 > > this from a clean objdir?  If not, can you try that?
 >=20
 > Hey riastradh - I think I've isolated it to MKDYNAMICROOT =3D no.
 >=20
 > Happy to take instruction to test this further - I'm interested in
 > understanding our flist facilities more, this might be a good opportunity.

 It looks like there is a spurious `dynamicroot' condition on the
 /usr/libexec/ld.elf_so entry, which should instead be unconditional.

 The condition may have been added by mistake by scole@ in 2016 for
 this PR to fix various ia64 build issues:

 https://gnats.netbsd.org/51261

 The PR has a comment about it suggesting it was intentional:

  M distrib/sets/lists/base/shl.mi		# change dynamicroot for ./lib/npf*, usr=
 /libexec/ld.elf_so

 But I don't think that makes sense, because /usr/libexec/ld.elf_so is
 always there (it's a regular file with MKDYNAMICROOT=3Dno, a symlink
 with MKDYNAMICROOT=3Dyes), whereas /libexec/ld.elf_so is correctly
 conditioned on `dynamicroot'.

From: Sean Cole <scole@NetBSD.org>
To: Taylor R Campbell <riastradh@NetBSD.org>
Cc: bch <brad.harder@gmail.com>, gnats-bugs@netbsd.org, gnats-admin@netbsd.org,
        netbsd-bugs@netbsd.org, toolchain-manager@netbsd.org
Subject: Re: toolchain/57378: Issue with set/checkflist
Date: Thu, 25 May 2023 08:34:28 +0700

 Taylor R Campbell <riastradh@NetBSD.org> writes:

 >> Date: Wed, 24 May 2023 12:37:36 -0700
 >> From: bch <brad.harder@gmail.com>
 >> 
 >> On Tue, Apr 25, 2023 at 04:40 Taylor R Campbell <riastradh@netbsd.org>
 >> wrote:
 >> 
 >> > > Date: Tue, 25 Apr 2023 05:35:00 +0000 (UTC)
 >> > > From: Bch <beceeh@shaw.ca>
 >> > >
 >> > > =======  1 extra files in DESTDIR  =========
 >> > > Files in DESTDIR but missing from flist.
 >> > > File is obsolete or flist is out of date ?
 >> > > ------------------------------------------
 >> > > ./usr/libexec/ld.elf_so
 >> >
 >> >  I haven't seen this and it hasn't turned up in the autobuilds.  Is
 >> > this from a clean objdir?  If not, can you try that?
 >> 
 >> Hey riastradh - I think I've isolated it to MKDYNAMICROOT = no.
 >> 
 >> Happy to take instruction to test this further - I'm interested in
 >> understanding our flist facilities more, this might be a good opportunity.
 >
 > It looks like there is a spurious `dynamicroot' condition on the
 > /usr/libexec/ld.elf_so entry, which should instead be unconditional.
 >
 > The condition may have been added by mistake by scole@ in 2016 for
 > this PR to fix various ia64 build issues:
 >
 > https://gnats.netbsd.org/51261
 >
 > The PR has a comment about it suggesting it was intentional:
 >
 >  M distrib/sets/lists/base/shl.mi # change dynamicroot for ./lib/npf*,
 > usr/libexec/ld.elf_so
 >
 > But I don't think that makes sense, because /usr/libexec/ld.elf_so is
 > always there (it's a regular file with MKDYNAMICROOT=no, a symlink
 > with MKDYNAMICROOT=yes), whereas /libexec/ld.elf_so is correctly
 > conditioned on `dynamicroot'.

 Feel free to change to whatever makes sense.

 I am not sure of the exact details for this particular change anymore,
 but have a vague recollection of ld.elf not yet being implemented for
 ia64 and trying to work around that.

 Also, it might be helpful to understand why the issue is showing up
 now.  I think I committed this about 7 years ago.

 Thanks

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.47 2022/09/11 19:34:41 kim Exp $
$NetBSD: gnats_config.sh,v 1.9 2014/08/02 14:16:04 spz Exp $
Copyright © 1994-2023 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.