NetBSD Problem Report #54844

From paul@whooppee.com  Wed Jan  8 13:39:24 2020
Return-Path: <paul@whooppee.com>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 9BC4B7A154
	for <gnats-bugs@gnats.NetBSD.org>; Wed,  8 Jan 2020 13:39:24 +0000 (UTC)
Message-Id: <20200108133852.7434A30F2C3@speedy.whooppee.com>
Date: Wed,  8 Jan 2020 05:38:52 -0800 (PST)
From: paul@whooppee.com
Reply-To: paul@whooppee.com
To: gnats-bugs@NetBSD.org
Subject: ``build.sh install-image'' fails with -V USE_PIGZGZIP=yes
X-Send-Pr-Version: 3.95

>Number:         54844
>Category:       install
>Synopsis:       ``build.sh install-image'' fails with -V USE_PIGZGZIP=yes
>Confidential:   no
>Severity:       non-critical
>Priority:       medium
>Responsible:    install-manager
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Wed Jan 08 13:40:00 +0000 2020
>Last-Modified:  Wed Jan 08 20:10:01 +0000 2020
>Originator:     Paul Goyette
>Release:        NetBSD 9.99.32
>Organization:
+--------------------+--------------------------+-----------------------+
| Paul Goyette       | PGP Key fingerprint:     | E-mail addresses:     |
| (Retired)          | FA29 0E3B 35AF E8AE 6651 | paul@whooppee.com     |
| Software Developer | 0786 F758 55DE 53BA 7731 | pgoyette@netbsd.org   |
+--------------------+--------------------------+-----------------------+
>Environment:


System: NetBSD speedy.whooppee.com 9.99.32 NetBSD 9.99.32 (SPEEDY 2020-01-01 13:34:35 UTC) #0: Wed Jan 1 16:22:29 UTC 2020 paul@speedy.whooppee.com:/build/netbsd-local/obj/amd64/sys/arch/amd64/compile/SPEEDY amd64
Architecture: x86_64
Machine: amd64
>Description:
``build.sh install-image'' fails with -V USE_PIGZGZIP=yes
===> build.sh command:    ./build.sh -T /build/netbsd-local/tools/x86_64/amd64 -D /build/netbsd-local/dest/amd64 -O /build/netbsd-local/obj/amd64 -R /build/netbsd-local/release -V RELEASEMACHINEDIR=amd64 -V MKDEBUG=yes -V MKKDEBUG=yes -V USE_PIGZGZIP=yes -U -x -N0 -m amd64 -j10 install-image
===> build.sh started:    Wed Jan  8 01:13:17 UTC 2020
===> NetBSD version:      9.99.34
===> MACHINE:             amd64
===> MACHINE_ARCH:        x86_64
===> Build platform:      NetBSD 9.99.32 amd64
===> HOST_SH:             /bin/sh
===> MAKECONF file:       /etc/mk.conf
===> TOOLDIR path:        /build/netbsd-local/tools/x86_64/amd64
===> DESTDIR path:        /build/netbsd-local/dest/amd64
===> RELEASEDIR path:     /build/netbsd-local/release
===> Updated makewrapper: /build/netbsd-local/tools/x86_64/amd64/bin/nbmake-amd64
install-image ===> etc
install_image ===> /build/netbsd-local/src_ro/distrib	(with: INSTIMG_RELEASEDIR=/build/netbsd-local/release/images)
install_image ===> /build/netbsd-local/src_ro/distrib/notes
install_image ===> /build/netbsd-local/src_ro/distrib/utils
install_image ===> /build/netbsd-local/src_ro/distrib/amd64
install_image ===> /build/netbsd-local/src_ro/distrib/amd64/installimage
creating MBR labels...
1+0 records in
1+0 records out
512 bytes transferred in 0.001 secs (512000 bytes/sec)
Making partition 0 active.
2048+0 records in
2048+0 records out
1048576 bytes transferred in 0.031 secs (33825032 bytes/sec)
Preparing /etc/fstab ...
Extracting kern-GENERIC.tgz ...
Extracting modules.tgz ...
Extracting base.tgz ...
Extracting etc.tgz ...
Copying secondary boot...
Setting rc_configured=YES in /etc/rc.conf ...
Copying extra dirs...
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/.
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/kern-GENERIC_KASLR.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/kern-XEN3_DOM0.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/kern-GENERIC.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/kern-XEN3_DOMU.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/tests.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/xbase.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/rescue.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/games.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/xdebug.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/MD5
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/SHA512
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/comp.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/etc.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/modules.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/misc.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/man.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/xserver.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/debug.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/xfont.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/text.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/xetc.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/base.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/sets/xcomp.tgz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/netbsd-XEN3_DOMU.gz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/netbsd-XEN3_DOM0.gz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/netbsd-GENERIC.gz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/netbsd-GENERIC_KASLR.gz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/netbsd-INSTALL_XEN3_DOMU.gz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/netbsd-INSTALL.gz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/MD5
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/SHA512
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/netbsd-INSTALL.symbols.gz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./binary/kernel/netbsd-GENERIC.symbols.gz
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation
./installation/cdrom >> <empty string>
./installation/cdrom/boot.iso >> <empty string>
./installation/cdrom/MD5 >> <empty string>
./installation/cdrom/SHA512 >> <empty string>
./installation/cdrom/boot-com.iso >> <empty string>
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation/misc
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation/misc/MD5
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation/misc/SHA512
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation/misc/pxeboot_ia32.bin
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation/miniroot
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation/miniroot/MD5
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation/miniroot/SHA512
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation/miniroot/miniroot.kmod
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./installation/miniroot/cgdroot.kmod
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./INSTALL.html
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./INSTALL.ps
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./INSTALL.txt
/build/netbsd-local/obj/amd64/distrib/amd64/installimage/work/amd64/./INSTALL.more
Copying extra files...
/build/netbsd-local/tools/x86_64/amd64/bin/x86_64--netbsd-install -c -m 0644 /build/netbsd-local/src_ro/distrib/amd64/installimage/etc.ttys work/etc/ttys
/build/netbsd-local/tools/x86_64/amd64/bin/x86_64--netbsd-install -c -m 0644 /build/netbsd-local/src_ro/distrib/amd64/installimage/etc.rc work/etc/rc
/build/netbsd-local/tools/x86_64/amd64/bin/x86_64--netbsd-install -c -m 0644 /build/netbsd-local/src_ro/distrib/amd64/installimage/install.sh work/.
/build/netbsd-local/tools/x86_64/amd64/bin/x86_64--netbsd-install -c -m 0644 /build/netbsd-local/obj/amd64/distrib/amd64/installimage/boot.cfg work/.
/build/netbsd-local/tools/x86_64/amd64/bin/x86_64--netbsd-install -c -m 0644 /build/netbsd-local/obj/amd64/usr.sbin/sysinst/arch/amd64/sysinstmsgs.de work/.
/build/netbsd-local/tools/x86_64/amd64/bin/x86_64--netbsd-install -c -m 0644 /build/netbsd-local/obj/amd64/usr.sbin/sysinst/arch/amd64/sysinstmsgs.es work/.
/build/netbsd-local/tools/x86_64/amd64/bin/x86_64--netbsd-install -c -m 0644 /build/netbsd-local/obj/amd64/usr.sbin/sysinst/arch/amd64/sysinstmsgs.fr work/.
/build/netbsd-local/tools/x86_64/amd64/bin/x86_64--netbsd-install -c -m 0644 /build/netbsd-local/obj/amd64/usr.sbin/sysinst/arch/amd64/sysinstmsgs.pl work/.
/build/netbsd-local/tools/x86_64/amd64/bin/x86_64--netbsd-install -c -m 0644 /build/netbsd-local/obj/amd64/usr.sbin/sysinst/arch/amd64/sysinst work/.
Preparing spec files for makefs...
Creating rootfs...
nbmakefs: `work' size of 1994883072 is larger than the maxsize of 1519386624.
*** Failed target:  imgroot.fs
*** Failed command: /build/netbsd-local/tools/x86_64/amd64/bin/nbmakefs -M 1519386624 -m 1519386624 -B 1234 -F work.spec -N work/etc -o bsize=16384,fsize=2048,density=8192 work.rootfs work
*** Error code 1
Stop.
nbmake[4]: stopped in /build/netbsd-local/src_ro/distrib/amd64/installimage
--- install_image ---
*** [install_image] Error code 1

nbmake[3]: stopped in /build/netbsd-local/src_ro/distrib/amd64
1 error

nbmake[3]: stopped in /build/netbsd-local/src_ro/distrib/amd64

*** Failed target:  install_image-amd64
*** Failed command: _makedirtarget() { dir="$1"; shift; target="$1"; shift; case "${dir}" in /*) this="${dir}/"; real="${dir}" ;; .) this="/build/netbsd-local/src_ro/distrib/"; real="/build/netbsd-local/src_ro/distrib" ;; *) this="/build/netbsd-local/src_ro/distrib/${dir}/"; real="/build/netbsd-local/src_ro/distrib/${dir}" ;; esac; show=${this:-.}; echo "${target} ===> ${show%/}${1:+ (with: $@)}"; cd "${real}" && /build/netbsd-local/tools/x86_64/amd64/bin/nbmake _THISDIR_="${this}" "$@" ${target}; }; _makedirtarget amd64 install_image
*** Error code 2
Stop.
nbmake[2]: stopped in /build/netbsd-local/src_ro/distrib
--- install-image ---
*** [install-image] Error code 1

nbmake[1]: stopped in /build/netbsd-local/src_ro/etc
1 error

nbmake[1]: stopped in /build/netbsd-local/src_ro/etc
--- install-image ---
*** [install-image] Error code 2

nbmake: stopped in /build/netbsd-local/src_ro

nbmake: stopped in /build/netbsd-local/src_ro
>How-To-Repeat:
See above

>Fix:
Unknown


>Audit-Trail:
From: Martin Husemann <martin@duskware.de>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: install/54844: ``build.sh install-image'' fails with -V
 USE_PIGZGZIP=yes
Date: Wed, 8 Jan 2020 15:05:37 +0100

 Not sure if we should support non standard options to this level, but
 you could try something like below.

 Martin

 Index: Makefile
 ===================================================================
 RCS file: /cvsroot/src/distrib/amd64/installimage/Makefile,v
 retrieving revision 1.10
 diff -u -r1.10 Makefile
 --- Makefile	15 Dec 2018 18:03:16 -0000	1.10
 +++ Makefile	8 Jan 2020 14:04:06 -0000
 @@ -4,7 +4,11 @@

  INSTIMGBASE=	NetBSD-${DISTRIBVER}-amd64-install	# gives ${IMGBASE}.img

 +.if ${USE_XZ_SETS:Uno} == "yes"
  INSTIMAGEMB?=	1450			# for all installation binaries
 +.else
 +INSTIMAGEMB?=	1950			# for all installation binaries
 +.endif

  PRIMARY_BOOT=		bootxx_ffsv1
  SECONDARY_BOOT=		boot

From: Paul Goyette <paul@whooppee.com>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: install/54844: ``build.sh install-image'' fails with -V
 USE_PIGZGZIP=yes (fwd)
Date: Wed, 8 Jan 2020 06:59:18 -0800 (PST)

 +--------------------+--------------------------+-----------------------+
 | Paul Goyette       | PGP Key fingerprint:     | E-mail addresses:     |
 | (Retired)          | FA29 0E3B 35AF E8AE 6651 | paul@whooppee.com     |
 | Software Developer | 0786 F758 55DE 53BA 7731 | pgoyette@netbsd.org   |
 +--------------------+--------------------------+-----------------------+

 ---------- Forwarded message ----------
 Date: Wed, 8 Jan 2020 06:58:30 -0800 (PST)
 From: Paul Goyette <paul@whooppee.com>
 To: Martin Husemann <martin@duskware.de>
 Subject: Re: install/54844: ``build.sh install-image'' fails with -V
      USE_PIGZGZIP=yes

 I'm not so sure this is just a size issue.  At one point I actually
 looked at the contents of the work directory, and found _another_
 work directory a couple levels down.  The lower-level work directory
 seemed to be the correct size.

 Perhaps there are some conflicting command-line args that work for
 xz but not for pigz?  (Guesing: Perhaps related to sym-links?)


 On Wed, 8 Jan 2020, Martin Husemann wrote:

 > The following reply was made to PR install/54844; it has been noted by GNATS.
 > 
 > From: Martin Husemann <martin@duskware.de>
 > To: gnats-bugs@netbsd.org
 > Cc:
 > Subject: Re: install/54844: ``build.sh install-image'' fails with -V
 > USE_PIGZGZIP=yes
 > Date: Wed, 8 Jan 2020 15:05:37 +0100
 > 
 > Not sure if we should support non standard options to this level, but
 > you could try something like below.
 > 
 > Martin
 > 
 > Index: Makefile
 > ===================================================================
 > RCS file: /cvsroot/src/distrib/amd64/installimage/Makefile,v
 > retrieving revision 1.10
 > diff -u -r1.10 Makefile
 > --- Makefile	15 Dec 2018 18:03:16 -0000	1.10
 > +++ Makefile	8 Jan 2020 14:04:06 -0000
 > @@ -4,7 +4,11 @@
 >
 >  INSTIMGBASE=	NetBSD-${DISTRIBVER}-amd64-install	# gives ${IMGBASE}.img
 > 
 > +.if ${USE_XZ_SETS:Uno} == "yes"
 >  INSTIMAGEMB?=	1450			# for all installation binaries
 > +.else
 > +INSTIMAGEMB?=	1950			# for all installation binaries
 > +.endif
 >
 >  PRIMARY_BOOT=		bootxx_ffsv1
 >  SECONDARY_BOOT=		boot
 > 
 > 
 > !DSPAM:5e15e2f6268761828113096!
 > 
 >

 +--------------------+--------------------------+-----------------------+
 | Paul Goyette       | PGP Key fingerprint:     | E-mail addresses:     |
 | (Retired)          | FA29 0E3B 35AF E8AE 6651 | paul@whooppee.com     |
 | Software Developer | 0786 F758 55DE 53BA 7731 | pgoyette@netbsd.org   |
 +--------------------+--------------------------+-----------------------+

From: Paul Goyette <paul@whooppee.com>
To: gnats-bugs@netbsd.org
Cc: martin@duskware.de
Subject: Re: install/54844: ``build.sh install-image'' fails with -V
 USE_PIGZGZIP=yes
Date: Wed, 8 Jan 2020 08:42:50 -0800 (PST)

 On Wed, 8 Jan 2020, Paul Goyette wrote:

 > I'm not so sure this is just a size issue.  At one point I actually
 > looked at the contents of the work directory, and found _another_
 > work directory a couple levels down.  The lower-level work directory
 > seemed to be the correct size.
 >
 > Perhaps there are some conflicting command-line args that work for
 > xz but not for pigz?  (Guesing: Perhaps related to sym-links?)

 Well, I just checked again, and I don't see the "nested" work directory.

 So perhapas setting the size as you suggest is appropriate.


 +--------------------+--------------------------+-----------------------+
 | Paul Goyette       | PGP Key fingerprint:     | E-mail addresses:     |
 | (Retired)          | FA29 0E3B 35AF E8AE 6651 | paul@whooppee.com     |
 | Software Developer | 0786 F758 55DE 53BA 7731 | pgoyette@netbsd.org   |
 +--------------------+--------------------------+-----------------------+

From: christos@zoulas.com (Christos Zoulas)
To: gnats-bugs@netbsd.org, install-manager@netbsd.org, 
	gnats-admin@netbsd.org, netbsd-bugs@netbsd.org, paul@whooppee.com
Cc: 
Subject: Re: install/54844: ``build.sh install-image'' fails with -V USE_PIGZGZIP=yes
Date: Wed, 8 Jan 2020 12:37:03 -0500

 On Jan 8,  4:45pm, paul@whooppee.com (Paul Goyette) wrote:
 -- Subject: Re: install/54844: ``build.sh install-image'' fails with -V USE_P

 | The following reply was made to PR install/54844; it has been noted by GNATS.
 | 
 | From: Paul Goyette <paul@whooppee.com>
 | To: gnats-bugs@netbsd.org
 | Cc: martin@duskware.de
 | Subject: Re: install/54844: ``build.sh install-image'' fails with -V
 |  USE_PIGZGZIP=yes
 | Date: Wed, 8 Jan 2020 08:42:50 -0800 (PST)
 | 
 |  On Wed, 8 Jan 2020, Paul Goyette wrote:
 |  
 |  > I'm not so sure this is just a size issue.  At one point I actually
 |  > looked at the contents of the work directory, and found _another_
 |  > work directory a couple levels down.  The lower-level work directory
 |  > seemed to be the correct size.
 |  >
 |  > Perhaps there are some conflicting command-line args that work for
 |  > xz but not for pigz?  (Guesing: Perhaps related to sym-links?)
 |  
 |  Well, I just checked again, and I don't see the "nested" work directory.
 |  
 |  So perhapas setting the size as you suggest is appropriate.

 But why is it that much bigger?

 christos

From: Paul Goyette <paul@whooppee.com>
To: gnats-bugs@netbsd.org
Cc: martin@duskware.de
Subject: Re: install/54844: ``build.sh install-image'' fails with -V
 USE_PIGZGZIP=yes
Date: Wed, 8 Jan 2020 12:07:51 -0800 (PST)

 On Wed, 8 Jan 2020, Paul Goyette wrote:

 > On Wed, 8 Jan 2020, Paul Goyette wrote:
 >
 >> I'm not so sure this is just a size issue.  At one point I actually
 >> looked at the contents of the work directory, and found _another_
 >> work directory a couple levels down.  The lower-level work directory
 >> seemed to be the correct size.
 >> 
 >> Perhaps there are some conflicting command-line args that work for
 >> xz but not for pigz?  (Guesing: Perhaps related to sym-links?)
 >
 > Well, I just checked again, and I don't see the "nested" work directory.
 >
 > So perhaps setting the size as you suggest is appropriate.

 Actually, the patch as-is doesn't work.  It seems that USE_XZ_SETS
 is still defined - for some reason USE_PIGZGZIP didn't unset it (at
 least, not for the install-image target).




 +--------------------+--------------------------+-----------------------+
 | Paul Goyette       | PGP Key fingerprint:     | E-mail addresses:     |
 | (Retired)          | FA29 0E3B 35AF E8AE 6651 | paul@whooppee.com     |
 | Software Developer | 0786 F758 55DE 53BA 7731 | pgoyette@netbsd.org   |
 +--------------------+--------------------------+-----------------------+

>Unformatted:

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.46 2020/01/03 16:35:01 leot Exp $
$NetBSD: gnats_config.sh,v 1.9 2014/08/02 14:16:04 spz Exp $
Copyright © 1994-2020 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.