NetBSD Problem Report #58076

From www@netbsd.org  Mon Mar 25 19:47:06 2024
Return-Path: <www@netbsd.org>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 1F76F1A9239
	for <gnats-bugs@gnats.NetBSD.org>; Mon, 25 Mar 2024 19:47:06 +0000 (UTC)
Message-Id: <20240325194704.719D51A923A@mollari.NetBSD.org>
Date: Mon, 25 Mar 2024 19:47:04 +0000 (UTC)
From: campbell+netbsd@mumble.net
Reply-To: campbell+netbsd@mumble.net
To: gnats-bugs@NetBSD.org
Subject: x86 live images don't support creds_msdos(8) and have confusing taxonomy
X-Send-Pr-Version: www-1.0

>Number:         58076
>Category:       install
>Synopsis:       x86 live images don't support creds_msdos(8) and have confusing taxonomy
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    install-manager
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Mon Mar 25 19:50:01 +0000 2024
>Last-Modified:  Sun Apr 14 09:30:01 +0000 2024
>Originator:     Taylor R Campbell
>Release:        current
>Organization:
The NetBSD Foundiso
>Environment:
>Description:
We have five different amd64 images and three different i386 images:

https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/amd64/installation/cdrom/boot.iso
https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-amd64-bios-install.img.gz
https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-amd64-install.img.gz
https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-amd64.iso
https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-amd64.iso

https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/i386/installation/cdrom/boot.iso
https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-i386-install.img.gz
https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-i386.iso

These are all qualitatively different from the arm64/armv7/riscv/octeon images like https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/evbarm-aarch64/binary/gzimg/arm64.img.gz and https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/evbmips-mips64eb/binary/gzimg/octeon.img.gz.

Here are some things that maybe distinguish them but I'm not sure and I'm not sure which is which:

- boots on CD vs use on r/w medium like USB/disk
- cd9660 vs ffs
- BIOS boot vs EFI boot
- MBR, disklabel, GPT
- boots into installer vs boots into live system
- has installation sets vs has no installation sets
- writes back to medium vs works in memory
- expands into medium or not (resize_root)
- supports creds.txt or not (creds_msdos)

I may have missed some properties too.
>How-To-Repeat:
try to navigate our dizzying array of images
>Fix:
Yes please!

I would like a smaller number of images, but short of that, I'd be satisfied with a clear description, maybe on a wiki page, of what these images are supposed to be and how to use them based on this rubric.

>Audit-Trail:
From: Izumi Tsutsui <tsutsui@ceres.dti.ne.jp>
To: gnats-bugs@netbsd.org
Cc: tsutsui@ceres.dti.ne.jp
Subject: Re: install/58076: x86 live images don't support creds_msdos(8) and
	 have confusing taxonomy
Date: Sun, 31 Mar 2024 00:47:15 +0900

 > >Synopsis:       x86 live images don't support creds_msdos(8) and have confusing taxonomy
  :
 > We have five different amd64 images and three different i386 images:
 > 
 > https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/amd64/installation/cdrom/boot.iso

 This is built in src/distrib/amd64/cdroms/bootcd and it includes
 only minimum boot files for rescue.

 > https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-amd64-bios-install.img.gz

 This is built in src/distrib/amd64/installimage-bios via
 build.sh install-image. It looks prepared for some BIOS machines
 that don't work with "Hybrid MBR boot code handover structure"
  https://www.fpmurphy.com/public/EDD-4_Hybrid_MBR_boot_code_annex.pdf

 > https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-amd64-install.img.gz

 This is built in src/distrib/amd64/installimage via
 build.sh install-image. See PR/45153 and PR/45155.

 These install images are built by Makefiles in src/distrib/common/bootimage.

 > https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-amd64.iso

 This is built in src/distrib/amd64/cdrom via build.sh iso-image.

 > https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/i386/installation/cdrom/boot.iso
 > https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-i386-install.img.gz
 > https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/images/NetBSD-10.99.10-i386.iso

 Same as amd64 (no UEFI version though).

 > These are all qualitatively different from the arm64/armv7/riscv/octeon images like https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/evbarm-aarch64/binary/gzimg/arm64.img.gz and https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202403200640Z/evbmips-mips64eb/binary/gzimg/octeon.img.gz.

 There is another install image build structure.
 I'm not sure if there were any PRs or discussions about this,
 but these images are created via src/distrib/utils/embedded.

 Makefiles in src/distrib/utils/embedded are invoked
 via "build.sh release" -> "make release" in src/etc
 -> "post_md_post" target in src/etc/etc.${MACHINE}/Makefile.inc
 -> "__mkimage" target in src/etc/etc.${MACHINE}/Makefile.inc
 -> src/distrib/utils/embedded/mkimage script using
    src/distrib/utils/embedded/conf/${h}.conf

 These are also includes /etc/rc.d/resize_root to expand partition size.

 ---
 Izumi Tsutsui

From: Taylor R Campbell <riastradh@NetBSD.org>
To: Izumi Tsutsui <tsutsui@ceres.dti.ne.jp>
Cc: install-manager@NetBSD.org, gnats-admin@NetBSD.org,
	netbsd-bugs@NetBSD.org, gnats-bugs@NetBSD.org
Subject: Re: install/58076: x86 live images don't support creds_msdos(8) and
	have confusing taxonomy
Date: Sat, 13 Apr 2024 13:53:02 +0000

 Thanks!  I forgot one other image:

 https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202404041900Z/images/NetBSD-=
 10.99.10-amd64-live.img.gz

 This is produced by build.sh live-image, and is currently
 BIOS-boot-only (but may soon boot with UEFI, perhaps).

 build.sh live-image descends into

 src/Makefile live-image
 src/etc/Makefile live-image
 src/distrib/Makefile live_image
 src/distrib/amd64/Makefile live_image
 src/distrib/amd64/liveimage/Makefile live_image
 src/distrib/amd64/liveimage/emuimage/Makefile live_image
 .include src/distrib/amd64/liveimage/Makefile.liveimage
 .include src/distrib/common/bootimage/Makefile.liveimage

From: Izumi Tsutsui <tsutsui@ceres.dti.ne.jp>
To: riastradh@NetBSD.org
Cc: gnats-bugs@NetBSD.org, tsutsui@ceres.dti.ne.jp
Subject: Re: install/58076: x86 live images don't support creds_msdos(8) andhave
	 confusing taxonomy
Date: Sun, 14 Apr 2024 02:35:09 +0900

 riastradh@ wrote:

 > Thanks!  I forgot one other image:
 > 
 > https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202404041900Z/images/NetBSD-10.99.10-amd64-live.img.gz

 We have to ask to admins which images will be built and installed
 onto our ftp release dirs..

 > This is produced by build.sh live-image, and is currently
 > BIOS-boot-only (but may soon boot with UEFI, perhaps).

 Building UEFI version should be trivial, maybe like this:
 (untested; see comments in src/distrib/common/bootimage/Makefile.bootimage)

 Index: Makefile.liveimage
 ===================================================================
 RCS file: /cvsroot/src/distrib/amd64/liveimage/Makefile.liveimage,v
 retrieving revision 1.2
 diff -u -p -d -r1.2 Makefile.liveimage
 --- Makefile.liveimage	15 Dec 2018 18:03:17 -0000	1.2
 +++ Makefile.liveimage	13 Apr 2024 17:31:20 -0000
 @@ -7,6 +7,11 @@ PRIMARY_BOOT=		bootxx_ffsv1
  SECONDARY_BOOT=		boot
  SECONDARY_BOOT_ARG=	# unnecessary

 +EFIBOOT=		${WORKDIR}/usr/mdec/bootx64.efi
 +EFIBOOT+=		${WORKDIR}/usr/mdec/bootia32.efi
 +
  USE_MBR=		yes
 +USE_GPT=		yes
 +USE_GPTMBR=		yes

  .include "${.CURDIR}/../../../common/bootimage/Makefile.liveimage"
 Index: emuimage/Makefile
 ===================================================================
 RCS file: /cvsroot/src/distrib/amd64/liveimage/emuimage/Makefile,v
 retrieving revision 1.9
 diff -u -p -d -r1.9 Makefile
 --- emuimage/Makefile	24 Jul 2021 16:13:44 -0000	1.9
 +++ emuimage/Makefile	13 Apr 2024 17:31:20 -0000
 @@ -13,6 +13,6 @@ SPEC_EXTRA=	${.CURDIR}/spec.emuimage
  RC_CONF_EXTRA=	${.CURDIR}/rc.conf.emuimage
  IMGFILE_EXTRA=								\
  	${FILESDIR}/ec2_init		etc/rc.d/ec2_init		\
 -	${FILESDIR}/resize_disklabel	etc/rc.d/resize_disklabel
 +	${FILESDIR}/resize_disklabel	etc/rc.d/resize_gpt

  .include "${.CURDIR}/../Makefile.liveimage"

 ---

From: Martin Husemann <martin@duskware.de>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: install/58076: x86 live images don't support creds_msdos(8)
 andhave confusing taxonomy
Date: Sun, 14 Apr 2024 11:29:48 +0200

 On Sat, Apr 13, 2024 at 05:40:02PM +0000, Izumi Tsutsui wrote:
 >  We have to ask to admins which images will be built and installed
 >  onto our ftp release dirs..

 The currently used build.sh command line for amd64 builds on the build
 cluster is:

 ....  release iso-image install-image live-image

 and to change this just drop releng@NetBSD.org a mail.


 Martin

Home	PR Database Search