NetBSD Problem Report #48157

From Wolfgang.Stukenbrock@nagler-company.com  Tue Aug 27 13:34:53 2013
Return-Path: <Wolfgang.Stukenbrock@nagler-company.com>
Received: from mail.netbsd.org (mail.netbsd.org [149.20.53.66])
	(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "Postmaster NetBSD.org" (verified OK))
	by mollari.NetBSD.org (Postfix) with ESMTPS id D939471969
	for <gnats-bugs@gnats.NetBSD.org>; Tue, 27 Aug 2013 13:34:53 +0000 (UTC)
Message-Id: <20130827133442.EAF76123B93@test-s0.nagler-company.com>
Date: Tue, 27 Aug 2013 15:34:42 +0200 (CEST)
From: Wolfgang.Stukenbrock@nagler-company.com
Reply-To: Wolfgang.Stukenbrock@nagler-company.com
To: gnats-bugs@gnats.NetBSD.org
Subject: pkgsrc 2013Q2 make-system exeeds max. command line length
X-Send-Pr-Version: 3.95

>Number:         48157
>Category:       pkg
>Synopsis:       pkgsrc 2013Q2 make-system exeeds max. command line length
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    pkg-manager
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Tue Aug 27 13:35:00 +0000 2013
>Last-Modified:  Sat Dec 21 19:50:01 +0000 2013
>Originator:     Dr. Wolfgang Stukenbrock
>Release:        NetBSD 6.1 / pkgsrc-2013Q2
>Organization:
Dr. Nagler & Company GmbH
>Environment:


System: NetBSD test-s0 5.1.2 NetBSD 5.1.2 (NSW-WS) #3: Fri Dec 21 15:15:43 CET 2012 wgstuken@test-s0:/usr/src/sys/arch/amd64/compile/NSW-WS amd64
Architecture: x86_64
Machine: amd64
>Description:
	While trying to build math/R with "make -D ALLOW_VULNERABLE_PACKAGES bin-install" I've got the error message
	"make: exec(/bin/sh) failed (Argument list too long)".
	When running make without "-D ALLOW_VULNERABLE_PACKAGE" it succeeds.
	I've tried to figure out the problem and run "make -d e -D ALLOW_VULNERABLE_PACKAGES bin-install".
	Now I get the same error message and the failed command dumped is:
*** Failed target:  barrier
*** Failed command: set -e; if test -n "" && /usr/pkg/sbin/pkg_info -K /var/db/pkg -qe dialog-1.2.20130523; then echo ===\> "Skipping installation of already handled package"; else cd /usr/pkgsrc-2013Q2/misc/dialog && /usr/bin/env MAKECONF=/etc/mk.conf PATH=/usr/pkgsrc-2013Q2/misc/dialog/work/.wrapper/bin:/usr/pkgsrc-2013Q2/misc/dialog/work/.buildlink/bin:/usr/pkgsrc-2013Q2/misc/dialog/work/.gcc/bin:/usr/pkgsrc-2013Q2/misc/dialog/work/.tools/bin:/usr/pkg/bin:/sbin:/bin:/usr/bin:/usr/sbin:/ USE_DESTDIR=yes /usr/bin/make -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNE
 RABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_
 VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULN
...... (many many many times '-d e -D ALLOW_VULNERABLE_PACKAGES' again) .....
-d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES DEPENDS_TARGET=bin-install HOST_OSTYPE=NetBSD-6.1-amd64 LOWER_OPSYS=netbsd OPSYS=NetBSD OS_VERSION=6.1 PKGTOOLS_VERSION=20130131 PKG_BUILD_OPTIONS.MesaLib=dri\ dri PKG_BUILD_OPTIONS.cairo=x11\ xcb PKG_BUILD_OPTIONS.tk=threads\ xft2 _AUTOMATIC=yes _CC=/usr/bin/gcc _MAKE=/usr/bin/make _PATH_ORIG=/sbin:/bin:/usr/bin:/usr/sbin:/ _PKGSRCDIR=/usr/pkgsrc-2013Q2 _SRC_TOP_= LOWER_OPSYS=netbsd clean; /usr/bin/env MAKECONF=/etc/mk.conf PATH=/usr/pkgsrc-2013Q2/misc/dialog/work/.wrapper/bin:/usr/pkgsrc-2013Q2/misc/dialog/work/.buildlink/bin:/usr/pkgsrc-2013Q2/misc/dialog/work/.gcc/bin:/usr/pkgsrc-2013Q2/misc/dialog/work/.tools/bin:/usr/pkg/bin:/sbin:/bin:/usr/bin:/usr/sbin:/ USE_DESTDIR=yes /usr/bin/make -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VUL
 NERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNER
 ABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNE
...... (many many many times '-d e -D ALLOW_VULNERABLE_PACKAGES' again) .....
CKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES -d e -D ALLOW_VULNERABLE_PACKAGES DEPENDS_TARGET=bin-install HOST_OSTYPE=NetBSD-6.1-amd64 LOWER_OPSYS=netbsd OPSYS=NetBSD OS_VERSION=6.1 PKGTOOLS_VERSION=20130131 PKG_BUILD_OPTIONS.MesaLib=dri\ dri PKG_BUILD_OPTIONS.cairo=x11\ xcb PKG_BUILD_OPTIONS.tk=threads\ xft2 _AUTOMATIC=yes _CC=/usr/bin/gcc _MAKE=/usr/bin/make _PATH_ORIG=/sbin:/bin:/usr/bin:/usr/sbin:/ _PKGSRCDIR=/usr/pkgsrc-2013Q2 _SRC_TOP_= LOWER_OPSYS=netbsd build ;; esac
*** Error code 1

	Hmm. It looks like the command options are placed on the command line again and again and again ... not very smart.
	There is a call to make with target 'clean' and a call to make with taget 'build'.
	The same happens if I try to use MAKEFLAGS environment variable for "-D ALLOW_VULNERABLE_PACKAGES".

	Remark: the command with target 'install' does not trigger the problem. It looks like there is an additional recursive call to make in case of
	'bin-install' and that will double the command line.
>How-To-Repeat:
	Try to compile math/R as descried above on a fresh system with out the dependencies installed (or present as binary packages)
>Fix:
	Not prepared till now - sorry, but the make-files of pkgsrc look not trivial to me.
	And someone with deeper knowledge to this make system will find the place to fix this much faster ...

	But the fix is clear: avoid adding the same options on the command line again and again ....

>Audit-Trail:
From: Wolfgang Stukenbrock <wolfgang.stukenbrock@nagler-company.com>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line length
Date: Mon, 30 Sep 2013 11:42:04 +0200

 Hi, I've just found additional packages, that are affected by this problem:

 print/teTex3-bin
 print/teTeX

 best regards

 W. Stukenbrock

 gnats-admin@NetBSD.org wrote:

 > Thank you very much for your problem report.
 > It has the internal identification `pkg/48157'.
 > The individual assigned to look at your
 > report is: pkg-manager. 
 > 
 > 
 >>Category:       pkg
 >>Responsible:    pkg-manager
 >>Synopsis:       pkgsrc 2013Q2 make-system exeeds max. command line length
 >>Arrival-Date:   Tue Aug 27 13:35:00 +0000 2013
 >>
 > 
 > 
 > 
 > Received: from AMSPR07MB035.eurprd07.prod.outlook.com (10.242.81.23) by
 >  AMSPR07MB034.eurprd07.prod.outlook.com (10.242.81.20) with Microsoft SMTP
 >  Server (TLS) id 15.0.745.25 via Mailbox Transport; Tue, 27 Aug 2013 13:35:42
 >  +0000
 > Received: from AMSPR07MB164.eurprd07.prod.outlook.com (10.242.86.151) by
 >  AMSPR07MB035.eurprd07.prod.outlook.com (10.242.81.23) with Microsoft SMTP
 >  Server (TLS) id 15.0.745.25; Tue, 27 Aug 2013 13:35:41 +0000
 > Received: from AMSPRD0711HT002.eurprd07.prod.outlook.com (10.242.14.163) by
 >  AMSPR07MB164.eurprd07.prod.outlook.com (10.242.86.151) with Microsoft SMTP
 >  Server (TLS) id 15.0.745.25; Tue, 27 Aug 2013 13:35:40 +0000
 > Received: from AMSPRD0711HT003.eurprd07.prod.outlook.com (10.242.14.164) by
 >  AMSPRD0711HT002.eurprd07.prod.outlook.com (10.242.14.163) with Microsoft SMTP
 >  Server (TLS) id 14.16.347.3; Tue, 27 Aug 2013 13:35:14 +0000
 > Received: from mail199-va3-R.bigfish.com (216.32.180.113) by
 >  AMSPRD0711HT003.eurprd07.prod.outlook.com (10.242.14.164) with Microsoft SMTP
 >  Server (TLS) id 14.16.347.3; Tue, 27 Aug 2013 13:35:13 +0000
 > Received: from mail199-va3 (localhost [127.0.0.1])	by
 >  mail199-va3-R.bigfish.com (Postfix) with ESMTP id DF1F92E016C	for
 >  <wolfgang.stukenbrock@nagler-company.com>; Tue, 27 Aug 2013 13:35:12 +0000
 >  (UTC)
 > X-Forefront-Antispam-Report: CIP:212.185.86.227;KIP:(null);UIP:(null);IPV:NLI;H:e002.nagler-company.com;RD:e002.nagler-company.com;EFVD:NLISFV:NSPM;SFS:(199002)(189002)(45984002)(36882001)(59766001)(77982001)(79102001)(52956002)(33656001)(16276001)(45336002)(51856001)(81816001)(42186004)(54356001)(46386002)(74366001)(83072001)(83322001)(70486001)(65816001)(80022001)(46102001)(69226001)(80976001)(48376002)(74706001)(81686001)(74876001)(50466002)(6806004)(43066001)(47446002)(74662001)(74502001)(54316002)(56776001)(76482001)(50986001)(47976001)(81542001)(81342001)(49866001)(47736001)(4396001)(77096001)(56816003)(76796001)(76786001)(20776003)(47776003)(63696002)(40753002);DIR:INB;SFP:;SCL:1;SRVR:AMSPR07MB164;H:AMSPRD0711HT002.eurprd07.prod.outlook.com;CLIP:212.185.86.227;RD:e002.nagler-company.com;A:1;MX:1;LANG:en;
 > X-SpamScore: -2
 > X-BigFish: ps-2(zfebmz11f6Nzz1f42he68I208ch1ee6h1de0h1fdah2073h1202h1e76h1d1ah1d2ah1fc6hzzz2dh2a8h839hd25h107ah10d2h11b5h121eh1288h12a5h12a9h12bdh12e5h137ah13b6h13eah1441h14afh1537h153bh162dh1631h1758h18e1h1946h19b5h1b0ah1b88h1d0ch1d2eh1d3fh1dfeh1dffh1e1dh1fe8h1ff5h1155h)
 > X-FFO-Routing-Override: nagler-company.com%inboundsmtpprofile-282668.customer.frontbridge.com;
 > Received: from mail199-va3 (localhost.localdomain [127.0.0.1]) by mail199-va3
 >  (MessageSwitch) id 1377610510816835_20355; Tue, 27 Aug 2013 13:35:10 +0000
 >  (UTC)
 > Received: from VA3EHSMHS021.bigfish.com (unknown [10.7.14.229])	by
 >  mail199-va3.bigfish.com (Postfix) with ESMTP id B872C2C0040	for
 >  <wolfgang.stukenbrock@nagler-company.com>; Tue, 27 Aug 2013 13:35:10 +0000
 >  (UTC)
 > Received: from e002.nagler-company.com (212.185.86.227) by
 >  VA3EHSMHS021.bigfish.com (10.7.99.31) with Microsoft SMTP Server (TLS) id
 >  14.16.227.3; Tue, 27 Aug 2013 13:35:10 +0000
 > Received: from mollari.NetBSD.org (blog.netbsd.org [149.20.53.80])	by
 >  e002.nagler-company.com (8.14.5/8.14.5) with ESMTP id r7RDZ5bR025799	for
 >  <Wolfgang.Stukenbrock@nagler-company.com>; Tue, 27 Aug 2013 15:35:08 +0200
 >  (CEST)
 > Received: by mollari.NetBSD.org (Postfix, from userid 31008)	id 0092071A7D;
 >  Tue, 27 Aug 2013 13:35:01 +0000 (UTC)
 > From: <gnats-admin@NetBSD.org>
 > To: <Wolfgang.Stukenbrock@nagler-company.com>
 > Reply-To: <gnats-bugs@NetBSD.org>
 > Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line length
 > References: <pr-pkg-48157@gnats.netbsd.org> <20130827133442.EAF76123B93@test-s0.nagler-company.com>
 > In-Reply-To: <20130827133442.EAF76123B93@test-s0.nagler-company.com>
 > Message-ID: <20130827133501.0092071A7D@mollari.NetBSD.org>
 > Date: Tue, 27 Aug 2013 13:35:01 +0000
 > Content-Type: text/plain
 > Return-Path: gnats@NetBSD.org
 > X-MS-Exchange-Organization-MessageDirectionality: Incoming
 > X-MS-Exchange-Organization-SCL: 1
 > X-MS-Exchange-Organization-AVStamp-Mailbox: MSFTFF;1;0;0 0 0
 > X-MS-Exchange-Organization-Network-Message-Id: 9e2db67e-9438-4618-4a20-08d0714174b1
 > X-MS-Exchange-Organization-AVStamp-Service: 1.0
 > Received-SPF: None (: NetBSD.org does not designate permitted sender hosts)
 > X-MS-Exchange-Organization-AuthSource: AMSPRD0711HT003.eurprd07.prod.outlook.com
 > X-MS-Exchange-Organization-AuthAs: Anonymous
 > MIME-Version: 1.0
 > 
 > Thank you very much for your problem report.
 > It has the internal identification `pkg/48157'.
 > The individual assigned to look at your
 > report is: pkg-manager. 
 > 
 > 
 >>Category:       pkg
 >>Responsible:    pkg-manager
 >>Synopsis:       pkgsrc 2013Q2 make-system exeeds max. command line length
 >>Arrival-Date:   Tue Aug 27 13:35:00 +0000 2013
 >>
 > 
 > 


 -- 


 Dr. Nagler & Company GmbH
 Hauptstraße 9
 92253 Schnaittenbach

 Tel. +49 9622/71 97-42
 Fax +49 9622/71 97-50

 Wolfgang.Stukenbrock@nagler-company.com
 http://www.nagler-company.com


 Hauptsitz: Schnaittenbach
 Handelregister: Amberg HRB
 Gerichtsstand: Amberg
 Steuernummer: 201/118/51825
 USt.-ID-Nummer: DE 273143997
 Geschäftsführer: Dr. Martin Nagler, Prof. Dr. Dr. Karl-Kuno Kunze


From: "OBATA Akio" <obache@netbsd.org>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 length
Date: Fri, 13 Dec 2013 19:53:58 +0900

 I cannot reproduce the issue.

 Do you have any relevant settings in mk.conf or environment variable?

From: Wolfgang Stukenbrock <wolfgang.stukenbrock@nagler-company.com>
To: gnats-bugs@NetBSD.org
Cc: pkg-manager@netbsd.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line length
Date: Fri, 13 Dec 2013 13:07:22 +0100

 Hi,

 my /etc/mk.conf:

 #
 # NC installation generated config file
 #

 # do not register any new shell - may be a security whole
 PKG_REGISTER_SHELLS=NO

 # do not download any binaries from anywhere - always compile the sources
 BINPKG_SITES=



 so nothing special, just killed binary downloads and avoid adding shells 
 automatically.

 I have the following binary packages "preinstalled" into packages/All:

 bash-4.2nb3.tgz
 bison-2.7.1.tgz
 bmon-2.0.1nb2.tgz
 bsdtar-2.8.4nb1.tgz
 cmake-2.8.11.tgz
 getopt-1.1.5.tgz
 gmake-3.82nb7.tgz
 gtar-base-1.26nb2.tgz
 help2man-1.43.2.tgz
 jpeg-9.tgz
 libgcrypt-1.5.2.tgz
 libpaper-1.1.24.tgz
 m4-1.4.16nb3.tgz
 mysql-client-5.5.32.tgz
 mysql-server-5.5.32.tgz
 p5-gettext-1.05nb9.tgz
 p7zip-9.20.1.tgz
 perl-5.18.0nb1.tgz
 php-5.4.16.tgz
 pkg-config-0.28.tgz
 poppler-0.22.4nb2.tgz
 poppler-utils-0.22.4nb2.tgz
 re2c-0.13.5.tgz
 readline-6.2.tgz
 screen-4.0.3nb5.tgz
 tcl-8.5.14.tgz
 tcl-expect-5.45.0nb2.tgz
 tcsh-6.18.01nb4.tgz
 tiff-4.0.3nb3.tgz
 unzip-6.0nb1.tgz
 xtail-2.1.tgz
 xz-5.0.4.tgz
 zip-3.0nb2.tgz


 This list ist for 2013Q2. But it also happens when no binary packages 
 are pre-installed in packages/All.

 The first "make" I've tried ist the make reported in math/R:
 make -D ALLOW_VULNERABLE_PACKAGES bin-install

 remark: This is "normaly" run during automated system setup, but the 
 problem is also present on a fresh system - just installed the binary 
 packages.
 If you have some dependand packages already installed, then it may be, 
 that the recursive build of packages does not reach the "critical" 
 depth. One way to work around this was to installed the failed package 
 by hand and the other build will than work too.

 The "-D ALLOW_VULNERABLE_PACKAGES" (and some other options) are placed 
 on the command line for each recursive package build again and again and 
 again. So triggering the problem needs a deep recursion tree.
 There should be some checks prior calling make for a dependant package 
 to filter out duplicate options.

 Currently I've recognised this problem only with the reported packages:
 math/R
 print/teTex3-bin
 pinrt/teTex
 But there may be more ..

 Best regards

 W. Stukenbrock


 OBATA Akio wrote:

 > The following reply was made to PR pkg/48157; it has been noted by GNATS.
 > 
 > From: "OBATA Akio" <obache@netbsd.org>
 > To: gnats-bugs@netbsd.org
 > Cc: 
 > Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 >  length
 > Date: Fri, 13 Dec 2013 19:53:58 +0900
 > 
 >  I cannot reproduce the issue.
 >  
 >  Do you have any relevant settings in mk.conf or environment variable?
 >  
 > 


 -- 


 Dr. Nagler & Company GmbH
 Hauptstraße 9
 92253 Schnaittenbach

 Tel. +49 9622/71 97-42
 Fax +49 9622/71 97-50

 Wolfgang.Stukenbrock@nagler-company.com
 http://www.nagler-company.com


 Hauptsitz: Schnaittenbach
 Handelregister: Amberg HRB
 Gerichtsstand: Amberg
 Steuernummer: 201/118/51825
 USt.-ID-Nummer: DE 273143997
 Geschäftsführer: Dr. Martin Nagler


From: Joerg Sonnenberger <joerg@britannica.bec.de>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 length
Date: Fri, 13 Dec 2013 14:22:47 +0100

 Hi,
 for me this is a clear case of "don't do that". Using -D has specific
 side effects exactly like the issues seen here. I have no interest in
 hacking around it as there is absolutely no good reason for using it in
 first place for this.

 Joerg

From: David Holland <dholland-pbugs@netbsd.org>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 length
Date: Fri, 13 Dec 2013 17:33:18 +0000

 On Fri, Dec 13, 2013 at 01:25:00PM +0000, Joerg Sonnenberger wrote:
  >  Hi,
  >  for me this is a clear case of "don't do that". Using -D has specific
  >  side effects exactly like the issues seen here.

      -D variable
              Define variable to be 1, in the global context.

 Care to clarify?

 -- 
 David A. Holland
 dholland@netbsd.org

From: Thomas Klausner <wiz@NetBSD.org>
To: NetBSD bugtracking <gnats-bugs@NetBSD.org>
Cc: 
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 length
Date: Fri, 13 Dec 2013 19:21:05 +0100

 On Fri, Dec 13, 2013 at 01:15:00PM +0000, Wolfgang Stukenbrock wrote:
 >  The "-D ALLOW_VULNERABLE_PACKAGES" (and some other options) are placed 
 >  on the command line for each recursive package build again and again and 
 >  again. So triggering the problem needs a deep recursion tree.

 That doesn't sound like a good idea.
 How about putting it in your /etc/mk.conf like the other variables you set?
  Thomas

From: Wolfgang Stukenbrock <wolfgang.stukenbrock@nagler-company.com>
To: gnats-bugs@NetBSD.org
Cc: pkg-manager@netbsd.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line length
Date: Mon, 16 Dec 2013 10:21:14 +0100

 Hi to all,

 I don't think that placing variables only needed for "some" builds - for 
 whatever reasons - in /etc/mk.conf is a real good sollution.

 This special variable is used to suppress lots of messages while 
 building some packages during "initial" system installation - the state 
 of the network is unknown at this time.
 (We've automated the system setup a little bit, because it is not 
 practical to setup (or upgrade) many systems by hand in a consistant way.)
 The variable should not be setup for builds later if the system is 
 completely configured and running.
 And I also don't think that editing in /etc/mk.conf "all the time" is a 
 good idea either.

 /etc/mk.conf is the right place to setup system depedant things - e.g. 
 support for the different compilers on a Solaris system - or 
 "security"-setups like to disallow automatich installation into /etc/shells.

 But neverless, it is no good idea to replicate command line options 
 while calling make in a recursive way. And this is done!
 You will loose even without setting some additional things on the 
 command line if the recursion is deep enought.
 So I don't think to solve this issue is "to hack around for a special 
 usage" as mentioned in an other reply before.
 And I also don't thing that specifying variables with "-D .." is an 
 unexpected usage. E.g. the messages when additional licenses are needed 
 to be accepted suggest to do this.

 Best regards,
 mary christmas and a happy new year

 W. Stukenbrock


 Thomas Klausner wrote:

 > The following reply was made to PR pkg/48157; it has been noted by GNATS.
 > 
 > From: Thomas Klausner <wiz@NetBSD.org>
 > To: NetBSD bugtracking <gnats-bugs@NetBSD.org>
 > Cc: 
 > Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 >  length
 > Date: Fri, 13 Dec 2013 19:21:05 +0100
 > 
 >  On Fri, Dec 13, 2013 at 01:15:00PM +0000, Wolfgang Stukenbrock wrote:
 >  >  The "-D ALLOW_VULNERABLE_PACKAGES" (and some other options) are placed 
 >  >  on the command line for each recursive package build again and again and 
 >  >  again. So triggering the problem needs a deep recursion tree.
 >  
 >  That doesn't sound like a good idea.
 >  How about putting it in your /etc/mk.conf like the other variables you set?
 >   Thomas
 >  
 > 



From: Aleksej Saushev <asau@inbox.ru>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line length
Date: Mon, 16 Dec 2013 13:51:38 +0400

   Hello,

 Wolfgang Stukenbrock <wolfgang.stukenbrock@nagler-company.com> writes:

 > Hi to all,
 >
 > I don't think that placing variables only needed for "some"
 > builds - for whatever reasons - in /etc/mk.conf is a real good
 > sollution.
 >
 > This special variable is used to suppress lots of messages while
 > building some packages during "initial" system installation -
 > the state of the network is unknown at this time.
 > (We've automated the system setup a little bit, because it is
 > not practical to setup (or upgrade) many systems by hand in a
 > consistant way.)
 > The variable should not be setup for builds later if the system
 > is completely configured and running.
 > And I also don't think that editing in /etc/mk.conf "all the
 > time" is a good idea either.
 >
 > /etc/mk.conf is the right place to setup system depedant things
 > - e.g. support for the different compilers on a Solaris system -
 > or "security"-setups like to disallow automatich installation
 > into /etc/shells.
 >
 > But neverless, it is no good idea to replicate command line
 > options while calling make in a recursive way. And this is done!
 > You will loose even without setting some additional things on
 > the command line if the recursion is deep enought.
 > So I don't think to solve this issue is "to hack around for a
 > special usage" as mentioned in an other reply before.
 > And I also don't thing that specifying variables with "-D .." is
 > an unexpected usage. E.g. the messages when additional licenses
 > are needed to be accepted suggest to do this.

 I'm of exactly the opposite opinion. It makes maintainance a lot easier
 when all settings are recorded. mk.conf is the place where such settings
 are kept in pkgsrc, thus "editing all the time" is the way to operate
 pkgsrc installation. I'm not sure that providing hacks that work around
 this requirement does any good. It can work for people with high
 organisational skills like old-school researchers and engineers who
 follow the old tradition of "everything must be written down in the
 laboratory log," but we have too few of them these days.

 In my opinion, in your particular case it would be better to skip
 vulnerability check for particular set of packages. E.g.:

 .if ${.CURDIR:M*/www/firefox}
 ALLOW_VULNERABLE_PACKAGES=yes
 .endif
 .if ${.CURDIR:M*/multimedia/mplayer}
 ALLOW_VULNERABLE_PACKAGES=yes
 .endif


 -- 
 HE CE3OH...

From: David Holland <dholland-pbugs@netbsd.org>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 length
Date: Sat, 21 Dec 2013 18:55:36 +0000

 On Mon, Dec 16, 2013 at 10:00:01AM +0000, Aleksej Saushev wrote:
  >  I'm of exactly the opposite opinion. It makes maintainance a lot easier
  >  when all settings are recorded. mk.conf is the place where [...]

 What should and should not go into mk.conf is irrelevant. The
 exhibited behavior is a bug.

 -- 
 David A. Holland
 dholland@netbsd.org

From: Joerg Sonnenberger <joerg@britannica.bec.de>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 length
Date: Sat, 21 Dec 2013 20:10:15 +0100

 On Sat, Dec 21, 2013 at 07:00:00PM +0000, David Holland wrote:
 > The following reply was made to PR pkg/48157; it has been noted by GNATS.
 > 
 > From: David Holland <dholland-pbugs@netbsd.org>
 > To: gnats-bugs@NetBSD.org
 > Cc: 
 > Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 >  length
 > Date: Sat, 21 Dec 2013 18:55:36 +0000
 > 
 >  On Mon, Dec 16, 2013 at 10:00:01AM +0000, Aleksej Saushev wrote:
 >   >  I'm of exactly the opposite opinion. It makes maintainance a lot easier
 >   >  when all settings are recorded. mk.conf is the place where [...]
 >  
 >  What should and should not go into mk.conf is irrelevant. The
 >  exhibited behavior is a bug.

 mk.conf is irrelevant. The point is just "do not use -D, just set the
 variable".

 Joerg

From: David Holland <dholland-pbugs@netbsd.org>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/48157: pkgsrc 2013Q2 make-system exeeds max. command line
 length
Date: Sat, 21 Dec 2013 19:49:39 +0000

 On Sat, Dec 21, 2013 at 07:15:00PM +0000, Joerg Sonnenberger wrote:
  >  >  What should and should not go into mk.conf is irrelevant. The
  >  >  exhibited behavior is a bug.
  >  
  >  mk.conf is irrelevant. The point is just "do not use -D, just set the
  >  variable".

 Right, which is fine, but my additional point is that the behavior
 seen with -D is a bug.

 It does not happen with simple makefiles; it seems to be caused by
 recursively invoking make and passing MAKEFLAGS both in the
 environment and on the command line, which is wrong...

 -- 
 David A. Holland
 dholland@netbsd.org

>Unformatted:

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.39 2013/11/01 18:47:49 spz Exp $
$NetBSD: gnats_config.sh,v 1.8 2006/05/07 09:23:38 tsutsui Exp $
Copyright © 1994-2007 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.