NetBSD Problem Report #53349

From john@platypus.nextvr.com  Wed Jun  6 22:48:19 2018
Return-Path: <john@platypus.nextvr.com>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id D0DDF7A1E3
	for <gnats-bugs@gnats.NetBSD.org>; Wed,  6 Jun 2018 22:48:19 +0000 (UTC)
Message-Id: <20180606213248.A6696DCED58@platypus.nextvr.com>
Date: Wed,  6 Jun 2018 21:32:48 +0000 (UTC)
From: john@ziaspace.com
Reply-To: john@ziaspace.com
To: gnats-bugs@NetBSD.org
Subject: www/firefox fails with high -j values
X-Send-Pr-Version: 3.95

>Number:         53349
>Category:       pkg
>Synopsis:       www/firefox fails with high -j values
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    ryoon
>State:          feedback
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Wed Jun 06 22:50:00 +0000 2018
>Closed-Date:    
>Last-Modified:  Mon Jul 09 09:30:00 +0000 2018
>Originator:     John Klos
>Release:        NetBSD 7.1_STABLE
>Organization:

>Environment:


System: NetBSD platypus.nextvr.com 7.1_STABLE NetBSD 7.1_STABLE (PLATYPUS) #0: Tue Dec 19 01:39:12 UTC 2017 john@platypus.nextvr.com:/usr/obj-amd64/sys/arch/amd64/compile/PLATYPUS amd64
Architecture: x86_64
Machine: amd64
>Description:


Trying to build www/firefox with MAKE_JOBS set to 8 fails with:

rm -f libjs_src.a
/usr/pkgsrc/www/firefox/work/build/_virtualenv/bin/python /usr/pkgsrc/www/firefox/work/firefox-60.0.1/config/expandlibs_gen.py -o libjs_src.a.desc RegExp.o CTypes.o Library.o Parser.o StoreBuffer.o Disassembler-x86-shared.o jsarray.o jsmath.o jsutil.o pm_stub.o DoubleToString.o Interpreter.o JSAtom.o Unified_cpp_js_src0.o Unified_cpp_js_src1.o Unified_cpp_js_src10.o Unified_cpp_js_src11.o Unified_cpp_js_src12.o Unified_cpp_js_src13.o Unified_cpp_js_src14.o Unified_cpp_js_src15.o Unified_cpp_js_src16.o Unified_cpp_js_src17.o Unified_cpp_js_src18.o Unified_cpp_js_src19.o Unified_cpp_js_src2.o Unified_cpp_js_src20.o Unified_cpp_js_src21.o Unified_cpp_js_src22.o Unified_cpp_js_src23.o Unified_cpp_js_src24.o Unified_cpp_js_src25.o Unified_cpp_js_src26.o Unified_cpp_js_src27.o Unified_cpp_js_src28.o Unified_cpp_js_src29.o Unified_cpp_js_src3.o Unified_cpp_js_src30.o Unified_cpp_js_src31.o Unified_cpp_js_src32.o Unified_cpp_js_src33.o Unified_cpp_js_src34.o Unified_cpp_js_src35.o Unified_cp
 p_js_src36.o Unified_cpp_js_src37.o Unified_cpp_js_src38.o Unified_cpp_js_src39.o Unified_cpp_js_src4.o Unified_cpp_js_src40.o Unified_cpp_js_src41.o Unified_cpp_js_src42.o Unified_cpp_js_src43.o Unified_cpp_js_src44.o Unified_cpp_js_src5.o Unified_cpp_js_src6.o Unified_cpp_js_src7.o Unified_cpp_js_src8.o Unified_cpp_js_src9.o 
gmake[3]: Leaving directory '/usr/pkgsrc/www/firefox/work/build/js/src'
gmake[2]: Leaving directory '/usr/pkgsrc/www/firefox/work/build'
/usr/pkgsrc/www/firefox/work/firefox-60.0.1/config/recurse.mk:32: recipe for target 'compile' failed
gmake[1]: *** [compile] Error 2
gmake[1]: Leaving directory '/usr/pkgsrc/www/firefox/work/build'
/usr/pkgsrc/www/firefox/work/firefox-60.0.1/config/rules.mk:434: recipe for target 'all' failed
gmake: *** [all] Error 2
*** Error code 2

Stop.
make[1]: stopped in /usr/pkgsrc/www/firefox
*** Error code 1


Building with MAKE_JOBS set to 1 succeeds.


>How-To-Repeat:

>Fix:


>Release-Note:

>Audit-Trail:
From: Thomas Klausner <wiz@NetBSD.org>
To: NetBSD bugtracking <gnats-bugs@NetBSD.org>
Cc: 
Subject: Re: pkg/53349: www/firefox fails with high -j values
Date: Thu, 7 Jun 2018 10:27:47 +0200

 On Wed, Jun 06, 2018 at 10:50:00PM +0000, john@ziaspace.com wrote:
 > Trying to build www/firefox with MAKE_JOBS set to 8 fails with:
 >=20
 > rm -f libjs_src.a
 > /usr/pkgsrc/www/firefox/work/build/_virtualenv/bin/python /usr/pkgsrc/www=
 /firefox/work/firefox-60.0.1/config/expandlibs_gen.py -o libjs_src.a.desc R=
 egExp.o CTypes.o Library.o Parser.o StoreBuffer.o Disassembler-x86-shared.o=
  jsarray.o jsmath.o jsutil.o pm_stub.o DoubleToString.o Interpreter.o JSAto=
 m.o Unified_cpp_js_src0.o Unified_cpp_js_src1.o Unified_cpp_js_src10.o Unif=
 ied_cpp_js_src11.o Unified_cpp_js_src12.o Unified_cpp_js_src13.o Unified_cp=
 p_js_src14.o Unified_cpp_js_src15.o Unified_cpp_js_src16.o Unified_cpp_js_s=
 rc17.o Unified_cpp_js_src18.o Unified_cpp_js_src19.o Unified_cpp_js_src2.o =
 Unified_cpp_js_src20.o Unified_cpp_js_src21.o Unified_cpp_js_src22.o Unifie=
 d_cpp_js_src23.o Unified_cpp_js_src24.o Unified_cpp_js_src25.o Unified_cpp_=
 js_src26.o Unified_cpp_js_src27.o Unified_cpp_js_src28.o Unified_cpp_js_src=
 29.o Unified_cpp_js_src3.o Unified_cpp_js_src30.o Unified_cpp_js_src31.o Un=
 ified_cpp_js_src32.o Unified_cpp_js_src33.o Unified_cpp_js_src34.o Unified_=
 cpp_js_src35.o U!
 >  nified_cp
 >  p_js_src36.o Unified_cpp_js_src37.o Unified_cpp_js_src38.o Unified_cpp_j=
 s_src39.o Unified_cpp_js_src4.o Unified_cpp_js_src40.o Unified_cpp_js_src41=
 =2Eo Unified_cpp_js_src42.o Unified_cpp_js_src43.o Unified_cpp_js_src44.o U=
 nified_cpp_js_src5.o Unified_cpp_js_src6.o Unified_cpp_js_src7.o Unified_cp=
 p_js_src8.o Unified_cpp_js_src9.o=20
 > gmake[3]: Leaving directory '/usr/pkgsrc/www/firefox/work/build/js/src'
 > gmake[2]: Leaving directory '/usr/pkgsrc/www/firefox/work/build'
 > /usr/pkgsrc/www/firefox/work/firefox-60.0.1/config/recurse.mk:32: recipe =
 for target 'compile' failed
 > gmake[1]: *** [compile] Error 2
 > gmake[1]: Leaving directory '/usr/pkgsrc/www/firefox/work/build'
 > /usr/pkgsrc/www/firefox/work/firefox-60.0.1/config/rules.mk:434: recipe f=
 or target 'all' failed
 > gmake: *** [all] Error 2
 > *** Error code 2

 The actual error is missing. Please read further up in the log and
 provide it.

 Thanks,
  Thomas

From: Ryo ONODERA <ryo@tetera.org>
To: gnats-bugs@NetBSD.org, john@ziaspace.com
Cc: 
Subject: Re: pkg/53349: www/firefox fails with high -j values
Date: Fri, 08 Jun 2018 12:41:25 +0000 (UTC)

 Hi,

 From: john@ziaspace.com, Date: Wed,  6 Jun 2018 22:50:00 +0000 (UTC)

 >>Number:         53349
 >>Category:       pkg
 >>Synopsis:       www/firefox fails with high -j values
 >>Confidential:   no
 >>Severity:       serious
 >>Priority:       medium
 >>Responsible:    pkg-manager
 >>State:          open
 >>Class:          sw-bug
 >>Submitter-Id:   net
 >>Arrival-Date:   Wed Jun 06 22:50:00 +0000 2018
 >>Originator:     John Klos
 >>Release:        NetBSD 7.1_STABLE
 >>Organization:
 > 	
 >>Environment:
 > 	
 > 	
 > System: NetBSD platypus.nextvr.com 7.1_STABLE NetBSD 7.1_STABLE (PLATYPUS) #0: Tue Dec 19 01:39:12 UTC 2017 john@platypus.nextvr.com:/usr/obj-amd64/sys/arch/amd64/compile/PLATYPUS amd64
 > Architecture: x86_64
 > Machine: amd64
 >>Description:
 > 	
 > 
 > Trying to build www/firefox with MAKE_JOBS set to 8 fails with:

 How many RAM does your machine have?
 My machine that has 16GB RAM builds www/firefox with MAKE_JOBS=8 repeatedly.

 Anyway, please provide me full log.

 Thank you.

 --
 Ryo ONODERA // ryo@tetera.org
 PGP fingerprint = 82A2 DC91 76E0 A10A 8ABB  FD1B F404 27FA C7D1 15F3

Responsible-Changed-From-To: pkg-manager->ryoon
Responsible-Changed-By: bsiegert@NetBSD.org
Responsible-Changed-When: Sun, 08 Jul 2018 10:25:14 +0000
Responsible-Changed-Why:
Over to Firefox maintainer.
Although the problem is probably that you are running out of memory.


State-Changed-From-To: open->feedback
State-Changed-By: bsiegert@NetBSD.org
State-Changed-When: Sun, 08 Jul 2018 10:25:30 +0000
State-Changed-Why:
Please provide the requested information.


From: John Klos <john@ziaspace.com>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/53349 (www/firefox fails with high -j values)
Date: Sun, 8 Jul 2018 17:01:47 +0000 (UTC)

 > Over to Firefox maintainer.
 > Although the problem is probably that you are running out of memory.

 The machine has 32 gigs of memory.

 I will try to recreate so I can provide more information.

From: Benny Siegert <bsiegert@gmail.com>
To: gnats-bugs@netbsd.org
Cc: Ryo ONODERA <ryoon@netbsd.org>, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org, 
	John Klos <john@ziaspace.com>
Subject: Re: pkg/53349 (www/firefox fails with high -j values)
Date: Sun, 8 Jul 2018 19:10:33 +0200

 Yes, but perhaps you need to tweak your ulimits (datasize, stacksize,
 number of files).
 On Sun, Jul 8, 2018 at 7:05 PM John Klos <john@ziaspace.com> wrote:
 >
 > The following reply was made to PR pkg/53349; it has been noted by GNATS.
 >
 > From: John Klos <john@ziaspace.com>
 > To: gnats-bugs@NetBSD.org
 > Cc:
 > Subject: Re: pkg/53349 (www/firefox fails with high -j values)
 > Date: Sun, 8 Jul 2018 17:01:47 +0000 (UTC)
 >
 >  > Over to Firefox maintainer.
 >  > Although the problem is probably that you are running out of memory.
 >
 >  The machine has 32 gigs of memory.
 >
 >  I will try to recreate so I can provide more information.
 >


 -- 
 Benny

From: Jonathan Perkin <jperkin@joyent.com>
To: gnats-bugs@NetBSD.org
Cc: ryoon@NetBSD.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org,
	john@ziaspace.com
Subject: Re: pkg/53349 (www/firefox fails with high -j values)
Date: Mon, 9 Jul 2018 10:28:53 +0100

 * On 2018-07-08 at 18:05 BST, John Klos wrote:

 > The following reply was made to PR pkg/53349; it has been noted by GNATS.
 > 
 > From: John Klos <john@ziaspace.com>
 > To: gnats-bugs@NetBSD.org
 > Cc: 
 > Subject: Re: pkg/53349 (www/firefox fails with high -j values)
 > Date: Sun, 8 Jul 2018 17:01:47 +0000 (UTC)
 > 
 >  > Over to Firefox maintainer.
 >  > Although the problem is probably that you are running out of memory.
 >  
 >  The machine has 32 gigs of memory.
 >  
 >  I will try to recreate so I can provide more information.

 Note that by default cargo (the rust package manager that is used to
 build parts of firefox) will use as many jobs as you have CPUs, so if
 you have a large number of CPUs compared to memory this may cause OOM
 failures.

 I fixed this for rust itself in

   https://github.com/NetBSD/pkgsrc/commit/397302f904f7bb09c510c9deddb5f1e49434d568

 but we may want to add that to the environment for any package which
 uses rust.

 This might not be the issue here, but it's worth pointing out.

 -- 
 Jonathan Perkin  -  Joyent, Inc.  -  www.joyent.com

>Unformatted:
 www/firefox fails with high MAKE_JOBS values

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.43 2018/01/16 07:36:43 maya Exp $
$NetBSD: gnats_config.sh,v 1.9 2014/08/02 14:16:04 spz Exp $
Copyright © 1994-2017 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.