NetBSD Problem Report #53489

From www@NetBSD.org  Wed Aug  1 12:51:58 2018
Return-Path: <www@NetBSD.org>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 944E57B148
	for <gnats-bugs@gnats.NetBSD.org>; Wed,  1 Aug 2018 12:51:58 +0000 (UTC)
Message-Id: <20180801125157.5A90B7B206@mollari.NetBSD.org>
Date: Wed,  1 Aug 2018 12:51:57 +0000 (UTC)
From: rares.aioanei@gmail.com
Reply-To: rares.aioanei@gmail.com
To: gnats-bugs@NetBSD.org
Subject: nbpax segfaults when installing libiconv on OpenIndiana Hipster
X-Send-Pr-Version: www-1.0

>Number:         53489
>Category:       pkg
>Synopsis:       nbpax segfaults when installing libiconv on OpenIndiana Hipster
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    pkg-manager
>State:          closed
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Wed Aug 01 12:55:00 +0000 2018
>Closed-Date:    Tue Sep 18 11:37:10 +0000 2018
>Last-Modified:  Tue Sep 18 11:37:10 +0000 2018
>Originator:     Rares Aioanei
>Release:        pkgsrc CVS 1st of August 2018
>Organization:
>Environment:
SunOS openindiana 5.11 illumos-e5c421abb8 i86pc i386 i86pc

>Description:
When trying to install clang from pkgsrc, the compilation process stops at libiconv with the following error :

===> Installing dependencies for gettext-lib-0.19.8.1
=> Tool dependency libtool-base>=2.4.2nb9: found libtool-base-2.4.6nb1
=> Tool dependency nbpatch-[0-9]*: found nbpatch-20151107
=> Build dependency cwrappers>=20150314: found cwrappers-20180325
=> Full dependency libiconv>=1.9.1nb4: NOT found
=> Verifying reinstall for ../../converters/libiconv
=> Bootstrap dependency digest>=20010302: found digest-20160304
===> Checking for vulnerabilities in libiconv-1.14nb3
===> Building for libiconv-1.14nb3
builddir="`pwd`"; cd libcharset && /usr/pkg/bin/bmake all &&     /usr/bin/bash ./libtool --mode=install cp lib/libcharset.la "$builddir/lib/" &&         /usr/pkg/bin/nbpax -rw include/*.h "$builddir/"
cd lib && /usr/pkg/bin/bmake all
libtool: install: cp lib/.libs/libcharset.so.1.0.0 /usr/pkg/pkgsrc/converters/libiconv/work/libiconv-1.14/lib/libcharset.so.1.0.0
libtool: install: (cd /usr/pkg/pkgsrc/converters/libiconv/work/libiconv-1.14/lib && { ln -s -f libcharset.so.1.0.0 libcharset.so.1 || { rm -f libcharset.so.1 && ln -s libcharset.so.1.0.0 libcharset.so.1; }; })
libtool: install: (cd /usr/pkg/pkgsrc/converters/libiconv/work/libiconv-1.14/lib && { ln -s -f libcharset.so.1.0.0 libcharset.so || { rm -f libcharset.so && ln -s libcharset.so.1.0.0 libcharset.so; }; })
libtool: install: chmod +x /usr/pkg/pkgsrc/converters/libiconv/work/libiconv-1.14/lib/libcharset.so.1.0.0
libtool: install: cp lib/.libs/libcharset.lai /usr/pkg/pkgsrc/converters/libiconv/work/libiconv-1.14/lib/libcharset.la
libtool: install: cp lib/.libs/libcharset.a /usr/pkg/pkgsrc/converters/libiconv/work/libiconv-1.14/lib/libcharset.a
libtool: install: chmod 644 /usr/pkg/pkgsrc/converters/libiconv/work/libiconv-1.14/lib/libcharset.a
libtool: install: ranlib /usr/pkg/pkgsrc/converters/libiconv/work/libiconv-1.14/lib/libcharset.a
libtool: warning: remember to run 'libtool --finish /usr/pkg/lib'
/usr/bin/bash: line 1:  2371 Segmentation Fault      (core dumped) /usr/pkg/bin/nbpax -rw include/*.h "$builddir/"
*** Error code 139

>How-To-Repeat:
Try to install clang from pkgsrc on an OI Hipster machine
>Fix:

>Release-Note:

>Audit-Trail:
From: Joerg Sonnenberger <joerg@bec.de>
To: gnats-bugs@NetBSD.org
Cc: pkg-manager@netbsd.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org
Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 OpenIndiana Hipster
Date: Thu, 2 Aug 2018 18:11:18 +0200

 On Wed, Aug 01, 2018 at 12:55:00PM +0000, rares.aioanei@gmail.com wrote:
 > /usr/bin/bash: line 1:  2371 Segmentation Fault      (core dumped) /usr/pkg/bin/nbpax -rw include/*.h "$builddir/"

 Backtrace? Otherwise there is nothing really we can do...

 Joerg

From: Jonathan Perkin <jperkin@joyent.com>
To: Joerg Sonnenberger <joerg@bec.de>
Cc: gnats-bugs@NetBSD.org, pkg-manager@netbsd.org, gnats-admin@netbsd.org,
	pkgsrc-bugs@netbsd.org
Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 OpenIndiana Hipster
Date: Fri, 3 Aug 2018 07:00:48 +0100

 * On 2018-08-02 at 17:12 BST, Joerg Sonnenberger wrote:

 > On Wed, Aug 01, 2018 at 12:55:00PM +0000, rares.aioanei@gmail.com wrote:
 > > /usr/bin/bash: line 1:  2371 Segmentation Fault      (core dumped) /usr/pkg/bin/nbpax -rw include/*.h "$builddir/"
 > 
 > Backtrace? Otherwise there is nothing really we can do...

 I upgraded my build hosts to joyent_20180730T090356Z and now I'm
 seeing this everywhere too:

   http://us-east.manta.joyent.com/pkgsrc/public/reports/upstream-trunk32/20180802.2011/meta/report.html

 It appears to only affect 32-bit though.

 I'll take a closer look..

 -- 
 Jonathan Perkin  -  Joyent, Inc.  -  www.joyent.com

From: Rares Aioanei <rares.aioanei@gmail.com>
To: gnats-bugs@netbsd.org
Cc: pkg-manager@netbsd.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org
Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 OpenIndiana Hipster
Date: Fri, 3 Aug 2018 10:10:02 +0300

 Hey,

 Perhaps this helps :

 root@: /usr/pkg/pkgsrc/converters/libiconv/work gdb --args
 /usr/pkg/bin/nbpax -rw ./libiconv-1.14/include/*.h .
 GNU gdb (GDB) 7.10.1
 Copyright (C) 2015 Free Software Foundation, Inc.
 License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
 This is free software: you are free to change and redistribute it.
 There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
 and "show warranty" for details.
 This GDB was configured as "i386-pc-solaris2.11".
 Type "show configuration" for configuration details.
 For bug reporting instructions, please see:
 <http://www.gnu.org/software/gdb/bugs/>.
 Find the GDB manual and other documentation resources online at:
 <http://www.gnu.org/software/gdb/documentation/>.
 For help, type "help".
 Type "apropos word" to search for commands related to "word"...
 Reading symbols from /usr/pkg/bin/nbpax...done.
 (gdb) r
 Starting program: /usr/pkg/bin/nbpax -rw
 ./libiconv-1.14/include/export.h ./libiconv-1.14/include/iconv.h .
 [Thread debugging using libthread_db enabled]
 [New Thread 1 (LWP 1)]

 Program received signal SIGSEGV, Segmentation fault.
 [Switching to Thread 1 (LWP 1)]
 0x0805d6dc in next_file ()
 (gdb) bt
 #0  0x0805d6dc in next_file ()
 #1  0x080599b5 in copy ()
 #2  0x08061828 in main ()

 On Fri, Aug 3, 2018 at 9:05 AM, Jonathan Perkin <jperkin@joyent.com> wrote:
 > The following reply was made to PR pkg/53489; it has been noted by GNATS.
 >
 > From: Jonathan Perkin <jperkin@joyent.com>
 > To: Joerg Sonnenberger <joerg@bec.de>
 > Cc: gnats-bugs@NetBSD.org, pkg-manager@netbsd.org, gnats-admin@netbsd.org,
 >         pkgsrc-bugs@netbsd.org
 > Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 >  OpenIndiana Hipster
 > Date: Fri, 3 Aug 2018 07:00:48 +0100
 >
 >  * On 2018-08-02 at 17:12 BST, Joerg Sonnenberger wrote:
 >
 >  > On Wed, Aug 01, 2018 at 12:55:00PM +0000, rares.aioanei@gmail.com wrote:
 >  > > /usr/bin/bash: line 1:  2371 Segmentation Fault      (core dumped) /usr/pkg/bin/nbpax -rw include/*.h "$builddir/"
 >  >
 >  > Backtrace? Otherwise there is nothing really we can do...
 >
 >  I upgraded my build hosts to joyent_20180730T090356Z and now I'm
 >  seeing this everywhere too:
 >
 >    http://us-east.manta.joyent.com/pkgsrc/public/reports/upstream-trunk32/20180802.2011/meta/report.html
 >
 >  It appears to only affect 32-bit though.
 >
 >  I'll take a closer look..
 >
 >  --
 >  Jonathan Perkin  -  Joyent, Inc.  -  www.joyent.com
 >

From: Rares Aioanei <rares.aioanei@gmail.com>
To: gnats-bugs@netbsd.org
Cc: pkg-manager@netbsd.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org
Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 OpenIndiana Hipster
Date: Fri, 3 Aug 2018 10:28:06 +0300

 Oh, and by the way, "isainfo -n" reports amd64.

 On Fri, Aug 3, 2018 at 9:05 AM, Jonathan Perkin <jperkin@joyent.com> wrote:
 > The following reply was made to PR pkg/53489; it has been noted by GNATS.
 >
 > From: Jonathan Perkin <jperkin@joyent.com>
 > To: Joerg Sonnenberger <joerg@bec.de>
 > Cc: gnats-bugs@NetBSD.org, pkg-manager@netbsd.org, gnats-admin@netbsd.org,
 >         pkgsrc-bugs@netbsd.org
 > Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 >  OpenIndiana Hipster
 > Date: Fri, 3 Aug 2018 07:00:48 +0100
 >
 >  * On 2018-08-02 at 17:12 BST, Joerg Sonnenberger wrote:
 >
 >  > On Wed, Aug 01, 2018 at 12:55:00PM +0000, rares.aioanei@gmail.com wrote:
 >  > > /usr/bin/bash: line 1:  2371 Segmentation Fault      (core dumped) /usr/pkg/bin/nbpax -rw include/*.h "$builddir/"
 >  >
 >  > Backtrace? Otherwise there is nothing really we can do...
 >
 >  I upgraded my build hosts to joyent_20180730T090356Z and now I'm
 >  seeing this everywhere too:
 >
 >    http://us-east.manta.joyent.com/pkgsrc/public/reports/upstream-trunk32/20180802.2011/meta/report.html
 >
 >  It appears to only affect 32-bit though.
 >
 >  I'll take a closer look..
 >
 >  --
 >  Jonathan Perkin  -  Joyent, Inc.  -  www.joyent.com
 >

From: Joerg Sonnenberger <joerg@bec.de>
To: Jonathan Perkin <jperkin@joyent.com>
Cc: Joerg Sonnenberger <joerg@bec.de>, gnats-bugs@NetBSD.org,
	pkg-manager@netbsd.org, gnats-admin@netbsd.org,
	pkgsrc-bugs@netbsd.org
Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 OpenIndiana Hipster
Date: Sun, 5 Aug 2018 00:35:45 +0200

 On Fri, Aug 03, 2018 at 07:00:48AM +0100, Jonathan Perkin wrote:
 > * On 2018-08-02 at 17:12 BST, Joerg Sonnenberger wrote:
 > 
 > > On Wed, Aug 01, 2018 at 12:55:00PM +0000, rares.aioanei@gmail.com wrote:
 > > > /usr/bin/bash: line 1:  2371 Segmentation Fault      (core dumped) /usr/pkg/bin/nbpax -rw include/*.h "$builddir/"
 > > 
 > > Backtrace? Otherwise there is nothing really we can do...
 > 
 > I upgraded my build hosts to joyent_20180730T090356Z and now I'm
 > seeing this everywhere too:
 > 
 >   http://us-east.manta.joyent.com/pkgsrc/public/reports/upstream-trunk32/20180802.2011/meta/report.html
 > 
 > It appears to only affect 32-bit though.
 > 
 > I'll take a closer look..

 Can you try to revert your large file change? That's the only change to
 nbpax in the last two years.

 Joerg

From: Jonathan Perkin <jperkin@joyent.com>
To: gnats-bugs@NetBSD.org
Cc: pkg-manager@netbsd.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org,
	rares.aioanei@gmail.com
Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 OpenIndiana Hipster
Date: Mon, 6 Aug 2018 14:12:04 +0100

 * On 2018-08-04 at 23:40 BST, Joerg Sonnenberger wrote:

 > The following reply was made to PR pkg/53489; it has been noted by GNATS.
 > 
 > From: Joerg Sonnenberger <joerg@bec.de>
 > To: Jonathan Perkin <jperkin@joyent.com>
 > Cc: Joerg Sonnenberger <joerg@bec.de>, gnats-bugs@NetBSD.org,
 > 	pkg-manager@netbsd.org, gnats-admin@netbsd.org,
 > 	pkgsrc-bugs@netbsd.org
 > Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 >  OpenIndiana Hipster
 > Date: Sun, 5 Aug 2018 00:35:45 +0200
 > 
 >  On Fri, Aug 03, 2018 at 07:00:48AM +0100, Jonathan Perkin wrote:
 >  > * On 2018-08-02 at 17:12 BST, Joerg Sonnenberger wrote:
 >  > 
 >  > > On Wed, Aug 01, 2018 at 12:55:00PM +0000, rares.aioanei@gmail.com wrote:
 >  > > > /usr/bin/bash: line 1:  2371 Segmentation Fault      (core dumped) /usr/pkg/bin/nbpax -rw include/*.h "$builddir/"
 >  > > 
 >  > > Backtrace? Otherwise there is nothing really we can do...
 >  > 
 >  > I upgraded my build hosts to joyent_20180730T090356Z and now I'm
 >  > seeing this everywhere too:
 >  > 
 >  >   http://us-east.manta.joyent.com/pkgsrc/public/reports/upstream-trunk32/20180802.2011/meta/report.html
 >  > 
 >  > It appears to only affect 32-bit though.
 >  > 
 >  > I'll take a closer look..
 >  
 >  Can you try to revert your large file change? That's the only change to
 >  nbpax in the last two years.

 The change is that illumos imported fts(3) into its libc last year,
 but it is not largefile aware.  I'm working on an upstream bug to fix
 that.

 Not sure how we should handle it in pkgsrc yet, probably explicitly
 disable builtin fts until we're reasonably sure nobody is using a bad
 version.

 -- 
 Jonathan Perkin  -  Joyent, Inc.  -  www.joyent.com

From: Jonathan Perkin <jperkin@joyent.com>
To: gnats-bugs@NetBSD.org
Cc: pkg-manager@netbsd.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org,
	rares.aioanei@gmail.com
Subject: Re: pkg/53489: nbpax segfaults when installing libiconv on
 OpenIndiana Hipster
Date: Tue, 7 Aug 2018 12:01:26 +0100

 * On 2018-08-06 at 14:12 BST, Jonathan Perkin wrote:

 > * On 2018-08-04 at 23:40 BST, Joerg Sonnenberger wrote:
 > 
 > >  Can you try to revert your large file change? That's the only change to
 > >  nbpax in the last two years.
 > 
 > The change is that illumos imported fts(3) into its libc last year,
 > but it is not largefile aware.  I'm working on an upstream bug to fix
 > that.

 A fix for this is available here: https://cr.joyent.us/#/c/4642/

 > Not sure how we should handle it in pkgsrc yet, probably explicitly
 > disable builtin fts until we're reasonably sure nobody is using a bad
 > version.

 I'll do this today.

 -- 
 Jonathan Perkin  -  Joyent, Inc.  -  www.joyent.com

From: "Jonathan Perkin" <jperkin@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc: 
Subject: PR/53489 CVS commit: pkgsrc/pkgtools/libnbcompat
Date: Tue, 7 Aug 2018 12:04:36 +0000

 Module Name:	pkgsrc
 Committed By:	jperkin
 Date:		Tue Aug  7 12:04:36 UTC 2018

 Modified Files:
 	pkgsrc/pkgtools/libnbcompat: inplace.mk

 Log Message:
 libnbcompat: Explicitly avoid SunOS fts(3C) for now.

 It is not currently largefile aware, leading to issues described in
 PR#53489.  This will be resolved upstream but it will take a while for
 everyone to catch up.


 To generate a diff of this commit:
 cvs rdiff -u -r1.13 -r1.14 pkgsrc/pkgtools/libnbcompat/inplace.mk

 Please note that diffs are not public domain; they are subject to the
 copyright notices on the relevant files.

State-Changed-From-To: open->closed
State-Changed-By: maya@NetBSD.org
State-Changed-When: Tue, 18 Sep 2018 11:37:10 +0000
State-Changed-Why:
It sounds like we have a workaround in place for people using problematic fts, and upstream illumos is fixed already, too. I guess there is nothing left to fix, just time for all users to update to the newer version so the hack can be undone (no rush, it sounds harmless).
Feel free to reply if you think there is still a problem to fix in this bug and I'll re-open.


>Unformatted:

Home	PR Database Search