NetBSD Problem Report #54071

From bjjl@chaos.lorenz.place  Mon Mar 25 09:21:39 2019
Return-Path: <bjjl@chaos.lorenz.place>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 4CD027A1A8
	for <gnats-bugs@gnats.NetBSD.org>; Mon, 25 Mar 2019 09:21:39 +0000 (UTC)
Message-Id: <20190325071832.3B50241078F@chaos.lorenz.place>
Date: Mon, 25 Mar 2019 08:18:32 +0100 (CET)
From: ben@pocket.services
To: gnats-bugs@NetBSD.org
Subject: mate build problems
X-Send-Pr-Version: 3.95

>Number:         54071
>Category:       pkg
>Synopsis:       mate build problems
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    gutteridge
>State:          closed
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Mon Mar 25 09:25:00 +0000 2019
>Closed-Date:    Mon Jun 03 11:25:43 +0000 2019
>Last-Modified:  Mon Jun 03 11:25:43 +0000 2019
>Originator:     Benjamin Lorenz
>Release:        NetBSD 8.99.36
>Organization:

>Environment:


System: NetBSD chaos.lorenz.place 8.99.36 NetBSD 8.99.36 (GENERIC) #0: Sun Mar 24 13:57:41 CET 2019 bjjl@chaos.lorenz.place:/home/bjjl/8.99/obj/sys/arch/amd64/compile/GENERIC amd64
Architecture: x86_64
Machine: amd64
>Description:
sysutils/caja-dropbox:

checking for gi on python3... yes

This is "no" and build fails when doing a fresh build of mate meta package.
After skipping this package, building all the rest, and then re-trying,
it was showing progress like above, saying it found gi on python3. I guess
some dependency is missing in the package meta data?


Second problem:

misc/mate-utils:

Entering directory '/home/bjjl/8.99/pkgsrc/misc/mate-utils/work/mate-utils-1.22.0/gsearchtool/help
  GEN    ar/
  GEN    pt/
  GEN    fr/
Traceback (most recent call last):
  File "/usr/pkg/bin/itstool", line 1598, in <module>
    doc.merge_translations(translations, opts.lang, strict=opts.strict)
  File "/usr/pkg/bin/itstool", line 986, in merge_translations
    lcnode.setProp(attr, origlang)
  File "/usr/pkg/lib/python2.7/site-packages/libxml2.py", line 3590, in setProp
    if ret is None:raise treeError('xmlSetProp() failed')
libxml2.treeError: xmlSetProp() failed

>How-To-Repeat:

>Fix:


>Release-Note:

>Audit-Trail:

Responsible-Changed-From-To: pkg-manager->youri
Responsible-Changed-By: leot@NetBSD.org
Responsible-Changed-When: Mon, 25 Mar 2019 11:18:58 +0000
Responsible-Changed-Why:
Youri, can you please give it a look?
(over to MAINTAINER)


From: "David H. Gutteridge" <david@gutteridge.ca>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: pkg/54071 (mate build problems)
Date: Mon, 25 Mar 2019 10:05:50 -0400

 The caja-dropbox issue is my fault: I recorded an incorrect dependency
 when I bumped it to 1.22. I'll fix that shortly. Sorry about that!

 Concerning mate-utils, I've found it has a particular translation
 file that can cause itstool to fail or segfault (I've seen both). I was
 encountering this with itstool 2.0.4, but with 2.0.5, I couldn't
 reproduce the issue, so I specified a hard dependency on that version
 of the tool in mate-utils's make file. I did ten rebuilds of mate-utils
 and couldn't reproduce the issue. I've since learned others have still
 been encountering the problem (e.g. jmcneill@ hit it in his aarch64
 builds).

 Dave


From: "David H. Gutteridge" <gutteridge@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc: 
Subject: PR/54071 CVS commit: pkgsrc/sysutils/caja-dropbox
Date: Mon, 25 Mar 2019 14:10:44 +0000

 Module Name:	pkgsrc
 Committed By:	gutteridge
 Date:		Mon Mar 25 14:10:44 UTC 2019

 Modified Files:
 	pkgsrc/sysutils/caja-dropbox: Makefile

 Log Message:
 caja-dropbox: fix a dependency issue

 We should be depending on py-gobject3, not gobject-introspection
 directly. Addresses part of PR pkg/54071.


 To generate a diff of this commit:
 cvs rdiff -u -r1.17 -r1.18 pkgsrc/sysutils/caja-dropbox/Makefile

 Please note that diffs are not public domain; they are subject to the
 copyright notices on the relevant files.

From: "David H. Gutteridge" <david@gutteridge.ca>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: pkg/54071 (mate build problems)
Date: Wed, 27 Mar 2019 00:58:42 -0400

 I was able to duplicate the problem with mate-utils: it seems it may be
 isolated to itstool using Python 2.7. (In one of my test environments,
 I was using Python 3.6 by default. That was where I couldn't duplicate
 the issue, and still can't. Since 2.7 is the default, we would be
 hitting this in bulk builds and stock user installations.) I haven't
 had time to analyze the issue further.

 Dave


From: "David H. Gutteridge" <david@gutteridge.ca>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: pkg/54071 (mate build problems)
Date: Fri, 29 Mar 2019 01:33:51 -0400

 I can intermittently reproduce this with Python 2.7. Some of the time,
 the build succeeds, other times it hits the Python traceback previously
 reported (the output I get there is identical), other times it will seg
 fault, as below. (The example below is on Linux, so it's a cross-
 platform issue.)

 By "intermittently", e.g., in four test runs I just did, it hit the
 traceback once, and succeeded in the rest. I've added more debugging
 output, but am out of time tonight.

 Core was generated by `/home/disciple/pkg/bin/python2.7 -s /home/disciple/pkg/bin/itstool -m ../pt/pt.'.
 Program terminated with signal SIGSEGV, Segmentation fault.
 #0  0x00007f45b3bf2b58 in libxml_type () from /home/disciple/pkg/lib/python2.7/site-packages/libxml2mod.so
 (gdb) bt
 #0  0x00007f45b3bf2b58 in libxml_type () from /home/disciple/pkg/lib/python2.7/site-packages/libxml2mod.so
 #1  0x00007f45b4864e39 in PyEval_EvalFrameEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #2  0x00007f45b48643de in PyEval_EvalFrameEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #3  0x00007f45b4865675 in PyEval_EvalCodeEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #4  0x00007f45b47eeedb in function_call () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #5  0x00007f45b47cb8b3 in PyObject_Call () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #6  0x00007f45b47cb981 in call_function_tail () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #7  0x00007f45b47cba51 in PyObject_CallFunction () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #8  0x00007f45b47d6e92 in instance_getattr2 () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #9  0x00007f45b47d76a0 in instance_getattr () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #10 0x00007f45b485fa93 in PyEval_EvalFrameEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #11 0x00007f45b4865675 in PyEval_EvalCodeEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #12 0x00007f45b486232c in PyEval_EvalFrameEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #13 0x00007f45b4865675 in PyEval_EvalCodeEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #14 0x00007f45b4865919 in PyEval_EvalCode () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #15 0x00007f45b487e65f in run_mod () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #16 0x00007f45b487f742 in PyRun_FileExFlags () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #17 0x00007f45b4880833 in PyRun_SimpleFileExFlags () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #18 0x00007f45b4891bf2 in Py_Main () from /home/disciple/pkg/lib/libpython2.7.so.1.0
 #19 0x00007f45b4409413 in __libc_start_main () from /lib64/libc.so.6
 #20 0x000000000040107e in _start ()

 Dave


State-Changed-From-To: open->feedback
State-Changed-By: gutteridge@NetBSD.org
State-Changed-When: Mon, 01 Apr 2019 22:11:59 +0000
State-Changed-Why:
textproc/itstool (where the issue really lies) has been altered to
disallow Python 2.7. This should resolve the mate-utils issue, please
advise if it does so for you. Thanks!

From: Benjamin Lorenz <ben@pocket.services>
To: <gnats-bugs@netbsd.org>,
	<youri@netbsd.org>,
	<pkgsrc-bugs@netbsd.org>,
	<gnats-admin@netbsd.org>,
	<gutteridge@NetBSD.org>
Cc: 
Subject: Re: pkg/54071 (mate build problems)
Date: Sun, 07 Apr 2019 10:23:02 +0200

 Itstool unfortunately still crashes. With new Python 3.7.3 from pkgsrc current

 gmake[3]: Entering directory '/home/bjjl/8.99/pkgsrc/misc/mate-utils/work/mate-utils-1.22.0/gsearchtool/help'
   GEN    pt/
   GEN    zh_HK/
   GEN    sr@latin/
   GEN    th/
 [1]   Segmentation fault (core dumped) (cd "pt/" && itstool -m "${mo}" ${d}/C/index.d...

 Gdb says

 Core was generated by `python3.7'.
 Program terminated with signal SIGSEGV, Segmentation fault.
 #0  0x00007e537ea3e514 in libxml_type () from /usr/pkg/lib/python3.7/site-packages/libxml2mod.so
 (gdb) bt
 #0  0x00007e537ea3e514 in libxml_type () from /usr/pkg/lib/python3.7/site-packages/libxml2mod.so
 #1  0x00007e5382a7f3eb in _PyMethodDef_RawFastCallKeywords () from /usr/pkg/lib/libpython3.7.so.1.0
 #2  0x00007e5382a7f5f2 in _PyCFunction_FastCallKeywords () from /usr/pkg/lib/libpython3.7.so.1.0
 #3  0x00007e5382ba762b in _PyEval_EvalFrameDefault () from /usr/pkg/lib/libpython3.7.so.1.0
 #4  0x00007e5382b9ea36 in function_code_fastcall () from /usr/pkg/lib/libpython3.7.so.1.0
 #5  0x00007e5382ba60ca in _PyEval_EvalFrameDefault () from /usr/pkg/lib/libpython3.7.so.1.0




From: "David H. Gutteridge" <david@gutteridge.ca>
To: Benjamin Lorenz <ben@pocket.services>, gnats-bugs@netbsd.org, 
	youri@netbsd.org
Cc: 
Subject: Re: pkg/54071 (mate build problems)
Date: Sun, 07 Apr 2019 05:17:30 -0400

 On Sun, 2019-04-07 at 10:23 +0200, Benjamin Lorenz wrote:
 > Itstool unfortunately still crashes. With new Python 3.7.3 from pkgsrc
 > current
 > 
 > gmake[3]: Entering directory '/home/bjjl/8.99/pkgsrc/misc/mate-
 > utils/work/mate-utils-1.22.0/gsearchtool/help'
 >   GEN    pt/
 >   GEN    zh_HK/
 >   GEN    sr@latin/
 >   GEN    th/
 > [1]   Segmentation fault (core dumped) (cd "pt/" && itstool -m "${mo}"
 > ${d}/C/index.d...
 > 
 > Gdb says
 > 
 > Core was generated by `python3.7'.
 > Program terminated with signal SIGSEGV, Segmentation fault.
 > #0  0x00007e537ea3e514 in libxml_type () from
 > /usr/pkg/lib/python3.7/site-packages/libxml2mod.so
 > (gdb) bt
 > #0  0x00007e537ea3e514 in libxml_type () from
 > /usr/pkg/lib/python3.7/site-packages/libxml2mod.so
 > #1  0x00007e5382a7f3eb in _PyMethodDef_RawFastCallKeywords () from
 > /usr/pkg/lib/libpython3.7.so.1.0
 > #2  0x00007e5382a7f5f2 in _PyCFunction_FastCallKeywords () from
 > /usr/pkg/lib/libpython3.7.so.1.0
 > #3  0x00007e5382ba762b in _PyEval_EvalFrameDefault () from
 > /usr/pkg/lib/libpython3.7.so.1.0
 > #4  0x00007e5382b9ea36 in function_code_fastcall () from
 > /usr/pkg/lib/libpython3.7.so.1.0
 > #5  0x00007e5382ba60ca in _PyEval_EvalFrameDefault () from
 > /usr/pkg/lib/libpython3.7.so.1.0

 That's not good. I guess we could apply a workaround like they were
 using with gnumeric112 recently, where they simply disabled the
 particular language translation file that was causing the issue.

 FWIW, I haven't been able to reproduce this in a few test runs I just
 did. But I can see it also occurred on a recent Joyent SmartOS build.

 Dave


From: "David H. Gutteridge" <david@gutteridge.ca>
To: Benjamin Lorenz <ben@pocket.services>, gnats-bugs@netbsd.org, 
	youri@netbsd.org
Cc: 
Subject: Re: pkg/54071 (mate build problems)
Date: Sun, 07 Apr 2019 05:38:37 -0400

 On Sun, 2019-04-07 at 05:17 -0400, David H. Gutteridge wrote:
 > That's not good. I guess we could apply a workaround like they were
 > using with gnumeric112 recently, where they simply disabled the
 > particular language translation file that was causing the issue.
 > 
 > FWIW, I haven't been able to reproduce this in a few test runs I just
 > did. But I can see it also occurred on a recent Joyent SmartOS build.

 This is https://github.com/itstool/itstool/issues/36 upstream. It seems
 OpenBSD went with the option of disabling the pt translations for now.
 I'm inclined to do the same.

 (I also see they just released itstool 2.0.6, but the changes aren't
 relevant in this context.)

 Dave


State-Changed-From-To: feedback->open
State-Changed-By: gutteridge@NetBSD.org
State-Changed-When: Sun, 07 Apr 2019 09:41:08 +0000
State-Changed-Why:
Feedback provided, thanks.

From: Benjamin Lorenz <ben@pocket.services>
To: <gnats-bugs@netbsd.org>,
	<youri@netbsd.org>,
	<gnats-admin@netbsd.org>,
	<pkgsrc-bugs@netbsd.org>
Cc: 
Subject: Re: pkg/54071 (mate build problems)
Date: Sun, 07 Apr 2019 11:41:04 +0200

 Compiled with debug symbols. It is crashing in libxml.c, in the directory /home/bjjl/8.99/pkgsrc/textproc/py-libxml2/work/libxml2-2.9.9/python, in the switch statement

   switch (cur->type) {
         case XML_ELEMENT_NODE:
             res = (const xmlChar *) "element";
             break;
         case XML_ATTRIBUTE_NODE:
             res = (const xmlChar *) "attribute";
             break; 
         case XML_TEXT_NODE:
             res = (const xmlChar *) "text";
             break;
 ...


 Core was generated by `python3.7'.
 Program terminated with signal SIGSEGV, Segmentation fault.
 #0  0x000072da7964b1ea in libxml_type (self=0x72da7c9113a8, args=0x72da7c823098) at libxml.c:2763
 2763                res = (const xmlChar *) "attribute";
 (gdb) bt
 #0  0x000072da7964b1ea in libxml_type (self=0x72da7c9113a8, args=0x72da7c823098) at libxml.c:2763
 #1  0x000072da7d67f3eb in _PyMethodDef_RawFastCallKeywords () from /usr/pkg/lib/libpython3.7.so.1.0
 #2  0x000072da7d67f5f2 in _PyCFunction_FastCallKeywords () from /usr/pkg/lib/libpython3.7.so.1.0





From: "David H. Gutteridge" <gutteridge@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc: 
Subject: PR/54071 CVS commit: pkgsrc/misc/mate-utils
Date: Wed, 10 Apr 2019 01:07:10 +0000

 Module Name:	pkgsrc
 Committed By:	gutteridge
 Date:		Wed Apr 10 01:07:10 UTC 2019

 Modified Files:
 	pkgsrc/misc/mate-utils: Makefile PLIST distinfo
 Added Files:
 	pkgsrc/misc/mate-utils/patches: patch-gsearchtool_help_Makefile.in

 Log Message:
 mate-utils: work around issue with itstool failures

 Disable the pt translations for one mate-utils component for now, to
 work around an issue where itstool is intermittently failing. This
 addresses PR pkg/54071. Okay youri@.


 To generate a diff of this commit:
 cvs rdiff -u -r1.16 -r1.17 pkgsrc/misc/mate-utils/Makefile
 cvs rdiff -u -r1.5 -r1.6 pkgsrc/misc/mate-utils/PLIST
 cvs rdiff -u -r1.6 -r1.7 pkgsrc/misc/mate-utils/distinfo
 cvs rdiff -u -r0 -r1.1 \
     pkgsrc/misc/mate-utils/patches/patch-gsearchtool_help_Makefile.in

 Please note that diffs are not public domain; they are subject to the
 copyright notices on the relevant files.

Responsible-Changed-From-To: youri->gutteridge
Responsible-Changed-By: gutteridge@NetBSD.org
Responsible-Changed-When: Mon, 15 Apr 2019 22:27:04 +0000
Responsible-Changed-Why:
Take, since I've been handling this. It's had a workaround applied,
but isn't properly resolved upstream.

From: "David H. Gutteridge" <david@gutteridge.ca>
To: Benjamin Lorenz <ben@pocket.services>, gnats-bugs@netbsd.org, 
	youri@netbsd.org
Cc: 
Subject: Re: pkg/54071 (mate build problems)
Date: Tue, 07 May 2019 22:31:58 -0400

 mate-utils 1.22.1 works around the problem exactly the same way, they
 simply removed the problematic "pt" translation file from consideration.
 I'm inclined to close this PR, and leave it to upstream to revisit this
 issue. (There hasn't been any traction in the itstool PR to date.)

 Dave


State-Changed-From-To: open->pending-pullups
State-Changed-By: gutteridge@NetBSD.org
State-Changed-When: Wed, 08 May 2019 11:33:51 +0000
State-Changed-Why:
Pull-up pending in releng ticket #5966.

From: "S.P.Zeidler" <spz@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc: 
Subject: PR/54071 CVS commit: [pkgsrc-2019Q1] pkgsrc/misc/mate-utils
Date: Sun, 2 Jun 2019 18:15:09 +0000

 Module Name:	pkgsrc
 Committed By:	spz
 Date:		Sun Jun  2 18:15:08 UTC 2019

 Modified Files:
 	pkgsrc/misc/mate-utils [pkgsrc-2019Q1]: Makefile PLIST distinfo
 Added Files:
 	pkgsrc/misc/mate-utils/patches [pkgsrc-2019Q1]:
 	    patch-gsearchtool_help_Makefile.in

 Log Message:
 Pullup ticket #5966 - requested by gutteridge
 misc/mate-utils: build fix

 Revisions pulled up:
 - misc/mate-utils/Makefile                                      1.17
 - misc/mate-utils/PLIST                                         1.6
 - misc/mate-utils/distinfo                                      1.7
 - misc/mate-utils/patches/patch-gsearchtool_help_Makefile.in    1.1

 -------------------------------------------------------------------
    Module Name:    pkgsrc
    Committed By:   gutteridge
    Date:           Wed Apr 10 01:07:10 UTC 2019

    Modified Files:
            pkgsrc/misc/mate-utils: Makefile PLIST distinfo
    Added Files:
            pkgsrc/misc/mate-utils/patches: patch-gsearchtool_help_Makefile.in

    Log Message:
    mate-utils: work around issue with itstool failures

    Disable the pt translations for one mate-utils component for now, to
    work around an issue where itstool is intermittently failing. This
    addresses PR pkg/54071. Okay youri@.

    To generate a diff of this commit:
    cvs rdiff -u -r1.16 -r1.17 pkgsrc/misc/mate-utils/Makefile
    cvs rdiff -u -r1.5 -r1.6 pkgsrc/misc/mate-utils/PLIST
    cvs rdiff -u -r1.6 -r1.7 pkgsrc/misc/mate-utils/distinfo
    cvs rdiff -u -r0 -r1.1 \
        pkgsrc/misc/mate-utils/patches/patch-gsearchtool_help_Makefile.in


 To generate a diff of this commit:
 cvs rdiff -u -r1.16 -r1.16.2.1 pkgsrc/misc/mate-utils/Makefile
 cvs rdiff -u -r1.5 -r1.5.2.1 pkgsrc/misc/mate-utils/PLIST
 cvs rdiff -u -r1.6 -r1.6.2.1 pkgsrc/misc/mate-utils/distinfo
 cvs rdiff -u -r0 -r1.2.2.2 \
     pkgsrc/misc/mate-utils/patches/patch-gsearchtool_help_Makefile.in

 Please note that diffs are not public domain; they are subject to the
 copyright notices on the relevant files.

State-Changed-From-To: pending-pullups->closed
State-Changed-By: gutteridge@NetBSD.org
State-Changed-When: Mon, 03 Jun 2019 11:25:43 +0000
State-Changed-Why:
Build fix pulled up to 2019Q1. Issue (specific to this package) resolved.

>Unformatted:

Home	PR Database Search