NetBSD Problem Report #54071
From bjjl@chaos.lorenz.place Mon Mar 25 09:21:39 2019
Return-Path: <bjjl@chaos.lorenz.place>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
by mollari.NetBSD.org (Postfix) with ESMTPS id 4CD027A1A8
for <gnats-bugs@gnats.NetBSD.org>; Mon, 25 Mar 2019 09:21:39 +0000 (UTC)
Message-Id: <20190325071832.3B50241078F@chaos.lorenz.place>
Date: Mon, 25 Mar 2019 08:18:32 +0100 (CET)
From: ben@pocket.services
To: gnats-bugs@NetBSD.org
Subject: mate build problems
X-Send-Pr-Version: 3.95
>Number: 54071
>Category: pkg
>Synopsis: mate build problems
>Confidential: no
>Severity: serious
>Priority: medium
>Responsible: gutteridge
>State: closed
>Class: sw-bug
>Submitter-Id: net
>Arrival-Date: Mon Mar 25 09:25:00 +0000 2019
>Closed-Date: Mon Jun 03 11:25:43 +0000 2019
>Last-Modified: Mon Jun 03 11:25:43 +0000 2019
>Originator: Benjamin Lorenz
>Release: NetBSD 8.99.36
>Organization:
>Environment:
System: NetBSD chaos.lorenz.place 8.99.36 NetBSD 8.99.36 (GENERIC) #0: Sun Mar 24 13:57:41 CET 2019 bjjl@chaos.lorenz.place:/home/bjjl/8.99/obj/sys/arch/amd64/compile/GENERIC amd64
Architecture: x86_64
Machine: amd64
>Description:
sysutils/caja-dropbox:
checking for gi on python3... yes
This is "no" and build fails when doing a fresh build of mate meta package.
After skipping this package, building all the rest, and then re-trying,
it was showing progress like above, saying it found gi on python3. I guess
some dependency is missing in the package meta data?
Second problem:
misc/mate-utils:
Entering directory '/home/bjjl/8.99/pkgsrc/misc/mate-utils/work/mate-utils-1.22.0/gsearchtool/help
GEN ar/
GEN pt/
GEN fr/
Traceback (most recent call last):
File "/usr/pkg/bin/itstool", line 1598, in <module>
doc.merge_translations(translations, opts.lang, strict=opts.strict)
File "/usr/pkg/bin/itstool", line 986, in merge_translations
lcnode.setProp(attr, origlang)
File "/usr/pkg/lib/python2.7/site-packages/libxml2.py", line 3590, in setProp
if ret is None:raise treeError('xmlSetProp() failed')
libxml2.treeError: xmlSetProp() failed
>How-To-Repeat:
>Fix:
>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: pkg-manager->youri
Responsible-Changed-By: leot@NetBSD.org
Responsible-Changed-When: Mon, 25 Mar 2019 11:18:58 +0000
Responsible-Changed-Why:
Youri, can you please give it a look?
(over to MAINTAINER)
From: "David H. Gutteridge" <david@gutteridge.ca>
To: gnats-bugs@netbsd.org
Cc:
Subject: Re: pkg/54071 (mate build problems)
Date: Mon, 25 Mar 2019 10:05:50 -0400
The caja-dropbox issue is my fault: I recorded an incorrect dependency
when I bumped it to 1.22. I'll fix that shortly. Sorry about that!
Concerning mate-utils, I've found it has a particular translation
file that can cause itstool to fail or segfault (I've seen both). I was
encountering this with itstool 2.0.4, but with 2.0.5, I couldn't
reproduce the issue, so I specified a hard dependency on that version
of the tool in mate-utils's make file. I did ten rebuilds of mate-utils
and couldn't reproduce the issue. I've since learned others have still
been encountering the problem (e.g. jmcneill@ hit it in his aarch64
builds).
Dave
From: "David H. Gutteridge" <gutteridge@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc:
Subject: PR/54071 CVS commit: pkgsrc/sysutils/caja-dropbox
Date: Mon, 25 Mar 2019 14:10:44 +0000
Module Name: pkgsrc
Committed By: gutteridge
Date: Mon Mar 25 14:10:44 UTC 2019
Modified Files:
pkgsrc/sysutils/caja-dropbox: Makefile
Log Message:
caja-dropbox: fix a dependency issue
We should be depending on py-gobject3, not gobject-introspection
directly. Addresses part of PR pkg/54071.
To generate a diff of this commit:
cvs rdiff -u -r1.17 -r1.18 pkgsrc/sysutils/caja-dropbox/Makefile
Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.
From: "David H. Gutteridge" <david@gutteridge.ca>
To: gnats-bugs@netbsd.org
Cc:
Subject: Re: pkg/54071 (mate build problems)
Date: Wed, 27 Mar 2019 00:58:42 -0400
I was able to duplicate the problem with mate-utils: it seems it may be
isolated to itstool using Python 2.7. (In one of my test environments,
I was using Python 3.6 by default. That was where I couldn't duplicate
the issue, and still can't. Since 2.7 is the default, we would be
hitting this in bulk builds and stock user installations.) I haven't
had time to analyze the issue further.
Dave
From: "David H. Gutteridge" <david@gutteridge.ca>
To: gnats-bugs@netbsd.org
Cc:
Subject: Re: pkg/54071 (mate build problems)
Date: Fri, 29 Mar 2019 01:33:51 -0400
I can intermittently reproduce this with Python 2.7. Some of the time,
the build succeeds, other times it hits the Python traceback previously
reported (the output I get there is identical), other times it will seg
fault, as below. (The example below is on Linux, so it's a cross-
platform issue.)
By "intermittently", e.g., in four test runs I just did, it hit the
traceback once, and succeeded in the rest. I've added more debugging
output, but am out of time tonight.
Core was generated by `/home/disciple/pkg/bin/python2.7 -s /home/disciple/pkg/bin/itstool -m ../pt/pt.'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00007f45b3bf2b58 in libxml_type () from /home/disciple/pkg/lib/python2.7/site-packages/libxml2mod.so
(gdb) bt
#0 0x00007f45b3bf2b58 in libxml_type () from /home/disciple/pkg/lib/python2.7/site-packages/libxml2mod.so
#1 0x00007f45b4864e39 in PyEval_EvalFrameEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#2 0x00007f45b48643de in PyEval_EvalFrameEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#3 0x00007f45b4865675 in PyEval_EvalCodeEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#4 0x00007f45b47eeedb in function_call () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#5 0x00007f45b47cb8b3 in PyObject_Call () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#6 0x00007f45b47cb981 in call_function_tail () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#7 0x00007f45b47cba51 in PyObject_CallFunction () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#8 0x00007f45b47d6e92 in instance_getattr2 () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#9 0x00007f45b47d76a0 in instance_getattr () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#10 0x00007f45b485fa93 in PyEval_EvalFrameEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#11 0x00007f45b4865675 in PyEval_EvalCodeEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#12 0x00007f45b486232c in PyEval_EvalFrameEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#13 0x00007f45b4865675 in PyEval_EvalCodeEx () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#14 0x00007f45b4865919 in PyEval_EvalCode () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#15 0x00007f45b487e65f in run_mod () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#16 0x00007f45b487f742 in PyRun_FileExFlags () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#17 0x00007f45b4880833 in PyRun_SimpleFileExFlags () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#18 0x00007f45b4891bf2 in Py_Main () from /home/disciple/pkg/lib/libpython2.7.so.1.0
#19 0x00007f45b4409413 in __libc_start_main () from /lib64/libc.so.6
#20 0x000000000040107e in _start ()
Dave
State-Changed-From-To: open->feedback
State-Changed-By: gutteridge@NetBSD.org
State-Changed-When: Mon, 01 Apr 2019 22:11:59 +0000
State-Changed-Why:
textproc/itstool (where the issue really lies) has been altered to
disallow Python 2.7. This should resolve the mate-utils issue, please
advise if it does so for you. Thanks!
From: Benjamin Lorenz <ben@pocket.services>
To: <gnats-bugs@netbsd.org>,
<youri@netbsd.org>,
<pkgsrc-bugs@netbsd.org>,
<gnats-admin@netbsd.org>,
<gutteridge@NetBSD.org>
Cc:
Subject: Re: pkg/54071 (mate build problems)
Date: Sun, 07 Apr 2019 10:23:02 +0200
Itstool unfortunately still crashes. With new Python 3.7.3 from pkgsrc current
gmake[3]: Entering directory '/home/bjjl/8.99/pkgsrc/misc/mate-utils/work/mate-utils-1.22.0/gsearchtool/help'
GEN pt/
GEN zh_HK/
GEN sr@latin/
GEN th/
[1] Segmentation fault (core dumped) (cd "pt/" && itstool -m "${mo}" ${d}/C/index.d...
Gdb says
Core was generated by `python3.7'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00007e537ea3e514 in libxml_type () from /usr/pkg/lib/python3.7/site-packages/libxml2mod.so
(gdb) bt
#0 0x00007e537ea3e514 in libxml_type () from /usr/pkg/lib/python3.7/site-packages/libxml2mod.so
#1 0x00007e5382a7f3eb in _PyMethodDef_RawFastCallKeywords () from /usr/pkg/lib/libpython3.7.so.1.0
#2 0x00007e5382a7f5f2 in _PyCFunction_FastCallKeywords () from /usr/pkg/lib/libpython3.7.so.1.0
#3 0x00007e5382ba762b in _PyEval_EvalFrameDefault () from /usr/pkg/lib/libpython3.7.so.1.0
#4 0x00007e5382b9ea36 in function_code_fastcall () from /usr/pkg/lib/libpython3.7.so.1.0
#5 0x00007e5382ba60ca in _PyEval_EvalFrameDefault () from /usr/pkg/lib/libpython3.7.so.1.0
From: "David H. Gutteridge" <david@gutteridge.ca>
To: Benjamin Lorenz <ben@pocket.services>, gnats-bugs@netbsd.org,
youri@netbsd.org
Cc:
Subject: Re: pkg/54071 (mate build problems)
Date: Sun, 07 Apr 2019 05:17:30 -0400
On Sun, 2019-04-07 at 10:23 +0200, Benjamin Lorenz wrote:
> Itstool unfortunately still crashes. With new Python 3.7.3 from pkgsrc
> current
>
> gmake[3]: Entering directory '/home/bjjl/8.99/pkgsrc/misc/mate-
> utils/work/mate-utils-1.22.0/gsearchtool/help'
> GEN pt/
> GEN zh_HK/
> GEN sr@latin/
> GEN th/
> [1] Segmentation fault (core dumped) (cd "pt/" && itstool -m "${mo}"
> ${d}/C/index.d...
>
> Gdb says
>
> Core was generated by `python3.7'.
> Program terminated with signal SIGSEGV, Segmentation fault.
> #0 0x00007e537ea3e514 in libxml_type () from
> /usr/pkg/lib/python3.7/site-packages/libxml2mod.so
> (gdb) bt
> #0 0x00007e537ea3e514 in libxml_type () from
> /usr/pkg/lib/python3.7/site-packages/libxml2mod.so
> #1 0x00007e5382a7f3eb in _PyMethodDef_RawFastCallKeywords () from
> /usr/pkg/lib/libpython3.7.so.1.0
> #2 0x00007e5382a7f5f2 in _PyCFunction_FastCallKeywords () from
> /usr/pkg/lib/libpython3.7.so.1.0
> #3 0x00007e5382ba762b in _PyEval_EvalFrameDefault () from
> /usr/pkg/lib/libpython3.7.so.1.0
> #4 0x00007e5382b9ea36 in function_code_fastcall () from
> /usr/pkg/lib/libpython3.7.so.1.0
> #5 0x00007e5382ba60ca in _PyEval_EvalFrameDefault () from
> /usr/pkg/lib/libpython3.7.so.1.0
That's not good. I guess we could apply a workaround like they were
using with gnumeric112 recently, where they simply disabled the
particular language translation file that was causing the issue.
FWIW, I haven't been able to reproduce this in a few test runs I just
did. But I can see it also occurred on a recent Joyent SmartOS build.
Dave
From: "David H. Gutteridge" <david@gutteridge.ca>
To: Benjamin Lorenz <ben@pocket.services>, gnats-bugs@netbsd.org,
youri@netbsd.org
Cc:
Subject: Re: pkg/54071 (mate build problems)
Date: Sun, 07 Apr 2019 05:38:37 -0400
On Sun, 2019-04-07 at 05:17 -0400, David H. Gutteridge wrote:
> That's not good. I guess we could apply a workaround like they were
> using with gnumeric112 recently, where they simply disabled the
> particular language translation file that was causing the issue.
>
> FWIW, I haven't been able to reproduce this in a few test runs I just
> did. But I can see it also occurred on a recent Joyent SmartOS build.
This is https://github.com/itstool/itstool/issues/36 upstream. It seems
OpenBSD went with the option of disabling the pt translations for now.
I'm inclined to do the same.
(I also see they just released itstool 2.0.6, but the changes aren't
relevant in this context.)
Dave
State-Changed-From-To: feedback->open
State-Changed-By: gutteridge@NetBSD.org
State-Changed-When: Sun, 07 Apr 2019 09:41:08 +0000
State-Changed-Why:
Feedback provided, thanks.
From: Benjamin Lorenz <ben@pocket.services>
To: <gnats-bugs@netbsd.org>,
<youri@netbsd.org>,
<gnats-admin@netbsd.org>,
<pkgsrc-bugs@netbsd.org>
Cc:
Subject: Re: pkg/54071 (mate build problems)
Date: Sun, 07 Apr 2019 11:41:04 +0200
Compiled with debug symbols. It is crashing in libxml.c, in the directory /home/bjjl/8.99/pkgsrc/textproc/py-libxml2/work/libxml2-2.9.9/python, in the switch statement
switch (cur->type) {
case XML_ELEMENT_NODE:
res = (const xmlChar *) "element";
break;
case XML_ATTRIBUTE_NODE:
res = (const xmlChar *) "attribute";
break;
case XML_TEXT_NODE:
res = (const xmlChar *) "text";
break;
...
Core was generated by `python3.7'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x000072da7964b1ea in libxml_type (self=0x72da7c9113a8, args=0x72da7c823098) at libxml.c:2763
2763 res = (const xmlChar *) "attribute";
(gdb) bt
#0 0x000072da7964b1ea in libxml_type (self=0x72da7c9113a8, args=0x72da7c823098) at libxml.c:2763
#1 0x000072da7d67f3eb in _PyMethodDef_RawFastCallKeywords () from /usr/pkg/lib/libpython3.7.so.1.0
#2 0x000072da7d67f5f2 in _PyCFunction_FastCallKeywords () from /usr/pkg/lib/libpython3.7.so.1.0
From: "David H. Gutteridge" <gutteridge@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc:
Subject: PR/54071 CVS commit: pkgsrc/misc/mate-utils
Date: Wed, 10 Apr 2019 01:07:10 +0000
Module Name: pkgsrc
Committed By: gutteridge
Date: Wed Apr 10 01:07:10 UTC 2019
Modified Files:
pkgsrc/misc/mate-utils: Makefile PLIST distinfo
Added Files:
pkgsrc/misc/mate-utils/patches: patch-gsearchtool_help_Makefile.in
Log Message:
mate-utils: work around issue with itstool failures
Disable the pt translations for one mate-utils component for now, to
work around an issue where itstool is intermittently failing. This
addresses PR pkg/54071. Okay youri@.
To generate a diff of this commit:
cvs rdiff -u -r1.16 -r1.17 pkgsrc/misc/mate-utils/Makefile
cvs rdiff -u -r1.5 -r1.6 pkgsrc/misc/mate-utils/PLIST
cvs rdiff -u -r1.6 -r1.7 pkgsrc/misc/mate-utils/distinfo
cvs rdiff -u -r0 -r1.1 \
pkgsrc/misc/mate-utils/patches/patch-gsearchtool_help_Makefile.in
Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.
Responsible-Changed-From-To: youri->gutteridge
Responsible-Changed-By: gutteridge@NetBSD.org
Responsible-Changed-When: Mon, 15 Apr 2019 22:27:04 +0000
Responsible-Changed-Why:
Take, since I've been handling this. It's had a workaround applied,
but isn't properly resolved upstream.
From: "David H. Gutteridge" <david@gutteridge.ca>
To: Benjamin Lorenz <ben@pocket.services>, gnats-bugs@netbsd.org,
youri@netbsd.org
Cc:
Subject: Re: pkg/54071 (mate build problems)
Date: Tue, 07 May 2019 22:31:58 -0400
mate-utils 1.22.1 works around the problem exactly the same way, they
simply removed the problematic "pt" translation file from consideration.
I'm inclined to close this PR, and leave it to upstream to revisit this
issue. (There hasn't been any traction in the itstool PR to date.)
Dave
State-Changed-From-To: open->pending-pullups
State-Changed-By: gutteridge@NetBSD.org
State-Changed-When: Wed, 08 May 2019 11:33:51 +0000
State-Changed-Why:
Pull-up pending in releng ticket #5966.
From: "S.P.Zeidler" <spz@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc:
Subject: PR/54071 CVS commit: [pkgsrc-2019Q1] pkgsrc/misc/mate-utils
Date: Sun, 2 Jun 2019 18:15:09 +0000
Module Name: pkgsrc
Committed By: spz
Date: Sun Jun 2 18:15:08 UTC 2019
Modified Files:
pkgsrc/misc/mate-utils [pkgsrc-2019Q1]: Makefile PLIST distinfo
Added Files:
pkgsrc/misc/mate-utils/patches [pkgsrc-2019Q1]:
patch-gsearchtool_help_Makefile.in
Log Message:
Pullup ticket #5966 - requested by gutteridge
misc/mate-utils: build fix
Revisions pulled up:
- misc/mate-utils/Makefile 1.17
- misc/mate-utils/PLIST 1.6
- misc/mate-utils/distinfo 1.7
- misc/mate-utils/patches/patch-gsearchtool_help_Makefile.in 1.1
-------------------------------------------------------------------
Module Name: pkgsrc
Committed By: gutteridge
Date: Wed Apr 10 01:07:10 UTC 2019
Modified Files:
pkgsrc/misc/mate-utils: Makefile PLIST distinfo
Added Files:
pkgsrc/misc/mate-utils/patches: patch-gsearchtool_help_Makefile.in
Log Message:
mate-utils: work around issue with itstool failures
Disable the pt translations for one mate-utils component for now, to
work around an issue where itstool is intermittently failing. This
addresses PR pkg/54071. Okay youri@.
To generate a diff of this commit:
cvs rdiff -u -r1.16 -r1.17 pkgsrc/misc/mate-utils/Makefile
cvs rdiff -u -r1.5 -r1.6 pkgsrc/misc/mate-utils/PLIST
cvs rdiff -u -r1.6 -r1.7 pkgsrc/misc/mate-utils/distinfo
cvs rdiff -u -r0 -r1.1 \
pkgsrc/misc/mate-utils/patches/patch-gsearchtool_help_Makefile.in
To generate a diff of this commit:
cvs rdiff -u -r1.16 -r1.16.2.1 pkgsrc/misc/mate-utils/Makefile
cvs rdiff -u -r1.5 -r1.5.2.1 pkgsrc/misc/mate-utils/PLIST
cvs rdiff -u -r1.6 -r1.6.2.1 pkgsrc/misc/mate-utils/distinfo
cvs rdiff -u -r0 -r1.2.2.2 \
pkgsrc/misc/mate-utils/patches/patch-gsearchtool_help_Makefile.in
Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.
State-Changed-From-To: pending-pullups->closed
State-Changed-By: gutteridge@NetBSD.org
State-Changed-When: Mon, 03 Jun 2019 11:25:43 +0000
State-Changed-Why:
Build fix pulled up to 2019Q1. Issue (specific to this package) resolved.
>Unformatted:
(Contact us)
$NetBSD: query-full-pr,v 1.43 2018/01/16 07:36:43 maya Exp $
$NetBSD: gnats_config.sh,v 1.9 2014/08/02 14:16:04 spz Exp $
Copyright © 1994-2017
The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.