NetBSD Problem Report #55134

From www@netbsd.org  Fri Apr  3 08:50:08 2020
Return-Path: <www@netbsd.org>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 120AB1A9213
	for <gnats-bugs@gnats.NetBSD.org>; Fri,  3 Apr 2020 08:50:08 +0000 (UTC)
Message-Id: <20200403085006.907EC1A921E@mollari.NetBSD.org>
Date: Fri,  3 Apr 2020 08:50:06 +0000 (UTC)
From: jbryn@students.wcpss.net
Reply-To: jbryn@students.wcpss.net
To: gnats-bugs@NetBSD.org
Subject: py-setuptools build crashes wtih MemoryError on OpenBSD amd64
X-Send-Pr-Version: www-1.0

>Number:         55134
>Category:       pkg
>Synopsis:       py-setuptools build crashes wtih MemoryError on OpenBSD amd64
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    openbsd-pkg-people
>State:          closed
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Fri Apr 03 08:55:00 +0000 2020
>Closed-Date:    Tue Sep 01 09:32:13 +0000 2020
>Last-Modified:  Tue Sep 01 09:35:01 +0000 2020
>Originator:     Jackson Bryn
>Release:        2020-Q1
>Organization:
N/A
>Environment:
OpenBSD tp-a485.THINKPADS 6.6 GENERIC.MP#7 amd64
>Description:
=> Bootstrap dependency digest>=20010302: found digest-20190127
===> Skipping vulnerability checks.
WARNING: No /usr/pkg/pkgdb/pkg-vulnerabilities file found.
WARNING: To fix run: `/usr/pkg/sbin/pkg_admin -K /usr/pkg/pkgdb fetch-pkg-vulnerabilities'.
=> Checksum SHA1 OK for setuptools-44.0.0.zip
=> Checksum RMD160 OK for setuptools-44.0.0.zip
=> Checksum SHA512 OK for setuptools-44.0.0.zip
===> Installing dependencies for py37-setuptools-44.0.0
==========================================================================
The following variables will affect the build process of this package,
py37-setuptools-44.0.0.  Their current value is shown below:

        * PYTHON_VERSION_DEFAULT = 37

Based on these variables, the following variables have been set:

        * PYPACKAGE = python37

You may want to abort the process now with CTRL-C and change their value
before continuing.  Be sure to run `/usr/pkg/bin/bmake clean' after
the changes.
==========================================================================
=> Tool dependency unzip-[0-9]*: found unzip-6.0nb9
=> Build dependency cwrappers>=20150314: found cwrappers-20180325
=> Full dependency py37-expat-[0-9]*: found py37-expat-3.7.7
=> Full dependency python37>=3.7.0: found python37-3.7.7
===> Overriding tools for py37-setuptools-44.0.0
===> Extracting for py37-setuptools-44.0.0
===> Patching for py37-setuptools-44.0.0
=> Applying pkgsrc patches for py37-setuptools-44.0.0
===> Creating toolchain wrappers for py37-setuptools-44.0.0
===> Configuring for py37-setuptools-44.0.0
=> Replacing python interpreter in setuptools/command/easy_install.py.
===> Building for py37-setuptools-44.0.0
(cd /usr/work/devel/py-setuptools/work/setuptools-44.0.0/ && /usr/bin/env USETOOLS=no PTHREAD_CFLAGS=\ -pthread\  PTHREAD_LDFLAGS=\ -pthread PTHREAD_LIBS=-lpthread PTHREADBASE=/usr DL_CFLAGS=\ -pthread\  DL_LDFLAGS=\ -pthread DL_LIBS=-lpthread PYTHON=/usr/pkg/bin/python3.7 CC=clang CFLAGS=-O2\ -O2\ -march=znver1\ -mtune=znver1\ -pipe\ -fstack-protector\ -I/usr/include\ -I/usr/pkg/include/python3.7\ -I/usr/pkg/include CPPFLAGS=-I/usr/include\ -I/usr/pkg/include/python3.7\ -I/usr/pkg/include CXX=clang++ CXXFLAGS=-O2\ -O2\ -march=znver1\ -mtune=znver1\ -pipe\ -fstack-protector\ -I/usr/include\ -I/usr/pkg/include/python3.7\ -I/usr/pkg/include COMPILER_RPATH_FLAG=-Wl,-R F77=f77 FC=f77 FFLAGS=-O LANG=C LC_ALL=C LC_COLLATE=C LC_CTYPE=C LC_MESSAGES=C LC_MONETARY=C LC_NUMERIC=C LC_TIME=C LDFLAGS=-L/usr/lib\ -Wl,-R/usr/lib\ -L/usr/pkg/lib\ -Wl,-R/usr/pkg/lib LINKER_RPATH_FLAG=-R PATH=/usr/work/devel/py-setuptools/work/.cwrapper/bin:/usr/work/devel/py-setuptools/work/.buildlink/bin:/usr/work/de
 vel/py-setuptools/work/.tools/bin:/usr/pkg/bin:/usr/pkg/bin:/sbin:/usr/sbin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/sbin:/usr/local/bin:/usr/pkg/bin:/usr/X11R6/bin PREFIX=/usr/pkg MAKELEVEL=0 CONFIG_SITE= PKG_SYSCONFDIR=/usr/pkg/etc CXXCPP=clang\ -E HOME=/usr/work/devel/py-setuptools/work/.home CWRAPPERS_CONFIG_DIR=/usr/work/devel/py-setuptools/work/.cwrapper/config CPP=clang\ -E LOCALBASE=/usr/pkg X11BASE=/usr/X11R6 PKGMANDIR=man PKGINFODIR=info PKGGNUDIR=gnu/ MAKECONF=/dev/null OBJECT_FMT=ELF USETOOLS=no BSD_INSTALL_PROGRAM=/usr/bin/install\ -c\ -s\ -o\ root\ -g\ wheel\ -m\ 755 BSD_INSTALL_SCRIPT=/usr/bin/install\ -c\ -o\ root\ -g\ wheel\ -m\ 755 BSD_INSTALL_LIB=/usr/bin/install\ -c\ -o\ root\ -g\ wheel\ -m\ 755 BSD_INSTALL_DATA=/usr/bin/install\ -c\ -o\ root\ -g\ wheel\ -m\ 644 BSD_INSTALL_MAN=/usr/bin/install\ -c\ -o\ root\ -g\ wheel\ -m\ 644 BSD_INSTALL=/usr/bin/install BSD_INSTALL_PROGRAM_DIR=/usr/bin/install\ -d\ -o\ root\ -g\ wheel\ -m\ 755 BSD_INSTALL_SCRIPT_DIR=/usr/bin/in
 stall\ -d\ -o\ root\ -g\ wheel\ -m\ 755 BSD_INSTALL_LIB_DIR=/usr/bin/install\ -d\ -o\ root\ -g\ wheel\ -m\ 755 BSD_INSTALL_DATA_DIR=/usr/bin/install\ -d\ -o\ root\ -g\ wheel\ -m\ 755 BSD_INSTALL_MAN_DIR=/usr/bin/install\ -d\ -o\ root\ -g\ wheel\ -m\ 755 BSD_INSTALL_GAME=/usr/bin/install\ -c\ -s\ -o\ root\ -g\ wheel\ -m\ 2555 BSD_INSTALL_GAME_DATA=/usr/bin/install\ -c\ -o\ root\ -g\ wheel\ -m\ 664 BSD_INSTALL_GAME_DIR=/usr/bin/install\ -d\ -o\ root\ -g\ wheel\ -m\ 775 INSTALL_INFO= MAKEINFO=/usr/work/devel/py-setuptools/work/.tools/bin/makeinfo FLEX= BISON= PKG_CONFIG= PKG_CONFIG_LIBDIR=/usr/work/devel/py-setuptools/work/.buildlink/lib/pkgconfig:/usr/work/devel/py-setuptools/work/.buildlink/share/pkgconfig PKG_CONFIG_LOG=/usr/work/devel/py-setuptools/work/.pkg-config.log PKG_CONFIG_PATH= CWRAPPERS_CONFIG_DIR=/usr/work/devel/py-setuptools/work/.cwrapper/config /usr/pkg/bin/python3.7  setup.py  build  -j2)
Traceback (most recent call last):
  File "setup.py", line 9, in <module>
    import setuptools
  File "/usr/work/devel/py-setuptools/work/setuptools-44.0.0/setuptools/__init__.py", line 20, in <module>
    from setuptools.dist import Distribution, Feature
  File "/usr/work/devel/py-setuptools/work/setuptools-44.0.0/setuptools/dist.py", line 36, in <module>
    from setuptools import windows_support
  File "/usr/work/devel/py-setuptools/work/setuptools-44.0.0/setuptools/windows_support.py", line 2, in <module>
    import ctypes
  File "/usr/pkg/lib/python3.7/ctypes/__init__.py", line 551, in <module>
    _reset_cache()
  File "/usr/pkg/lib/python3.7/ctypes/__init__.py", line 273, in _reset_cache
    CFUNCTYPE(c_int)(lambda: None)
MemoryError
*** Error code 1

Stop.
bmake[1]: stopped in /usr/pkgsrc/devel/py-setuptools
*** Error code 1

Stop.
bmake: stopped in /usr/pkgsrc/devel/py-setuptools

Tried adjusting ulimits and setting every relevant property in UNLIMIT_RESOURCES, but no dice. Have not gone to adjusting vmparams.h yet.
>How-To-Repeat:
1. bmake
>Fix:

>Release-Note:

>Audit-Trail:

Responsible-Changed-From-To: pkg-manager->openbsd-pkg-people
Responsible-Changed-By: leot@NetBSD.org
Responsible-Changed-When: Fri, 03 Apr 2020 09:02:36 +0000
Responsible-Changed-Why:
OpenBSD problem


State-Changed-From-To: open->closed
State-Changed-By: schmonz@NetBSD.org
State-Changed-When: Tue, 01 Sep 2020 09:32:13 +0000
State-Changed-Why:
Fixed in pythons 2.7.18nb2, 3.6.12nb1, and 3.7.9nb1 (couldn't reproduce with 3.8). Thanks for the report!


From: "Amitai Schleier" <schmonz@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc: 
Subject: PR/55134 CVS commit: pkgsrc/lang
Date: Tue, 1 Sep 2020 09:26:55 +0000

 Module Name:	pkgsrc
 Committed By:	schmonz
 Date:		Tue Sep  1 09:26:55 UTC 2020

 Modified Files:
 	pkgsrc/lang/python27: Makefile distinfo
 	pkgsrc/lang/python36: Makefile distinfo
 	pkgsrc/lang/python37: Makefile distinfo
 Added Files:
 	pkgsrc/lang/python27/patches: patch-Lib_ctypes_____init____.py
 	pkgsrc/lang/python36/patches: patch-Lib_ctypes_____init____.py
 	pkgsrc/lang/python37/patches: patch-Lib_ctypes_____init____.py

 Log Message:
 Avoid MemoryError from "import ctypes" on OpenBSD (PR pkg/55134) for all
 applicable Pythons. Bump PKGREVISION.


 To generate a diff of this commit:
 cvs rdiff -u -r1.88 -r1.89 pkgsrc/lang/python27/Makefile
 cvs rdiff -u -r1.77 -r1.78 pkgsrc/lang/python27/distinfo
 cvs rdiff -u -r0 -r1.1 \
     pkgsrc/lang/python27/patches/patch-Lib_ctypes_____init____.py
 cvs rdiff -u -r1.26 -r1.27 pkgsrc/lang/python36/Makefile
 cvs rdiff -u -r1.33 -r1.34 pkgsrc/lang/python36/distinfo
 cvs rdiff -u -r0 -r1.1 \
     pkgsrc/lang/python36/patches/patch-Lib_ctypes_____init____.py
 cvs rdiff -u -r1.20 -r1.21 pkgsrc/lang/python37/Makefile \
     pkgsrc/lang/python37/distinfo
 cvs rdiff -u -r0 -r1.1 \
     pkgsrc/lang/python37/patches/patch-Lib_ctypes_____init____.py

 Please note that diffs are not public domain; they are subject to the
 copyright notices on the relevant files.

>Unformatted:

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.46 2020/01/03 16:35:01 leot Exp $
$NetBSD: gnats_config.sh,v 1.9 2014/08/02 14:16:04 spz Exp $
Copyright © 1994-2020 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.