NetBSD Problem Report #50209

From www@NetBSD.org  Fri Sep  4 17:13:46 2015
Return-Path: <www@NetBSD.org>
Received: from mail.netbsd.org (mail.netbsd.org [149.20.53.66])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "mail.netbsd.org", Issuer "Postmaster NetBSD.org" (verified OK))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 884ECA57FD
	for <gnats-bugs@gnats.NetBSD.org>; Fri,  4 Sep 2015 17:13:46 +0000 (UTC)
Message-Id: <20150904171341.C7721A6558@mollari.NetBSD.org>
Date: Fri,  4 Sep 2015 17:13:41 +0000 (UTC)
From: nonakap@gmail.com
Reply-To: nonakap@gmail.com
To: gnats-bugs@NetBSD.org
Subject: devel/opengrok: should not be download jar files during build
X-Send-Pr-Version: www-1.0

>Number:         50209
>Category:       pkg
>Synopsis:       devel/opengrok: should not be download jar files during build
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    pkg-manager
>State:          open
>Class:          change-request
>Submitter-Id:   net
>Arrival-Date:   Fri Sep 04 17:15:00 +0000 2015
>Last-Modified:  Sun Sep 06 01:20:00 +0000 2015
>Originator:     NONAKA Kimihiro
>Release:        HEAD (20150904)
>Organization:
>Environment:
NetBSD koharu.myhome.nonakap.org 7.99.21 NetBSD 7.99.21 (KOHARU) #3204: Thu Sep  3 23:04:05 JST 2015  nonaka@koharu.myhome.nonakap.org:/home/snapshot/NetBSD/20150822/obj.NetBSD-amd64/amd64/sys/arch/amd64/compile/KOHARU amd64
>Description:
devel/opengrok is download some jar files during build.
For example, if proxy server is needed environment it fails to download the jar file.

---------- BUILD LOG ----------
=> Bootstrap dependency digest>=20010302: found digest-20121220
=> Bootstrap dependency wget-[0-9]*: found wget-1.16.1
===> Skipping vulnerability checks.
WARNING: No /var/db/pkg/pkg-vulnerabilities file found.
WARNING: To fix run: `/usr/sbin/pkg_admin -K /var/db/pkg fetch-pkg-vulnerabilities'.
=> Checksum SHA1 OK for OpenGrok-0.12.1.5.tar.gz
=> Checksum RMD160 OK for OpenGrok-0.12.1.5.tar.gz
===> Installing dependencies for OpenGrok-0.12.1.5
==========================================================================
The supported build options for OpenGrok are:

	svn

The currently selected options are:

	svn

You can select which build options to use by setting PKG_DEFAULT_OPTIONS
or the following variable.  Its current value is shown:

	PKG_OPTIONS.opengrok = svn

==========================================================================
==========================================================================
The following variables will affect the build process of this package,
OpenGrok-0.12.1.5.  Their current value is shown below:

        * PKG_JVM_DEFAULT (defined)
        * SSLBASE = /usr
        * SSLCERTS = /etc/openssl/certs
        * SSLDIR = /etc/openssl
        * SSLKEYS = /etc/openssl/private

Based on these variables, the following variables have been set:

        * JAVA_BINPREFIX = /usr/pkg/bin/openjdk8
        * PKG_JAVA_HOME = /usr/pkg/java/openjdk8
        * PKG_JVM = openjdk8

You may want to abort the process now with CTRL-C and change their value
before continuing.  Be sure to run `/usr/bin/make clean' after
the changes.
==========================================================================
=> Tool dependency bsdtar-[0-9]*: found bsdtar-3.1.2nb1
=> Full dependency exctags-[0-9]*: found exctags-5.8
=> Full dependency jflex-[0-9]*: found jflex-1.6.0
=> Full dependency apache-ant-[0-9]*: found apache-ant-1.9.6
=> Full dependency zip-[0-9]*: found zip-3.0nb2
=> Full dependency zip-[0-9]*: found zip-3.0nb2
=> Full dependency zip-[0-9]*: found zip-3.0nb2
=> Full dependency zip-[0-9]*: found zip-3.0nb2
=> Full dependency subversion-base>=1.8.13nb1: found subversion-base-1.8.13nb1
=> Full dependency openjdk8-[0-9]*: found openjdk8-1.8.51nb1
=> Full dependency openjdk8>=1.8.0: found openjdk8-1.8.51nb1
===> Overriding tools for OpenGrok-0.12.1.5
===> Extracting for OpenGrok-0.12.1.5
===> Patching for OpenGrok-0.12.1.5
=> Applying pkgsrc patches for OpenGrok-0.12.1.5
===> Creating toolchain wrappers for OpenGrok-0.12.1.5
/bin/mkdir -p /usr/obj.pkgsrc/devel/opengrok/work.netbsd/.buildlink/bin && /bin/ln -fs apr-1-config /usr/obj.pkgsrc/devel/opengrok/work.netbsd/.buildlink/bin/apr-config
/bin/mkdir -p /usr/obj.pkgsrc/devel/opengrok/work.netbsd/.buildlink/bin && /bin/ln -fs apu-1-config /usr/obj.pkgsrc/devel/opengrok/work.netbsd/.buildlink/bin/apu-config
===> Configuring for OpenGrok-0.12.1.5
=> Set VCS program pathes.
=> Set configuration.xml location
===> Building for OpenGrok-0.12.1.5
cd /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5 &&  CLASSPATH=/usr/pkg/lib/java/JFlex.jar /usr/pkg/bin/ant
Buildfile: /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/build.xml

-touch-manifest:

-exclude-client:

-pre-init:

-init-private:

-init-user:

-init-project:

-init-macrodef-property:

-do-init:

-post-init:
    [mkdir] Created dir: /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/build/test/classes
    [mkdir] Created dir: /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/build/src/jsp

-init-check:

-init-macrodef-javac:

-init-macrodef-junit:

-init-debug-args:

-init-macrodef-nbjpda:

-init-macrodef-debug:

-init-macrodef-java:

-init-presetdef-jar:

init:

-deps-jar-init:

deps-jar:

-warn-already-built-jar:
[propertyfile] Updating property file: /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/build/built-jar.properties

-check-automatic-build:

-clean-after-automatic-build:

-verify-automatic-build:

-pre-pre-compile:
    [mkdir] Created dir: /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/build/classes

jrcs:
    [mkdir] Created dir: /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/build/jrcs
    [javac] Compiling 51 source files to /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/build/jrcs
      [jar] Building jar: /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/lib/jrcs.jar

-check-jflex:

download-jflex:
      [get] Getting: http://repo1.maven.org/maven2/de/jflex/jflex/1.5.1/jflex-1.5.1.jar
      [get] To: /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/lib/jflex-1.5.1.jar
      [get] Error getting http://repo1.maven.org/maven2/de/jflex/jflex/1.5.1/jflex-1.5.1.jar to /usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/lib/jflex-1.5.1.jar

BUILD FAILED
/usr/obj.pkgsrc/devel/opengrok/work.netbsd/OpenGrok-0.12.1.5/build.xml:159: java.net.ConnectException: Connection timed out
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:589)
	at java.net.Socket.connect(Socket.java:538)
	at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
	at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
	at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
	at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
	at sun.net.www.http.HttpClient.New(HttpClient.java:308)
	at sun.net.www.http.HttpClient.New(HttpClient.java:326)
	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1168)
	at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1104)
	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:998)
	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:932)
	at org.apache.tools.ant.taskdefs.Get$GetThread.openConnection(Get.java:728)
	at org.apache.tools.ant.taskdefs.Get$GetThread.get(Get.java:641)
	at org.apache.tools.ant.taskdefs.Get$GetThread.run(Get.java:631)

Total time: 1 minute 17 seconds
*** Error code 1

Stop.
make: stopped in /usr/pkgsrc/devel/opengrok
*** Error code 1

Stop.
make: stopped in /usr/pkgsrc/devel/opengrok
---------- BUILD LOG ----------

>How-To-Repeat:
1) cd /path/to/pkgsrc/devel/opengrok
2) make fetch
3) (Down all networks)
4) make

>Fix:
For example, jar files is download when make fetch like following patch.

Index: Makefile
===================================================================
RCS file: /cvsroot/pkgsrc/devel/opengrok/Makefile,v
retrieving revision 1.41
diff -u -r1.41 Makefile
--- Makefile	4 Sep 2015 14:23:49 -0000	1.41
+++ Makefile	4 Sep 2015 14:25:20 -0000
@@ -2,8 +2,10 @@

 DISTNAME=	OpenGrok-0.12.1.5
 PKGNAME=	${DISTNAME:tl:S/-rc/rc/}
+PKGREVISION=	1
 CATEGORIES=	devel
 MASTER_SITES=	${MASTER_SITE_GITHUB:=OpenGrok/}
+DISTFILES=	${DEFAULT_DISTFILES}

 MAINTAINER=	pkgsrc-users@NetBSD.org
 HOMEPAGE=	http://opengrok.github.io/OpenGrok/
@@ -13,9 +15,22 @@
 EXTRACT_USING=	bsdtar

 DEPENDS+=	exctags-[0-9]*:../../devel/exctags
-DEPENDS+=	jflex-[0-9]*:../../devel/jflex
 DEPENDS+=	apache-ant-[0-9]*:../../devel/apache-ant

+JFLEX_VER=	1.5.1
+DISTFILES+=	jflex-${JFLEX_VER}.jar
+SITES.jflex-${JFLEX_VER}.jar= http://repo1.maven.org/maven2/de/jflex/jflex/${JFLEX_VER}/
+
+LUCENE_VER=	4.7.1
+DISTFILES+=	lucene-core-${LUCENE_VER}.jar
+DISTFILES+=	lucene-analyzers-common-${LUCENE_VER}.jar
+DISTFILES+=	lucene-queryparser-${LUCENE_VER}.jar
+DISTFILES+=	lucene-suggest-${LUCENE_VER}.jar
+SITES.lucene-core-${LUCENE_VER}.jar= http://repo1.maven.org/maven2/org/apache/lucene/lucene-core/${LUCENE_VER}/
+SITES.lucene-analyzers-common-${LUCENE_VER}.jar= http://repo1.maven.org/maven2/org/apache/lucene/lucene-analyzers-common/${LUCENE_VER}/
+SITES.lucene-queryparser-${LUCENE_VER}.jar= http://repo1.maven.org/maven2/org/apache/lucene/lucene-queryparser/${LUCENE_VER}/
+SITES.lucene-suggest-${LUCENE_VER}.jar= http://repo1.maven.org/maven2/org/apache/lucene/lucene-suggest/${LUCENE_VER}/
+
 # XXX PREFIX should not be used here, but I would like to reduce dependencies.
 SUBST_CLASSES+=		vcs
 SUBST_FILES.vcs+=	OpenGrok
@@ -46,8 +61,11 @@
 			share/opengrok/var/opengrok

 do-build:
-	cd ${WRKSRC} && \
-		CLASSPATH=${PREFIX}/lib/java/JFlex.jar ${PREFIX}/bin/ant
+	cp ${WRKDIR}/jflex-${JFLEX_VER}.jar ${WRKSRC}/lib/
+	for i in core analyzers-common queryparser suggest; do \
+		cp ${WRKDIR}/lucene-$$i-${LUCENE_VER}.jar ${WRKSRC}/lib; \
+	done
+	cd ${WRKSRC} && ${PREFIX}/bin/ant

 do-install:
 	${INSTALL_SCRIPT} ${WRKSRC}/OpenGrok \
Index: distinfo
===================================================================
RCS file: /cvsroot/pkgsrc/devel/opengrok/distinfo,v
retrieving revision 1.13
diff -u -r1.13 distinfo
--- distinfo	4 Sep 2015 14:23:49 -0000	1.13
+++ distinfo	4 Sep 2015 14:25:20 -0000
@@ -3,5 +3,20 @@
 SHA1 (OpenGrok-0.12.1.5.tar.gz) = a31ca03bb340a084019825de61b9ec1878662c95
 RMD160 (OpenGrok-0.12.1.5.tar.gz) = 2c4dbebe88eab498d7d4a25807cc0bd45a4a5f40
 Size (OpenGrok-0.12.1.5.tar.gz) = 1560600 bytes
+SHA1 (jflex-1.5.1.jar) = 262c62559392e63dbab50ed023cc398035c8a9cf
+RMD160 (jflex-1.5.1.jar) = 17bab7447efadde3a1bcc7f561a4baa2885bda7f
+Size (jflex-1.5.1.jar) = 940749 bytes
+SHA1 (lucene-analyzers-common-4.7.1.jar) = 5980364242d4e34d7afd5a848af49d9ce42f522e
+RMD160 (lucene-analyzers-common-4.7.1.jar) = fc1315c268573fa39d69c52313505ddff9dad811
+Size (lucene-analyzers-common-4.7.1.jar) = 1658498 bytes
+SHA1 (lucene-core-4.7.1.jar) = 91ca386b26cd6e5942616c9787131df4ab434483
+RMD160 (lucene-core-4.7.1.jar) = 455b6e12284e40357a998e596aac7acecd566056
+Size (lucene-core-4.7.1.jar) = 2357831 bytes
+SHA1 (lucene-queryparser-4.7.1.jar) = 0781aa1701302fb56ac516df4c7958c257841296
+RMD160 (lucene-queryparser-4.7.1.jar) = 35e015ae016168d10c6f7d2e5315891fae89c0ff
+Size (lucene-queryparser-4.7.1.jar) = 390053 bytesIndex: Makefile
===================================================================
RCS file: /cvsroot/pkgsrc/devel/opengrok/Makefile,v
retrieving revision 1.41
diff -u -r1.41 Makefile
--- Makefile	4 Sep 2015 14:23:49 -0000	1.41
+++ Makefile	4 Sep 2015 14:25:20 -0000
@@ -2,8 +2,10 @@

 DISTNAME=	OpenGrok-0.12.1.5
 PKGNAME=	${DISTNAME:tl:S/-rc/rc/}
+PKGREVISION=	1
 CATEGORIES=	devel
 MASTER_SITES=	${MASTER_SITE_GITHUB:=OpenGrok/}
+DISTFILES=	${DEFAULT_DISTFILES}

 MAINTAINER=	pkgsrc-users@NetBSD.org
 HOMEPAGE=	http://opengrok.github.io/OpenGrok/
@@ -13,9 +15,22 @@
 EXTRACT_USING=	bsdtar

 DEPENDS+=	exctags-[0-9]*:../../devel/exctags
-DEPENDS+=	jflex-[0-9]*:../../devel/jflex
 DEPENDS+=	apache-ant-[0-9]*:../../devel/apache-ant

+JFLEX_VER=	1.5.1
+DISTFILES+=	jflex-${JFLEX_VER}.jar
+SITES.jflex-${JFLEX_VER}.jar= http://repo1.maven.org/maven2/de/jflex/jflex/${JFLEX_VER}/
+
+LUCENE_VER=	4.7.1
+DISTFILES+=	lucene-core-${LUCENE_VER}.jar
+DISTFILES+=	lucene-analyzers-common-${LUCENE_VER}.jar
+DISTFILES+=	lucene-queryparser-${LUCENE_VER}.jar
+DISTFILES+=	lucene-suggest-${LUCENE_VER}.jar
+SITES.lucene-core-${LUCENE_VER}.jar= http://repo1.maven.org/maven2/org/apache/lucene/lucene-core/${LUCENE_VER}/
+SITES.lucene-analyzers-common-${LUCENE_VER}.jar= http://repo1.maven.org/maven2/org/apache/lucene/lucene-analyzers-common/${LUCENE_VER}/
+SITES.lucene-queryparser-${LUCENE_VER}.jar= http://repo1.maven.org/maven2/org/apache/lucene/lucene-queryparser/${LUCENE_VER}/
+SITES.lucene-suggest-${LUCENE_VER}.jar= http://repo1.maven.org/maven2/org/apache/lucene/lucene-suggest/${LUCENE_VER}/
+
 # XXX PREFIX should not be used here, but I would like to reduce dependencies.
 SUBST_CLASSES+=		vcs
 SUBST_FILES.vcs+=	OpenGrok
@@ -46,8 +61,11 @@
 			share/opengrok/var/opengrok

 do-build:
-	cd ${WRKSRC} && \
-		CLASSPATH=${PREFIX}/lib/java/JFlex.jar ${PREFIX}/bin/ant
+	cp ${WRKDIR}/jflex-${JFLEX_VER}.jar ${WRKSRC}/lib/
+	for i in core analyzers-common queryparser suggest; do \
+		cp ${WRKDIR}/lucene-$$i-${LUCENE_VER}.jar ${WRKSRC}/lib; \
+	done
+	cd ${WRKSRC} && ${PREFIX}/bin/ant

 do-install:
 	${INSTALL_SCRIPT} ${WRKSRC}/OpenGrok \
Index: distinfo
===================================================================
RCS file: /cvsroot/pkgsrc/devel/opengrok/distinfo,v
retrieving revision 1.13
diff -u -r1.13 distinfo
--- distinfo	4 Sep 2015 14:23:49 -0000	1.13
+++ distinfo	4 Sep 2015 14:25:20 -0000
@@ -3,5 +3,20 @@
 SHA1 (OpenGrok-0.12.1.5.tar.gz) = a31ca03bb340a084019825de61b9ec1878662c95
 RMD160 (OpenGrok-0.12.1.5.tar.gz) = 2c4dbebe88eab498d7d4a25807cc0bd45a4a5f40
 Size (OpenGrok-0.12.1.5.tar.gz) = 1560600 bytes
+SHA1 (jflex-1.5.1.jar) = 262c62559392e63dbab50ed023cc398035c8a9cf
+RMD160 (jflex-1.5.1.jar) = 17bab7447efadde3a1bcc7f561a4baa2885bda7f
+Size (jflex-1.5.1.jar) = 940749 bytes
+SHA1 (lucene-analyzers-common-4.7.1.jar) = 5980364242d4e34d7afd5a848af49d9ce42f522e
+RMD160 (lucene-analyzers-common-4.7.1.jar) = fc1315c268573fa39d69c52313505ddff9dad811
+Size (lucene-analyzers-common-4.7.1.jar) = 1658498 bytes
+SHA1 (lucene-core-4.7.1.jar) = 91ca386b26cd6e5942616c9787131df4ab434483
+RMD160 (lucene-core-4.7.1.jar) = 455b6e12284e40357a998e596aac7acecd566056
+Size (lucene-core-4.7.1.jar) = 2357831 bytes
+SHA1 (lucene-queryparser-4.7.1.jar) = 0781aa1701302fb56ac516df4c7958c257841296
+RMD160 (lucene-queryparser-4.7.1.jar) = 35e015ae016168d10c6f7d2e5315891fae89c0ff
+Size (lucene-queryparser-4.7.1.jar) = 390053 bytes
+SHA1 (lucene-suggest-4.7.1.jar) = 85a18158a5d120f3e6f38be205e9794e8153e600
+RMD160 (lucene-suggest-4.7.1.jar) = 128c2654627e93c1b000aaefc41f83a6f56f8ef3
+Size (lucene-suggest-4.7.1.jar) = 192323 bytes
 SHA1 (patch-OpenGrok) = 3626793fca6f62a4e9da2ff23ccc20e1ec82087b
 SHA1 (patch-web_WEB-INF_web.xml) = dad7fe0aac6ba6f8cd388b89959abc129d960ac3

+SHA1 (lucene-suggest-4.7.1.jar) = 85a18158a5d120f3e6f38be205e9794e8153e600
+RMD160 (lucene-suggest-4.7.1.jar) = 128c2654627e93c1b000aaefc41f83a6f56f8ef3
+Size (lucene-suggest-4.7.1.jar) = 192323 bytes
 SHA1 (patch-OpenGrok) = 3626793fca6f62a4e9da2ff23ccc20e1ec82087b
 SHA1 (patch-web_WEB-INF_web.xml) = dad7fe0aac6ba6f8cd388b89959abc129d960ac3

>Audit-Trail:
From: David Holland <dholland-pbugs@netbsd.org>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/50209: devel/opengrok: should not be download jar files
 during build
Date: Sun, 6 Sep 2015 01:15:59 +0000

 On Fri, Sep 04, 2015 at 05:15:00PM +0000, nonakap@gmail.com wrote:
  >  DEPENDS+=	exctags-[0-9]*:../../devel/exctags
  > -DEPENDS+=	jflex-[0-9]*:../../devel/jflex
  >  DEPENDS+=	apache-ant-[0-9]*:../../devel/apache-ant
  >  
  > +JFLEX_VER=	1.5.1
  > +DISTFILES+=	jflex-${JFLEX_VER}.jar
  > +SITES.jflex-${JFLEX_VER}.jar= http://repo1.maven.org/maven2/de/jflex/jflex/${JFLEX_VER}/

 It would be better to make it use the pkgsrc jflex, not download its
 own (and maybe different) binary blob.

 (Same for lucene, for that matter, although I'm not sure the java
 lucene is in pkgsrc)

 -- 
 David A. Holland
 dholland@netbsd.org

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.39 2013/11/01 18:47:49 spz Exp $
$NetBSD: gnats_config.sh,v 1.8 2006/05/07 09:23:38 tsutsui Exp $
Copyright © 1994-2014 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.