NetBSD Problem Report #49906

From bad@bsd.de  Thu May 14 17:32:33 2015
Return-Path: <bad@bsd.de>
Received: from mail.netbsd.org (mail.netbsd.org [149.20.53.66])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "mail.netbsd.org", Issuer "Postmaster NetBSD.org" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 75AC2A65F0
	for <gnats-bugs@gnats.NetBSD.org>; Thu, 14 May 2015 17:32:33 +0000 (UTC)
Message-Id: <20150514173218.8160838445@limiting-factor.k.bsd.de>
Date: Thu, 14 May 2015 19:32:18 +0200 (MEST)
From: bad@bsd.de
Reply-To: bad@bsd.de
To: gnats-bugs@gnats.NetBSD.org
Subject: MASTER_SITE urls with prefixed "-" fail to fetch
X-Send-Pr-Version: 3.95

>Number:         49906
>Category:       pkg
>Synopsis:       "MASTER_SITE= -https://example.com/zorch" fails to fetch
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    pkg-manager
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Thu May 14 17:35:00 +0000 2015
>Last-Modified:  Thu Jul 02 14:15:00 +0000 2015
>Originator:     Christoph Badura
>Release:        NetBSD 6.1_STABLE
>Organization:
bozotic software testing labs

>Environment:


System: NetBSD size-isnt-everything 6.1_STABLE NetBSD 6.1_STABLE (thinkpad-500) #6: Wed Feb 11 19:35:21 MET 2015 bad@size-isnt-everything:/u/0/trees/src/netbsd-6/sys/arch/amd64/compile/thinkpad-500 amd64
Architecture: x86_64
Machine: amd64
>Description:

E.g.:

cd /usr/pkgsrc/security/mozilla-rootcerts && /usr/bin/make fetch-list | sh
ftp: unknown option -- h
usage: ftp [-46AadefginpRtVv] [-N netrc] [-o outfile] [-P port] [-q quittime]
           [-r retry] [-s srcaddr] [-T dir,max[,inc]]
           [[user@]host [port]] [host:path[/]] [file:///file]
           [ftp://[user[:pass]@]host[:port]/path[/]]
           [http://[user[:pass]@]host[:port]/path] [...]
           [https://[user[:pass]@]host[:port]/path] [...]
       ftp -u URL file [...]
certdata-20141117.txt not fetched

cd /usr/pkgsrc/mail/postfix && /usr/bin/make fetch-list | sh
ftp: unknown option -- h
usage: ftp [-46AadefginpRtVv] [-N netrc] [-o outfile] [-P port] [-q quittime]
           [-r retry] [-s srcaddr] [-T dir,max[,inc]]
           [[user@]host [port]] [host:path[/]] [file:///file]
           [ftp://[user[:pass]@]host[:port]/path[/]]
           [http://[user[:pass]@]host[:port]/path] [...]
           [https://[user[:pass]@]host[:port]/path] [...]
       ftp -u URL file [...]
cyrus-sasl-dedad73e5e7a75d01a5f3d5a6702ab8ccd2ff40d.patch.v2 not fetched


>How-To-Repeat:

E.g.:

cd /usr/pkgsrc/security/mozilla-rootcerts && /usr/bin/make fetch-list | sh
cd /usr/pkgsrc/mail/postfix && /usr/bin/make fetch-list | sh

>Fix:
now idea.


>Audit-Trail:
From: Benny Siegert <bsiegert@gmail.com>
To: gnats-bugs@netbsd.org
Cc: pkg-manager@netbsd.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org
Subject: Re: pkg/49906: MASTER_SITE urls with prefixed "-" fail to fetch
Date: Sun, 28 Jun 2015 17:00:21 +0200

 From the NetBSD guide:

 The exception to this rule are URLs starting with a dash. In that case
 the URL is taken as is, fetched and the result stored under the name
 of the distfile.

 So the "make fetch-list" output would need to strip the dash and add a
 "-o filename" option to the ftp invocation. This involves editing
 mk/fetch/fetch-list.mk.

From: Joerg Sonnenberger <joerg@britannica.bec.de>
To: gnats-bugs@NetBSD.org
Cc: pkg-manager@netbsd.org, gnats-admin@netbsd.org, pkgsrc-bugs@netbsd.org
Subject: Re: pkg/49906: MASTER_SITE urls with prefixed "-" fail to fetch
Date: Sun, 28 Jun 2015 18:34:20 +0200

 On Thu, May 14, 2015 at 05:35:00PM +0000, bad@bsd.de wrote:
 > cd /usr/pkgsrc/security/mozilla-rootcerts && /usr/bin/make fetch-list | sh

 Any reason for not using depends-fetch or depends-checksum?
 I'd prefer to phase out fetch-list, there are lot of situation it
 doesn't handle properly.

 Joerg

From: Christoph Badura <bad@bsd.de>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/49906: MASTER_SITE urls with prefixed "-" fail to fetch
Date: Thu, 2 Jul 2015 13:28:42 +0200

 On Sun, Jun 28, 2015 at 04:35:03PM +0000, Joerg Sonnenberger wrote:
 >  On Thu, May 14, 2015 at 05:35:00PM +0000, bad@bsd.de wrote:
 >  > cd /usr/pkgsrc/security/mozilla-rootcerts && /usr/bin/make fetch-list | sh
 >  
 >  Any reason for not using depends-fetch or depends-checksum?

 Several good reasons:

 pkgsrc.txt documents fetch-list as the official solution.

 And the problem with depends-fetch is, e.g.:

 ===> Fetching for sysutils/checkperms
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/libtool-base
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for archivers/libarchive
 ===> Fetching for devel/gmake
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/libexecinfo
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/ncurses
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/pkg-config
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for lang/perl5
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for textproc/gsed
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/libidn
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for www/curl
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/cmake
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/m4
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/bison
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for shells/bash
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for databases/mysql56-client
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/libffi
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for devel/libltdl
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for graphics/freetype2
 => Bootstrap dependency digest>=20010302: found digest-20121220
 ===> Fetching for fonts/fontconfig
 => Bootstrap dependency digest>=20010302: found digest-20121220

 [103 more lines of similar nonsense elided].

 --chris


From: Joerg Sonnenberger <joerg@britannica.bec.de>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: pkg/49906: MASTER_SITE urls with prefixed "-" fail to fetch
Date: Thu, 2 Jul 2015 16:10:42 +0200

 On Thu, Jul 02, 2015 at 11:35:00AM +0000, Christoph Badura wrote:
 >  On Sun, Jun 28, 2015 at 04:35:03PM +0000, Joerg Sonnenberger wrote:
 >  >  On Thu, May 14, 2015 at 05:35:00PM +0000, bad@bsd.de wrote:
 >  >  > cd /usr/pkgsrc/security/mozilla-rootcerts && /usr/bin/make fetch-list | sh
 >  >  
 >  >  Any reason for not using depends-fetch or depends-checksum?
 >  
 >  Several good reasons:
 >  
 >  pkgsrc.txt documents fetch-list as the official solution.

 So it is outdated, not such a surprise.

 >  And the problem with depends-fetch is, e.g.:
 >  
 >  ===> Fetching for sysutils/checkperms
 >  => Bootstrap dependency digest>=20010302: found digest-20121220
 [snip]
 >  => Bootstrap dependency digest>=20010302: found digest-20121220
 >  
 >  [103 more lines of similar nonsense elided].

 and how it is a problem that it prints the tree enumeration? That same
 happens with fetch-list, it is just more aggressive in throwing stuff to
 /dev/null. I'd hardly call it a feature to have no progress report.

 Joerg

>Unformatted:

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.39 2013/11/01 18:47:49 spz Exp $
$NetBSD: gnats_config.sh,v 1.8 2006/05/07 09:23:38 tsutsui Exp $
Copyright © 1994-2014 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.