NetBSD Problem Report #47841

From tsutsui@ceres.dti.ne.jp  Mon May 20 11:12:24 2013
Return-Path: <tsutsui@ceres.dti.ne.jp>
Received: from mail.netbsd.org (mail.netbsd.org [149.20.53.66])
	by www.NetBSD.org (Postfix) with ESMTP id 02C5D63F058
	for <gnats-bugs@gnats.NetBSD.org>; Mon, 20 May 2013 11:12:23 +0000 (UTC)
Message-Id: <201305201112.r4KBCJgR010312@mirage.localdomain>
Date: Mon, 20 May 2013 20:12:19 +0900 (JST)
From: Izumi Tsutsui <tsutsui@ceres.dti.ne.jp>
Reply-To: tsutsui@ceres.dti.ne.jp
To: gnats-bugs@gnats.NetBSD.org
Cc: tsutsui@ceres.dti.ne.jp
Subject: pkg_add(1) http://ftp.jp.netbsd.org/ fails with weird error
X-Send-Pr-Version: 3.95

>Number:         47841
>Notify-List:    gson@gson.org
>Category:       bin
>Synopsis:       pkg_add(1) http://ftp.jp.netbsd.org/ fails with weird error
>Confidential:   no
>Severity:       non-critical
>Priority:       medium
>Responsible:    bin-bug-people
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Mon May 20 11:15:01 +0000 2013
>Last-Modified:  Sat Jan 17 14:24:24 +0000 2015
>Originator:     Izumi Tsutsui
>Release:        NetBSD 6.1
>Organization:
>Environment:
System: NetBSD/i386 6.1
Architecture: i386 and m68k
Machine: i386 and x68k, maybe MI issue
>Description:
pkg_add(1) using binary packages mirrored in http://ftp.jp.netbsd.org/
fails with "Host not found" error unless whole *.tgz filename is specified,
while pkg_add via ftp:// against the same path works. 

Probably there is some http server dependent problem, but
the error message "Host not found" by pkg_add(1) is not correct
and it confuses users.

>How-To-Repeat:

# uname -mrs
NetBSD 6.1 i386
# pkg_add http://ftp.jp.netbsd.org/pub/pkgsrc/packages/NetBSD/i386/6.0/All/digest
pkg_add: Can't process http://ftp.jp.netbsd.org:80/pub/pkgsrc/packages/NetBSD/i386/6.0/All/digest*: Host not found
pkg_add: no pkg found for 'http://ftp.jp.netbsd.org/pub/pkgsrc/packages/NetBSD/i386/6.0/All/digest', sorry.
pkg_add: 1 package addition failed
# pkg_add ftp://ftp.jp.netbsd.org/pub/pkgsrc/packages/NetBSD/i386/6.0/All/digest
pkg_add: Warning: package `digest-20121220' was built for a platform:
pkg_add: NetBSD/i386 6.0 (pkg) vs. NetBSD/i386 6.1 (this host)
# pkg_delete digest
# pkg_add http://ftp.jp.netbsd.org/pub/pkgsrc/packages/NetBSD/i386/6.0/All/digest-20121220.tgz
pkg_add: Warning: package `digest-20121220' was built for a platform:
pkg_add: NetBSD/i386 6.0 (pkg) vs. NetBSD/i386 6.1 (this host)
# 

>Fix:
No idea.

>Release-Note:

>Audit-Trail:
From: Andreas Gustafsson <gson@gson.org>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: bin/47841 (http://ftp.jp.netbsd.org/ fails with weird error)
Date: Sat, 3 Jan 2015 12:45:39 +0200

 The same thing happens with ftp.netbsd.org, so this is not specific
 to the .jp mirror.

   # export 'PKG_PATH=http://ftp.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/6.0/All'
   # pkg_add xenkernel42
   pkg_add: Can't process http://ftp.netbsd.org:80/pub/pkgsrc/packages/NetBSD/amd64/6.0/All/xenkernel42*: Host not found

 -- 
 Andreas Gustafsson, gson@gson.org

From: Justin Cormack <justin@specialbusservice.com>
To: gnats-bugs@netbsd.org
Cc: gnats-admin@netbsd.org, netbsd-bugs@netbsd.org, tsutsui@ceres.dti.ne.jp
Subject: Re: bin/47841 (http://ftp.jp.netbsd.org/ fails with weird error)
Date: Mon, 12 Jan 2015 01:25:19 +0000

 On Sat, Jan 3, 2015 at 10:50 AM, Andreas Gustafsson <gson@gson.org> wrote:
 > The following reply was made to PR bin/47841; it has been noted by GNATS.
 >
 > From: Andreas Gustafsson <gson@gson.org>
 > To: gnats-bugs@NetBSD.org
 > Cc:
 > Subject: Re: bin/47841 (http://ftp.jp.netbsd.org/ fails with weird error)
 > Date: Sat, 3 Jan 2015 12:45:39 +0200
 >
 >  The same thing happens with ftp.netbsd.org, so this is not specific
 >  to the .jp mirror.
 >
 >    # export 'PKG_PATH=http://ftp.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/6.0/All'
 >    # pkg_add xenkernel42
 >    pkg_add: Can't process http://ftp.netbsd.org:80/pub/pkgsrc/packages/NetBSD/amd64/6.0/All/xenkernel42*: Host not found

 This has recently (well, last few months max) started happening in the
 installer when trying to setup binary packages.

 I get with nightly netbsd 7 201501110540Z amd64 from nyftp:

      Status: Command failed
     Command: pkg_add http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd64/7.0_
 BETA/All/pkgin
      Hit enter to continue
 --------------------------------------------------------------------------------
 pkg_add: Can't process http://ftp.NetBSD.org:80/pub/pkgsrc/packages/NetBSD/amd64
 /7.0_BETA/All/pkgin*: Host not found
 pkg_add: no pkg found for 'http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd6
 4/7.0_BETA/All/pkgin', sorry.
 pkg_add: 1 package addition failed

 Networking is fine (ipv4 and ipv6), can install everything else from
 that host fine, eg source packages and sets. So somehow globbing on
 ftp seems broken, possibly only with some web servers.

 However it is ok using ftp.allbsd.org, so it is maybe http server
 specific - maybe a bozohttpd issue?

 Justin

From: matthew green <mrg@eterna.com.au>
To: Justin Cormack <justin@specialbusservice.com>
Cc: gnats-admin@netbsd.org, netbsd-bugs@netbsd.org,
    tsutsui@ceres.dti.ne.jp, gnats-bugs@netbsd.org
Subject: re: bin/47841 (http://ftp.jp.netbsd.org/ fails with weird error)
Date: Mon, 12 Jan 2015 13:14:35 +1100

 > --------------------------------------------------------------------------------
 > pkg_add: Can't process http://ftp.NetBSD.org:80/pub/pkgsrc/packages/NetBSD/amd64
 > /7.0_BETA/All/pkgin*: Host not found
 > pkg_add: no pkg found for 'http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd6
 > 4/7.0_BETA/All/pkgin', sorry.
 > pkg_add: 1 package addition failed
 > 
 > Networking is fine (ipv4 and ipv6), can install everything else from
 > that host fine, eg source packages and sets. So somehow globbing on
 > ftp seems broken, possibly only with some web servers.
 > 
 > However it is ok using ftp.allbsd.org, so it is maybe http server
 > specific - maybe a bozohttpd issue?

 hmm.

 bozohttpd does not do any sort of globbing.  it returns you
 directory listing, or a file...  globbing how pkg* uses seems
 to only be possible with an ftp server that enables globbing.


 .mrg.

From: Justin Cormack <justin@specialbusservice.com>
To: matthew green <mrg@eterna.com.au>
Cc: gnats-bugs@netbsd.org, netbsd-bugs@netbsd.org, gnats-admin@netbsd.org, 
	tsutsui@ceres.dti.ne.jp
Subject: re: bin/47841 (http://ftp.jp.netbsd.org/ fails with weird error)
Date: Mon, 12 Jan 2015 11:06:53 +0000

 --001a1134da4a017ba3050c72814a
 Content-Type: text/plain; charset=UTF-8

 On Jan 12, 2015 2:14 AM, "matthew green" <mrg@eterna.com.au> wrote:
 >
 >
 > >
 --------------------------------------------------------------------------------
 > > pkg_add: Can't process
 http://ftp.NetBSD.org:80/pub/pkgsrc/packages/NetBSD/amd64
 > > /7.0_BETA/All/pkgin*: Host not found
 > > pkg_add: no pkg found for '
 http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd6
 > > 4/7.0_BETA/All/pkgin', sorry.
 > > pkg_add: 1 package addition failed
 > >
 > > Networking is fine (ipv4 and ipv6), can install everything else from
 > > that host fine, eg source packages and sets. So somehow globbing on
 > > ftp seems broken, possibly only with some web servers.
 > >
 > > However it is ok using ftp.allbsd.org, so it is maybe http server
 > > specific - maybe a bozohttpd issue?
 >
 > hmm.
 >
 > bozohttpd does not do any sort of globbing.  it returns you
 > directory listing, or a file...  globbing how pkg* uses seems
 > to only be possible with an ftp server that enables globbing.
 >

 Indeed, no http server does. I haven't had a chance to look through the
 code yet but I think it is misparsing the directory listing, based on the
 bogus DNS lookup it is doing. It seems somewhat fragile.

 Justin

 --001a1134da4a017ba3050c72814a
 Content-Type: text/html; charset=UTF-8
 Content-Transfer-Encoding: quoted-printable

 <p dir=3D"ltr"><br>
 On Jan 12, 2015 2:14 AM, &quot;matthew green&quot; &lt;<a href=3D"mailto:mr=
 g@eterna.com.au">mrg@eterna.com.au</a>&gt; wrote:<br>
 &gt;<br>
 &gt;<br>
 &gt; &gt; -----------------------------------------------------------------=
 ---------------<br>
 &gt; &gt; pkg_add: Can&#39;t process <a href=3D"http://ftp.NetBSD.org:80/pu=
 b/pkgsrc/packages/NetBSD/amd64">http://ftp.NetBSD.org:80/pub/pkgsrc/package=
 s/NetBSD/amd64</a><br>
 &gt; &gt; /7.0_BETA/All/pkgin*: Host not found<br>
 &gt; &gt; pkg_add: no pkg found for &#39;<a href=3D"http://ftp.NetBSD.org/p=
 ub/pkgsrc/packages/NetBSD/amd6">http://ftp.NetBSD.org/pub/pkgsrc/packages/N=
 etBSD/amd6</a><br>
 &gt; &gt; 4/7.0_BETA/All/pkgin&#39;, sorry.<br>
 &gt; &gt; pkg_add: 1 package addition failed<br>
 &gt; &gt;<br>
 &gt; &gt; Networking is fine (ipv4 and ipv6), can install everything else f=
 rom<br>
 &gt; &gt; that host fine, eg source packages and sets. So somehow globbing =
 on<br>
 &gt; &gt; ftp seems broken, possibly only with some web servers.<br>
 &gt; &gt;<br>
 &gt; &gt; However it is ok using <a href=3D"http://ftp.allbsd.org">ftp.allb=
 sd.org</a>, so it is maybe http server<br>
 &gt; &gt; specific - maybe a bozohttpd issue?<br>
 &gt;<br>
 &gt; hmm.<br>
 &gt;<br>
 &gt; bozohttpd does not do any sort of globbing.=C2=A0 it returns you<br>
 &gt; directory listing, or a file...=C2=A0 globbing how pkg* uses seems<br>
 &gt; to only be possible with an ftp server that enables globbing.<br>
 &gt;</p>
 <p dir=3D"ltr">Indeed, no http server does. I haven&#39;t had a chance to l=
 ook through the code yet but I think it is misparsing the directory listing=
 , based on the bogus DNS lookup it is doing. It seems somewhat fragile.</p>
 <p dir=3D"ltr">Justin</p>

 --001a1134da4a017ba3050c72814a--

>Unformatted:

Home	PR Database Search