NetBSD Problem Report #10006

Received: (qmail 17778 invoked from network); 28 Apr 2000 21:20:10 -0000
Message-Id: <20000428211928.CD952D204@dr-evil.shagadelic.org>
Date: Fri, 28 Apr 2000 14:19:28 -0700 (PDT)
From: thorpej@zembu.com
Reply-To: thorpej@netbsd.org
To: gnats-bugs@gnats.netbsd.org
Subject: No support for HTTP in pkg_add(1)
X-Send-Pr-Version: 3.95

>Number:         10006
>Category:       pkg
>Synopsis:       No support for HTTP in pkg_add(1)
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    wiz
>State:          closed
>Class:          change-request
>Submitter-Id:   net
>Arrival-Date:   Fri Apr 28 21:21:00 +0000 2000
>Closed-Date:    Fri Oct 03 15:44:08 +0000 2003
>Last-Modified:  Fri Oct 03 15:44:08 +0000 2003
>Originator:     Jason R. Thorpe
>Release:        April 24, 2000
>Organization:
Zembu Labs, Inc.
>Environment:

>Description:
	pkg_add(1) does not support fetching packages via HTTP.  Using
	HTTP is especially handy in many automated environments where
	WWW servers are already running, but where there is not a desire
	to set up anonymous FTP.

>How-To-Repeat:
	Attempt to provide an HTTP URL to pkg_add(1).  Watch it fail.
	Subsequently inspect code.

>Fix:
	Not provided.
>Release-Note:
>Audit-Trail:

From: Hubert Feyrer <feh39068@rrzc3.rz.uni-regensburg.de>
To: thorpej@zembu.com
Cc: gnats-bugs@gnats.netbsd.org
Subject: Re: pkg/10006: No support for HTTP in pkg_add(1)
Date: Sat, 29 Apr 2000 17:17:17 +0200 (MET DST)

 On Fri, 28 Apr 2000 thorpej@zembu.com wrote:
 > >Description:
 > 	pkg_add(1) does not support fetching packages via HTTP.  Using
 > 	HTTP is especially handy in many automated environments where
 > 	WWW servers are already running, but where there is not a desire
 > 	to set up anonymous FTP.

 Fetching single pkgs via FTP should work, probably even non-wildcard
 dependencies. Using wildcard depends will fail, though, as parsing of HTML
 is necessary to resolve the wildcard. I don't have any plans to do that.

 Workaround: use non-anonymous FTP.


  - Hubert

 -- 
 Hubert Feyrer <hubert.feyrer@rz.uni-regensburg.de>


From: Jason R Thorpe <thorpej@zembu.com>
To: Hubert Feyrer <hubert.feyrer@rz.uni-regensburg.de>
Cc: gnats-bugs@gnats.netbsd.org
Subject: Re: pkg/10006: No support for HTTP in pkg_add(1)
Date: Sat, 29 Apr 2000 10:02:45 -0700

 On Sat, Apr 29, 2000 at 05:17:17PM +0200, Hubert Feyrer wrote:

  > Fetching single pkgs via FTP should work, probably even non-wildcard
  > dependencies. Using wildcard depends will fail, though, as parsing of HTML
  > is necessary to resolve the wildcard. I don't have any plans to do that.
  > 
  > Workaround: use non-anonymous FTP.

 Non-answer.  I specifically stated in my PR that it's being used in an
 environment where use of anonymous FTP is not desirable.

 Fetching the single-package using the ftpio support in pkg_add(1) does not
 in fact work; it appears to chop off the end of the URL, to do an FTP
 change-directory, which obviously fails for HTTP.

 -- 
         -- Jason R. Thorpe <thorpej@zembu.com>

From: Hubert Feyrer <feyrer@rfhs8012.fh-regensburg.de>
To: Jason R Thorpe <thorpej@zembu.com>
Cc: gnats-bugs@gnats.netbsd.org
Subject: Re: pkg/10006: No support for HTTP in pkg_add(1)
Date: Sat, 29 Apr 2000 23:39:19 +0200 (MET DST)

 On Sat, 29 Apr 2000, Jason R Thorpe wrote:
 >  > Fetching single pkgs via FTP should work, probably even non-wildcard
 >  > dependencies. Using wildcard depends will fail, though, as parsing of HTML
 >  > is necessary to resolve the wildcard. I don't have any plans to do that.
 >  > 
 >  > Workaround: use non-anonymous FTP.
 > 
 > Non-answer.  I specifically stated in my PR that it's being used in an
 > environment where use of anonymous FTP is not desirable.

 How is using "NON-anonymous FTP" a non-answer there? 
 Is non-anonymous FTP not working? I admit I haven't tried adding a pkg
 that way recently, but I've enough trust in things...
 Of can't you use FTP at all? In that case, we have a problem.


 > Fetching the single-package using the ftpio support in pkg_add(1) does not
 > in fact work; it appears to chop off the end of the URL, to do an FTP
 > change-directory, which obviously fails for HTTP.

 IC... Hm. The right thing to fix this would be to implement VFS-like
 operations for local (file://) pkgs, ftp:// and http:// operations, and
 then define certain operations there. That would fix at last far enough
 that you can pkg_add a few pkgs. For everything to work via http, more
 work is needed, see above.

 I do not currently have time to work on this, though. Sorry.


  - Hubert

 -- 
 Microsoft: "Where do you want to go today?"
 Linux:     "Where do you want to be tomorrow?"
 BSD:       "Are you guys coming, or what?"


From: Jason R Thorpe <thorpej@zembu.com>
To: hubert.feyrer@informatik.fh-regensburg.de
Cc: gnats-bugs@gnats.netbsd.org
Subject: Re: pkg/10006: No support for HTTP in pkg_add(1)
Date: Sat, 29 Apr 2000 14:52:42 -0700

 On Sat, Apr 29, 2000 at 11:39:19PM +0200, Hubert Feyrer wrote:

  > > Non-answer.  I specifically stated in my PR that it's being used in an
  > > environment where use of anonymous FTP is not desirable.
  > 
  > How is using "NON-anonymous FTP" a non-answer there? 
  > Is non-anonymous FTP not working? I admit I haven't tried adding a pkg
  > that way recently, but I've enough trust in things...
  > Of can't you use FTP at all? In that case, we have a problem.

 Sorry, yes, FTP is not available *at all*.

 -- 
         -- Jason R. Thorpe <thorpej@zembu.com>

From: Hubert Feyrer <feyrer@rfhs8012.fh-regensburg.de>
To: Jason R Thorpe <thorpej@zembu.com>
Cc: gnats-bugs@gnats.netbsd.org
Subject: Re: pkg/10006: No support for HTTP in pkg_add(1)
Date: Sat, 29 Apr 2000 23:59:20 +0200 (MET DST)

 On Sat, 29 Apr 2000, Jason R Thorpe wrote:
 >  > How is using "NON-anonymous FTP" a non-answer there? 
 >  > Is non-anonymous FTP not working? I admit I haven't tried adding a pkg
 >  > that way recently, but I've enough trust in things...
 >  > Of can't you use FTP at all? In that case, we have a problem.
 > 
 > Sorry, yes, FTP is not available *at all*.

 Hum, difficult. Fetching pkgs via HTTP and then running pkg_add locally
 won't work easily either, due to the wildcard-expansion problem.

 How's HTTP better for your environment over FTP, or are you using SHTTP?


  - Hubert

 -- 
 Microsoft: "Where do you want to go today?"
 Linux:     "Where do you want to be tomorrow?"
 BSD:       "Are you guys coming, or what?"


From: Jonathan Perkin <sketch@rd.bbc.co.uk>
To: gnats-bugs@gnats.netbsd.org
Cc:  
Subject: Re: pkg/10006: No support for HTTP in pkg_add(1)
Date: Tue, 18 Feb 2003 01:33:06 +0000

 Related, but not solving the problem if you need wildcards, would be to
 teach pkg_add to check for getenv("FETCH_CMD") and use that if available.

 This would match bsd.pkg.mk behaviour, so you can use your favourite
 software downloader for any exotic file transfer protocol you may need.

 -- 
 Jonathan Perkin - Internet Operations Engineer - BBC Internet Services
 24x7 Hotline: +44 (0)1628 407 777 (x37777) - http://support.bbc.co.uk/
Responsible-Changed-From-To: pkg-manager->wiz 
Responsible-Changed-By: wiz 
Responsible-Changed-When: Sun Sep 28 09:22:54 UTC 2003 
Responsible-Changed-Why:  
I'll handle this one. 

From: Thomas Klausner <wiz@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc:  
Subject: pr/10006 CVS commit: src/usr.sbin/pkg_install
Date: Fri,  3 Oct 2003 15:40:27 +0000 (UTC)

 Module Name:	src
 Committed By:	wiz
 Date:		Fri Oct  3 15:40:27 UTC 2003

 Modified Files:
 	src/usr.sbin/pkg_install/add: pkg_add.1
 	src/usr.sbin/pkg_install/lib: ftpio.c lib.h

 Log Message:
 Add HTTP support.
 Thanks to dillo@ for extensive review and jmmv@ for testing.
 Remaining bugs are, of course, mine.

 Closes PR 10006.


 To generate a diff of this commit:
 cvs rdiff -r1.45 -r1.46 src/usr.sbin/pkg_install/add/pkg_add.1
 cvs rdiff -r1.57 -r1.58 src/usr.sbin/pkg_install/lib/ftpio.c
 cvs rdiff -r1.61 -r1.62 src/usr.sbin/pkg_install/lib/lib.h

 Please note that diffs are not public domain; they are subject to the
 copyright notices on the relevant files.

State-Changed-From-To: open->closed 
State-Changed-By: wiz 
State-Changed-When: Fri Oct 3 15:43:58 UTC 2003 
State-Changed-Why:  
Fixed, thanks for the PR. 
>Unformatted:

Home	PR Database Search