NetBSD Problem Report #39093

From www@NetBSD.org  Thu Jul  3 16:37:28 2008
Return-Path: <www@NetBSD.org>
Received: from mail.netbsd.org (mail.netbsd.org [204.152.190.11])
	by narn.NetBSD.org (Postfix) with ESMTP id C5E0C63BC7C
	for <gnats-bugs@gnats.netbsd.org>; Thu,  3 Jul 2008 16:37:27 +0000 (UTC)
Message-Id: <20080703163727.659F463B880@narn.NetBSD.org>
Date: Thu,  3 Jul 2008 16:37:27 +0000 (UTC)
From: ks@ub.uni-mainz.de
Reply-To: ks@ub.uni-mainz.de
To: gnats-bugs@NetBSD.org
Subject: usb doesn't work anymore on IBM T43p
X-Send-Pr-Version: www-1.0

>Number:         39093
>Category:       kern
>Synopsis:       usb doesn't work anymore on IBM T43p
>Confidential:   no
>Severity:       critical
>Priority:       high
>Responsible:    kern-bug-people
>State:          closed
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Thu Jul 03 16:40:01 +0000 2008
>Closed-Date:    Fri Aug 23 07:22:41 +0000 2019
>Last-Modified:  Fri Aug 23 07:22:41 +0000 2019
>Originator:     Kurt Schreiner
>Release:        i386  -current as of Jul  3 17:32 MEST
>Organization:
>Environment:
NetBSD ipaddi 4.99.69 NetBSD 4.99.69 (PADDI) #337: Thu Jul  3 17:48:37 MEST 2008  ks@ipaddi:/u/NetBSD/arch/i386/obj/sys/arch/i386/compile/PADDI i386
>Description:
Since some days (June 27 to be precise) I see the following in /var/log/messages:
Jul  3 18:12:00 ipaddi /netbsd: uhci3: host controller process error
Jul  3 18:12:00 ipaddi /netbsd: uhci3: host controller halted
Jul  3 18:12:00 ipaddi /netbsd: uhci1: host controller process error
Jul  3 18:12:00 ipaddi /netbsd: uhci1: host controller halted
Jul  3 18:12:00 ipaddi /netbsd: uhci2: host controller process error
Jul  3 18:12:00 ipaddi /netbsd: uhci2: host controller halted
Jul  3 18:12:02 ipaddi /netbsd: uhci0: host controller process error
Jul  3 18:12:02 ipaddi /netbsd: uhci0: host controller halted

The system feels verry sluggish to use (in- and output stalls for seconds to minutes) hanging hard (power button needed to reset) after some time. Additionally system gets very hot being eventually powered down by BIOS (if power button isn't used before).

Note: Only the kernel is changed. There are no modifications done to the hardware or BIOS settings!

Playing w/ BIOS settings has no effect, btw.


>How-To-Repeat:
Take an IBM T43p, use a -current kernel w/ uhci and have "fun"...
>Fix:
There's no real fix that I know of, but there are at least 2 workarounds:

 a) use an older kernel! Last good one I have is from Jun 14.

 b) comment out uhci from your config file and compile a kernel w/o
    uhci! (Thats what I'm running now.)

>Release-Note:

>Audit-Trail:
From: Manuel Bouyer <bouyer@antioche.eu.org>
To: gnats-bugs@NetBSD.org
Cc: kern-bug-people@NetBSD.org, gnats-admin@NetBSD.org, netbsd-bugs@NetBSD.org
Subject: Re: kern/39093: usb doesn't work anymore on IBM T43p
Date: Fri, 4 Jul 2008 20:23:39 +0200

 On Thu, Jul 03, 2008 at 04:40:01PM +0000, ks@ub.uni-mainz.de wrote:
 > >Number:         39093
 > >Category:       kern
 > >Synopsis:       usb doesn't work anymore on IBM T43p
 > >Confidential:   no
 > >Severity:       critical
 > >Priority:       high
 > >Responsible:    kern-bug-people
 > >State:          open
 > >Class:          sw-bug
 > >Submitter-Id:   net
 > >Arrival-Date:   Thu Jul 03 16:40:01 +0000 2008
 > >Originator:     Kurt Schreiner
 > >Release:        i386  -current as of Jul  3 17:32 MEST
 > >Organization:
 > >Environment:
 > NetBSD ipaddi 4.99.69 NetBSD 4.99.69 (PADDI) #337: Thu Jul  3 17:48:37 MEST 2008  ks@ipaddi:/u/NetBSD/arch/i386/obj/sys/arch/i386/compile/PADDI i386
 > >Description:
 > Since some days (June 27 to be precise) I see the following in /var/log/messages:

 Do you mean is started failing on Jun 27, or that it worked on Jun 27 and
 started failing later ? I commited some changes to the USB drivers on Jun 28.

 > Jul  3 18:12:00 ipaddi /netbsd: uhci3: host controller process error
 > Jul  3 18:12:00 ipaddi /netbsd: uhci3: host controller halted
 > Jul  3 18:12:00 ipaddi /netbsd: uhci1: host controller process error
 > Jul  3 18:12:00 ipaddi /netbsd: uhci1: host controller halted
 > Jul  3 18:12:00 ipaddi /netbsd: uhci2: host controller process error
 > Jul  3 18:12:00 ipaddi /netbsd: uhci2: host controller halted
 > Jul  3 18:12:02 ipaddi /netbsd: uhci0: host controller process error
 > Jul  3 18:12:02 ipaddi /netbsd: uhci0: host controller halted
 > 
 > The system feels verry sluggish to use (in- and output stalls for seconds to minutes) hanging hard (power button needed to reset) after some time. Additionally system gets very hot being eventually powered down by BIOS (if power button isn't used before).

 Please run
 systat vm
 and watch for unusually high interrupt rate
 Also, is there something else printed about USB before the
 "host controller process error" ?

 -- 
 Manuel Bouyer <bouyer@antioche.eu.org>
      NetBSD: 26 ans d'experience feront toujours la difference
 --

From: Kurt Schreiner <ks@ub.uni-mainz.de>
To: Manuel Bouyer <bouyer@antioche.eu.org>
Cc: "gnats-bugs@NetBSD.org" <gnats-bugs@NetBSD.org>,
   "kern-bug-people@NetBSD.org" <kern-bug-people@NetBSD.org>,
   "gnats-admin@NetBSD.org" <gnats-admin@NetBSD.org>,
   "netbsd-bugs@NetBSD.org" <netbsd-bugs@NetBSD.org>
Subject: Re: kern/39093: usb doesn't work anymore on IBM T43p
Date: Fri, 4 Jul 2008 21:42:54 +0200

 --9amGYk9869ThD9tj
 Content-Type: text/plain; charset=us-ascii
 Content-Disposition: inline

 On Fri, Jul 04, 2008 at 08:23:39PM +0200, Manuel Bouyer wrote:
 > On Thu, Jul 03, 2008 at 04:40:01PM +0000, ks@ub.uni-mainz.de wrote:
 > > >Number:         39093
 > > >Category:       kern
 > > >Synopsis:       usb doesn't work anymore on IBM T43p
 > > >Confidential:   no
 > > >Severity:       critical
 > > >Priority:       high
 > > >Responsible:    kern-bug-people
 > > >State:          open
 > > >Class:          sw-bug
 > > >Submitter-Id:   net
 > > >Arrival-Date:   Thu Jul 03 16:40:01 +0000 2008
 > > >Originator:     Kurt Schreiner
 > > >Release:        i386  -current as of Jul  3 17:32 MEST
 > > >Organization:
 > > >Environment:
 > > NetBSD ipaddi 4.99.69 NetBSD 4.99.69 (PADDI) #337: Thu Jul  3 17:48:37 MEST 2008  ks@ipaddi:/u/NetBSD/arch/i386/obj/sys/arch/i386/compile/PADDI i386
 > > >Description:
 > > Since some days (June 27 to be precise) I see the following in /var/log/messages:
 > 
 > Do you mean is started failing on Jun 27, or that it worked on Jun 27 and
 > started failing later ? I commited some changes to the USB drivers on Jun 28.
 First failure is from Jun 27. Here's the relevant excerpt from /var/log/messages

 /var/log/messages.1.gz:Jun 27 19:30:29 ipaddi /netbsd: Accounting started
 /var/log/messages.1.gz:Jun 27 19:48:42 ipaddi /netbsd: bge0: block failed to stop: reg 0x1400, bit 0
 x00000002
 /var/log/messages.1.gz:Jun 27 19:48:42 ipaddi /netbsd: ath0: setting keyix 0 w/o power
 /var/log/messages.1.gz:Jun 27 20:11:18 ipaddi /netbsd: uhci2: host controller process error
 /var/log/messages.1.gz:Jun 27 20:11:18 ipaddi /netbsd: uhci2: host controller halted
 /var/log/messages.1.gz:Jun 27 20:11:50 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.1.gz:Jun 27 20:11:50 ipaddi /netbsd: uhci3: host controller halted
 /var/log/messages.1.gz:Jun 27 20:11:50 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.1.gz:Jun 27 20:11:50 ipaddi /netbsd: uhci0: host controller halted
 /var/log/messages.1.gz:Jun 27 20:11:50 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.1.gz:Jun 27 20:11:50 ipaddi /netbsd: uhci1: host controller halted

 Hm, there are 41 minutes from finishing boot 'till the errors first appeared.
 Following boots show the error message w/o "pause"... (see attached parts of
 /var/log/messages)

 > > The system feels verry sluggish to use (in- and output stalls for
 > > seconds to minutes) hanging hard (power button needed to reset) after
 > > some time. Additionally system gets very hot being eventually powered
 > > down by BIOS (if power button isn't used before).
 > 
 > Please run
 > systat vm
 > and watch for unusually high interrupt rate
 Hm, I had "sysstat vm 1" running and couldn't see anything suspicious.
 I'll try vmstat - hopefully the notebook will be running long enough...

 > Also, is there something else printed about USB before the
 > "host controller process error" ?
 No, nada (besides the normal boot messages).

 Thanks for looking into this
 Kurt

 --9amGYk9869ThD9tj
 Content-Type: text/plain; charset=unknown-8bit
 Content-Disposition: attachment; filename=xxx
 Content-Transfer-Encoding: 8bit

 Jun 27 19:30:28 ipaddi /netbsd: Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
 Jun 27 19:30:28 ipaddi /netbsd: 2006, 2007, 2008
 Jun 27 19:30:28 ipaddi /netbsd: The NetBSD Foundation, Inc.  All rights reserved.
 Jun 27 19:30:28 ipaddi /netbsd: Copyright (c) 1982, 1986, 1989, 1991, 1993
 Jun 27 19:30:28 ipaddi /netbsd: The Regents of the University of California.  All rights reserved.
 Jun 27 19:30:28 ipaddi /netbsd: 
 Jun 27 19:30:28 ipaddi /netbsd: NetBSD 4.99.67 (PADDI) #327: Thu Jun 26 19:54:06 MEST 2008
 Jun 27 19:30:28 ipaddi /netbsd: ks@ipaddi:/u/NetBSD/arch/i386/obj/sys/arch/i386/compile/PADDI
 Jun 27 19:30:28 ipaddi /netbsd: multiboot: Information structure flags: 0x000007e7
 Jun 27 19:30:28 ipaddi /netbsd: multiboot: Boot loader: GNU GRUB 0.97
 Jun 27 19:30:28 ipaddi /netbsd: multiboot: Command line: /netbsd root=wd0a
 Jun 27 19:30:28 ipaddi /netbsd: multiboot: 636 KB lower memory, 2094976 KB upper memory
 Jun 27 19:30:28 ipaddi /netbsd: multiboot: Symbol table at 0xc05489d4, length 279936 bytes
 Jun 27 19:30:28 ipaddi /netbsd: multiboot: String table at 0xc058cf54, length 280214 bytes
 Jun 27 19:30:28 ipaddi /netbsd: total memory = 2046 MB
 Jun 27 19:30:28 ipaddi /netbsd: avail memory = 2003 MB
 Jun 27 19:30:28 ipaddi /netbsd: timecounter: Timecounters tick every 10.000 msec
 Jun 27 19:30:28 ipaddi /netbsd: timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100
 Jun 27 19:30:28 ipaddi /netbsd: IBM 2668H8G (ThinkPad T43p)
 Jun 27 19:30:28 ipaddi /netbsd: mainbus0 (root)
 Jun 27 19:30:28 ipaddi /netbsd: cpu0 at mainbus0 apid 0: Intel 686-class, 2128MHz, id 0x6d8
 Jun 27 19:30:28 ipaddi /netbsd: cpu0: Enhanced SpeedStep (1356 mV) 2133 MHz
 Jun 27 19:30:28 ipaddi /netbsd: cpu0: Enhanced SpeedStep frequencies available (MHz): 2133 1867 1600 1333 1067 800
 Jun 27 19:30:28 ipaddi /netbsd: cpu0: Intel(R) On Demand Clock Modulation (state disabled)
 Jun 27 19:30:28 ipaddi /netbsd: ioapic0 at mainbus0 apid 1: pa 0xfec00000, version 20, 24 pins
 Jun 27 19:30:28 ipaddi /netbsd: acpi0 at mainbus0: Intel ACPICA 20080321
 Jun 27 19:30:28 ipaddi /netbsd: acpi0: X/RSDT: OemId <IBM   ,TP-1Y   ,00001290>, AslId < LTP,00000000>
 Jun 27 19:30:28 ipaddi /netbsd: acpiecdt0 at acpi0: ACPI Embedded Controller via ECDT
 Jun 27 19:30:28 ipaddi /netbsd: acpi0: SCI interrupting at int 9
 Jun 27 19:30:28 ipaddi /netbsd: acpi0: fixed-feature power button present
 Jun 27 19:30:28 ipaddi /netbsd: timecounter: Timecounter "ACPI-Fast" frequency 3579545 Hz quality 1000
 Jun 27 19:30:28 ipaddi /netbsd: ACPI-Fast 24-bit timer
 Jun 27 19:30:28 ipaddi /netbsd: acpilid0 at acpi0 (LID, PNP0C0D): ACPI Lid Switch
 Jun 27 19:30:28 ipaddi /netbsd: acpibut0 at acpi0 (SLPB, PNP0C0E): ACPI Sleep Button
 Jun 27 19:30:28 ipaddi /netbsd: attimer0 at acpi0 (TIMR, PNP0100): AT Timer
 Jun 27 19:30:28 ipaddi /netbsd: attimer0: io 0x40-0x43 irq 0
 Jun 27 19:30:28 ipaddi /netbsd: SPKR (PNP0800) [AT-style speaker sound] at acpi0 not configured
 Jun 27 19:30:28 ipaddi /netbsd: npx0 at acpi0 (FPU, PNP0C04)
 Jun 27 19:30:28 ipaddi /netbsd: npx0: io 0xf0 irq 13
 Jun 27 19:30:28 ipaddi /netbsd: npx0: reported by CPUID; using exception 16
 Jun 27 19:30:28 ipaddi /netbsd: pckbc0 at acpi0 (KBD, PNP0303): kbd port
 Jun 27 19:30:28 ipaddi /netbsd: pckbc0: io 0x60,0x64 irq 1
 Jun 27 19:30:28 ipaddi /netbsd: pckbc1 at acpi0 (MOU, IBM0057): aux port
 Jun 27 19:30:28 ipaddi /netbsd: pckbc1: irq 12
 Jun 27 19:30:28 ipaddi /netbsd: com0 at acpi0 (UART, PNP0501)
 Jun 27 19:30:28 ipaddi /netbsd: com0: io 0x3f8-0x3ff irq 4
 Jun 27 19:30:28 ipaddi /netbsd: com0: ns16550a, working fifo
 Jun 27 19:30:28 ipaddi /netbsd: acpiec0 at acpi0 (EC, PNP0C09-0): ACPI Embedded Controller (disabled)
 Jun 27 19:30:28 ipaddi /netbsd: acpibat0 at acpi0 (BAT0, PNP0C0A-0): ACPI Battery (Control Method)
 Jun 27 19:30:28 ipaddi /netbsd: acpibat0: battery info: SANYO, LION, IBM-92P1077   121
 Jun 27 19:30:28 ipaddi /netbsd: acpiacad0 at acpi0 (AC, ACPI0003-0): ACPI AC Adapter
 Jun 27 19:30:28 ipaddi /netbsd: thinkpad0 at acpi0 (HKEY, IBM0068)
 Jun 27 19:30:28 ipaddi /netbsd: thinkpad0: using CMOS at \UCMS
 Jun 27 19:30:28 ipaddi /netbsd: thinkpad0: using EC at acpiecdt0
 Jun 27 19:30:28 ipaddi /netbsd: acpitz0 at acpi0 (THM0): critical 99.0C passive 39.0C, passive cooling
 Jun 27 19:30:28 ipaddi /netbsd: apm0 at acpi0: Power Management spec V1.2
 Jun 27 19:30:28 ipaddi /netbsd: pckbd0 at pckbc0 (kbd slot)
 Jun 27 19:30:28 ipaddi /netbsd: pckbc0: using irq 1 for kbd slot
 Jun 27 19:30:28 ipaddi /netbsd: wskbd0 at pckbd0: console keyboard
 Jun 27 19:30:28 ipaddi /netbsd: pms0 at pckbc0 (aux slot)
 Jun 27 19:30:28 ipaddi /netbsd: pckbc0: using irq 12 for aux slot
 Jun 27 19:30:28 ipaddi /netbsd: wsmouse0 at pms0 mux 0
 Jun 27 19:30:28 ipaddi /netbsd: pci0 at mainbus0 bus 0: configuration mode 1
 Jun 27 19:30:28 ipaddi /netbsd: pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
 Jun 27 19:30:28 ipaddi /netbsd: pchb0 at pci0 dev 0 function 0
 Jun 27 19:30:28 ipaddi /netbsd: pchb0: Intel 82915PM/GM/GMS,82910GML Host Bridge (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: pchb0: timeout reading test samples, RNG disabled.
 Jun 27 19:30:28 ipaddi /netbsd: agp0 at pchb0: can't find internal VGA device config space
 Jun 27 19:30:28 ipaddi /netbsd: ppb0 at pci0 dev 1 function 0: Intel 82915PM/GM PCI Express Bridge (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: pci1 at ppb0 bus 1
 Jun 27 19:30:28 ipaddi /netbsd: pci1: i/o space, memory space enabled, rd/line, wr/inv ok
 Jun 27 19:30:28 ipaddi /netbsd: vga0 at pci1 dev 0 function 0: ATI Technologies FireGL M24 GL 3154 (rev. 0x80)
 Jun 27 19:30:28 ipaddi /netbsd: wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation), using wskbd0
 Jun 27 19:30:28 ipaddi /netbsd: wsmux1: connecting to wsdisplay0
 Jun 27 19:30:28 ipaddi /netbsd: radeondrm0 at vga0: ATI FireGL M24 GL (unit 0)
 Jun 27 19:30:28 ipaddi /netbsd: radeondrm0: Initialized radeon 1.26.0 20060524
 Jun 27 19:30:28 ipaddi /netbsd: ppb1 at pci0 dev 28 function 0: Intel 82801FB/FR PCI Express Port #0 (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: pci2 at ppb1 bus 2
 Jun 27 19:30:28 ipaddi /netbsd: pci2: i/o space, memory space enabled, rd/line, wr/inv ok
 Jun 27 19:30:28 ipaddi /netbsd: bge0 at pci2 dev 0 function 0: Broadcom BCM5751M Gigabit Ethernet
 Jun 27 19:30:28 ipaddi /netbsd: bge0: interrupting at ioapic0 pin 16
 Jun 27 19:30:28 ipaddi /netbsd: bge0: ASIC BCM5751 A1 (0x4101), Ethernet address 00:11:25:b1:41:71
 Jun 27 19:30:28 ipaddi /netbsd: bge0: setting short Tx thresholds
 Jun 27 19:30:28 ipaddi /netbsd: brgphy0 at bge0 phy 1: BCM5750 1000BASE-T media interface, rev. 0
 Jun 27 19:30:28 ipaddi /netbsd: brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
 Jun 27 19:30:28 ipaddi /netbsd: ppb2 at pci0 dev 28 function 2: Intel 82801FB/FR PCI Express Port #2 (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: ppb2: disabling notification events
 Jun 27 19:30:28 ipaddi /netbsd: pci3 at ppb2 bus 3
 Jun 27 19:30:28 ipaddi /netbsd: pci3: i/o space, memory space enabled, rd/line, wr/inv ok
 Jun 27 19:30:28 ipaddi /netbsd: uhci0 at pci0 dev 29 function 0: Intel 82801FB/FR USB UHCI Controller (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: uhci0: interrupting at ioapic0 pin 16
 Jun 27 19:30:28 ipaddi /netbsd: usb0 at uhci0: USB revision 1.0
 Jun 27 19:30:28 ipaddi /netbsd: uhci1 at pci0 dev 29 function 1: Intel 82801FB/FR USB UHCI Controller (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: uhci1: interrupting at ioapic0 pin 17
 Jun 27 19:30:28 ipaddi /netbsd: usb1 at uhci1: USB revision 1.0
 Jun 27 19:30:28 ipaddi /netbsd: uhci2 at pci0 dev 29 function 2: Intel 82801FB/FR USB UHCI Controller (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: uhci2: interrupting at ioapic0 pin 18
 Jun 27 19:30:28 ipaddi /netbsd: usb2 at uhci2: USB revision 1.0
 Jun 27 19:30:28 ipaddi /netbsd: uhci3 at pci0 dev 29 function 3: Intel 82801FB/FR USB UHCI Controller (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: uhci3: interrupting at ioapic0 pin 19
 Jun 27 19:30:28 ipaddi /netbsd: usb3 at uhci3: USB revision 1.0
 Jun 27 19:30:28 ipaddi /netbsd: ehci0 at pci0 dev 29 function 7: Intel 82801FB/FR USB EHCI Controller (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: ehci0: interrupting at ioapic0 pin 19
 Jun 27 19:30:28 ipaddi /netbsd: ehci0: EHCI version 1.0
 Jun 27 19:30:28 ipaddi /netbsd: ehci0: companion controllers, 2 ports each: uhci0 uhci1 uhci2 uhci3
 Jun 27 19:30:28 ipaddi /netbsd: usb4 at ehci0: USB revision 2.0
 Jun 27 19:30:28 ipaddi /netbsd: ppb3 at pci0 dev 30 function 0: Intel 82801BAM Hub-PCI Bridge (rev. 0xd3)
 Jun 27 19:30:28 ipaddi /netbsd: pci4 at ppb3 bus 11
 Jun 27 19:30:28 ipaddi /netbsd: pci4: i/o space, memory space enabled
 Jun 27 19:30:28 ipaddi /netbsd: cbb0 at pci4 dev 0 function 0: Ricoh 5C476 PCI-CardBus bridge (rev. 0x8d)
 Jun 27 19:30:28 ipaddi /netbsd: ath0 at pci4 dev 2 function 0
 Jun 27 19:30:28 ipaddi /netbsd: ath0: interrupting at ioapic0 pin 21
 Jun 27 19:30:28 ipaddi /netbsd: ath0: 11a rates: 6Mbps 9Mbps 12Mbps 18Mbps 24Mbps 36Mbps 48Mbps 54Mbps
 Jun 27 19:30:28 ipaddi /netbsd: ath0: 11b rates: 1Mbps 2Mbps 5.5Mbps 11Mbps
 Jun 27 19:30:28 ipaddi /netbsd: ath0: 11g rates: 1Mbps 2Mbps 5.5Mbps 11Mbps 6Mbps 9Mbps 12Mbps 18Mbps 24Mbps 36Mbps 48Mbps 54Mbps
 Jun 27 19:30:28 ipaddi /netbsd: ath0: mac 5.9 phy 4.3 radio 3.6
 Jun 27 19:30:28 ipaddi /netbsd: cbb0: cacheline 0x0 lattimer 0x40
 Jun 27 19:30:28 ipaddi /netbsd: cbb0: bhlc 0x824000
 Jun 27 19:30:28 ipaddi /netbsd: cbb0: interrupting at ioapic0 pin 16
 Jun 27 19:30:28 ipaddi /netbsd: cardslot0 at cbb0
 Jun 27 19:30:28 ipaddi /netbsd: cardbus0 at cardslot0: bus 12
 Jun 27 19:30:28 ipaddi /netbsd: pcmcia0 at cardslot0
 Jun 27 19:30:28 ipaddi /netbsd: auich0 at pci0 dev 30 function 2: i82801FB (ICH6) AC-97 Audio
 Jun 27 19:30:28 ipaddi /netbsd: auich0: interrupting at ioapic0 pin 22
 Jun 27 19:30:28 ipaddi /netbsd: auich0: ac97: Analog Devices AD1981B codec; headphone, 20 bit DAC, no 3D stereo
 Jun 27 19:30:28 ipaddi /netbsd: auich0: ac97: ext id 601<AC97_22,AMAP,VRA>
 Jun 27 19:30:28 ipaddi /netbsd: ichlpcib0 at pci0 dev 31 function 0
 Jun 27 19:30:28 ipaddi /netbsd: ichlpcib0: Intel 82801FBM ICH6M LPC Interface Bridge (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: timecounter: Timecounter "ichlpcib0" frequency 3579545 Hz quality 1000
 Jun 27 19:30:28 ipaddi /netbsd: ichlpcib0: 24-bit timer
 Jun 27 19:30:28 ipaddi /netbsd: ichlpcib0: TCO (watchdog) timer configured.
 Jun 27 19:30:28 ipaddi /netbsd: piixide0 at pci0 dev 31 function 2
 Jun 27 19:30:28 ipaddi /netbsd: piixide0: Intel 82801FBM Serial ATA Controller (ICH6) (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: piixide0: bus-master DMA support present
 Jun 27 19:30:28 ipaddi /netbsd: piixide0: primary channel wired to compatibility mode
 Jun 27 19:30:28 ipaddi /netbsd: piixide0: primary channel interrupting at ioapic0 pin 14
 Jun 27 19:30:28 ipaddi /netbsd: atabus0 at piixide0 channel 0
 Jun 27 19:30:28 ipaddi /netbsd: piixide0: secondary channel wired to compatibility mode
 Jun 27 19:30:28 ipaddi /netbsd: piixide0: secondary channel interrupting at ioapic0 pin 15
 Jun 27 19:30:28 ipaddi /netbsd: atabus1 at piixide0 channel 1
 Jun 27 19:30:28 ipaddi /netbsd: ichsmb0 at pci0 dev 31 function 3: Intel 82801FB/FR SMBus Controller (rev. 0x03)
 Jun 27 19:30:28 ipaddi /netbsd: ichsmb0: interrupting at ioapic0 pin 23
 Jun 27 19:30:28 ipaddi /netbsd: iic0 at ichsmb0: I2C bus
 Jun 27 19:30:28 ipaddi /netbsd: isa0 at ichlpcib0
 Jun 27 19:30:28 ipaddi /netbsd: aps0 at isa0 port 0x1600-0x161e
 Jun 27 19:30:28 ipaddi /netbsd: aps0: Thinkpad Active Protection System
 Jun 27 19:30:28 ipaddi /netbsd: timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
 Jun 27 19:30:28 ipaddi /netbsd: auich0: measured ac97 link rate at 48001 Hz, will use 48000 Hz
 Jun 27 19:30:28 ipaddi /netbsd: audio0 at auich0: full duplex, mmap, independent
 Jun 27 19:30:28 ipaddi /netbsd: acpiacad0: AC adapter online.
 Jun 27 19:30:28 ipaddi /netbsd: uhub0 at usb0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jun 27 19:30:28 ipaddi /netbsd: uhub0: 2 ports with 2 removable, self powered
 Jun 27 19:30:28 ipaddi /netbsd: uhub1 at usb1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jun 27 19:30:28 ipaddi /netbsd: uhub1: 2 ports with 2 removable, self powered
 Jun 27 19:30:28 ipaddi /netbsd: uhub2 at usb2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jun 27 19:30:28 ipaddi /netbsd: uhub2: 2 ports with 2 removable, self powered
 Jun 27 19:30:28 ipaddi /netbsd: uhub3 at usb3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jun 27 19:30:28 ipaddi /netbsd: uhub3: 2 ports with 2 removable, self powered
 Jun 27 19:30:28 ipaddi /netbsd: uhub4 at usb4: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
 Jun 27 19:30:28 ipaddi /netbsd: uhub4: 8 ports with 8 removable, self powered
 Jun 27 19:30:28 ipaddi /netbsd: wd0 at atabus0 drive 0: <WDC WD2500BEVE-00WZT0>
 Jun 27 19:30:28 ipaddi /netbsd: wd0: drive supports 16-sector PIO transfers, LBA48 addressing
 Jun 27 19:30:28 ipaddi /netbsd: wd0: 232 GB, 484521 cyl, 16 head, 63 sec, 512 bytes/sect x 488397168 sectors
 Jun 27 19:30:28 ipaddi /netbsd: wd0: 32-bit data port
 Jun 27 19:30:28 ipaddi /netbsd: wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 5 (Ultra/100)
 Jun 27 19:30:28 ipaddi /netbsd: wd0(piixide0:0:0): using PIO mode 4, Ultra-DMA mode 5 (Ultra/100) (using DMA)
 Jun 27 19:30:28 ipaddi /netbsd: atapibus0 at atabus1: 2 targets
 Jun 27 19:30:28 ipaddi /netbsd: cd0 at atapibus0 drive 0: <MATSHITADVD-RAM UJ-822S, , 1.03> cdrom removable
 Jun 27 19:30:28 ipaddi /netbsd: cd0: 32-bit data port
 Jun 27 19:30:28 ipaddi /netbsd: cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 2 (Ultra/33)
 Jun 27 19:30:28 ipaddi /netbsd: cd0(piixide0:1:0): using PIO mode 4, Ultra-DMA mode 2 (Ultra/33) (using DMA)
 Jun 27 19:30:28 ipaddi /netbsd: boot device: wd0
 Jun 27 19:30:28 ipaddi /netbsd: root on wd0a dumps on wd0b
 Jun 27 19:30:28 ipaddi /netbsd: root file system type: ffs
 Jun 27 19:30:28 ipaddi /netbsd: ath0: setting keyix 0 w/o power
 Jun 27 19:30:28 ipaddi /netbsd: wsdisplay0: screen 1 added (80x25, vt100 emulation)
 Jun 27 19:30:28 ipaddi /netbsd: wsdisplay0: screen 2 added (80x25, vt100 emulation)
 Jun 27 19:30:28 ipaddi /netbsd: wsdisplay0: screen 3 added (80x25, vt100 emulation)
 Jun 27 19:30:28 ipaddi /netbsd: wsdisplay0: screen 4 added (80x25, vt100 emulation)
 Jun 27 19:30:29 ipaddi /netbsd: Accounting started
 Jun 27 19:48:42 ipaddi /netbsd: bge0: block failed to stop: reg 0x1400, bit 0x00000002
 Jun 27 19:48:42 ipaddi /netbsd: ath0: setting keyix 0 w/o power
 Jun 27 20:11:18 ipaddi /netbsd: uhci2: host controller process error
 Jun 27 20:11:18 ipaddi /netbsd: uhci2: host controller halted
 Jun 27 20:11:50 ipaddi /netbsd: uhci3: host controller process error
 Jun 27 20:11:50 ipaddi /netbsd: uhci3: host controller halted
 Jun 27 20:11:50 ipaddi /netbsd: uhci0: host controller process error
 Jun 27 20:11:50 ipaddi /netbsd: uhci0: host controller halted
 Jun 27 20:11:50 ipaddi /netbsd: uhci1: host controller process error
 Jun 27 20:11:50 ipaddi /netbsd: uhci1: host controller halted
 Jun 27 20:34:45 ipaddi sudo:       ks : TTY=ttyp5 ; PWD=/home/ks ; USER=root ; COMMAND=/bin/sh NBscripts/build-netbsd -K
 Jun 27 20:36:07 ipaddi /netbsd: Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
 Jun 27 20:36:07 ipaddi /netbsd: 2006, 2007, 2008
 Jun 27 20:36:07 ipaddi /netbsd: The NetBSD Foundation, Inc.  All rights reserved.
 Jun 27 20:36:07 ipaddi /netbsd: Copyright (c) 1982, 1986, 1989, 1991, 1993
 Jun 27 20:36:07 ipaddi /netbsd: The Regents of the University of California.  All rights reserved.
 Jun 27 20:36:07 ipaddi /netbsd: 
 Jun 27 20:36:07 ipaddi /netbsd: NetBSD 4.99.67 (PADDI) #328: Fri Jun 27 20:28:35 MEST 2008
 Jun 27 20:36:07 ipaddi /netbsd: ks@ipaddi:/u/NetBSD/arch/i386/obj/sys/arch/i386/compile/PADDI
 Jun 27 20:36:07 ipaddi /netbsd: multiboot: Information structure flags: 0x000007e7
 Jun 27 20:36:07 ipaddi /netbsd: multiboot: Boot loader: GNU GRUB 0.97
 Jun 27 20:36:07 ipaddi /netbsd: multiboot: Command line: /netbsd root=wd0a
 Jun 27 20:36:07 ipaddi /netbsd: multiboot: 636 KB lower memory, 2094976 KB upper memory
 Jun 27 20:36:07 ipaddi /netbsd: multiboot: Symbol table at 0xc05489d4, length 279936 bytes
 Jun 27 20:36:07 ipaddi /netbsd: multiboot: String table at 0xc058cf54, length 280214 bytes
 Jun 27 20:36:07 ipaddi /netbsd: total memory = 2046 MB
 Jun 27 20:36:07 ipaddi /netbsd: avail memory = 2003 MB
 Jun 27 20:36:07 ipaddi /netbsd: timecounter: Timecounters tick every 10.000 msec
 Jun 27 20:36:07 ipaddi /netbsd: timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100
 Jun 27 20:36:07 ipaddi /netbsd: IBM 2668H8G (ThinkPad T43p)
 Jun 27 20:36:07 ipaddi /netbsd: mainbus0 (root)
 Jun 27 20:36:07 ipaddi /netbsd: cpu0 at mainbus0 apid 0: Intel 686-class, 2128MHz, id 0x6d8
 Jun 27 20:36:07 ipaddi /netbsd: cpu0: Enhanced SpeedStep (1356 mV) 2133 MHz
 Jun 27 20:36:07 ipaddi /netbsd: cpu0: Enhanced SpeedStep frequencies available (MHz): 2133 1867 1600 1333 1067 800
 Jun 27 20:36:07 ipaddi /netbsd: cpu0: Intel(R) On Demand Clock Modulation (state disabled)
 Jun 27 20:36:07 ipaddi /netbsd: ioapic0 at mainbus0 apid 1: pa 0xfec00000, version 20, 24 pins
 Jun 27 20:36:07 ipaddi /netbsd: acpi0 at mainbus0: Intel ACPICA 20080321
 Jun 27 20:36:07 ipaddi /netbsd: acpi0: X/RSDT: OemId <IBM   ,TP-1Y   ,00001290>, AslId < LTP,00000000>
 Jun 27 20:36:07 ipaddi /netbsd: acpiecdt0 at acpi0: ACPI Embedded Controller via ECDT
 Jun 27 20:36:07 ipaddi /netbsd: acpi0: SCI interrupting at int 9
 Jun 27 20:36:07 ipaddi /netbsd: acpi0: fixed-feature power button present
 Jun 27 20:36:07 ipaddi /netbsd: timecounter: Timecounter "ACPI-Fast" frequency 3579545 Hz quality 1000
 Jun 27 20:36:07 ipaddi /netbsd: ACPI-Fast 24-bit timer
 Jun 27 20:36:07 ipaddi /netbsd: acpilid0 at acpi0 (LID, PNP0C0D): ACPI Lid Switch
 Jun 27 20:36:07 ipaddi /netbsd: acpibut0 at acpi0 (SLPB, PNP0C0E): ACPI Sleep Button
 Jun 27 20:36:07 ipaddi /netbsd: attimer0 at acpi0 (TIMR, PNP0100): AT Timer
 Jun 27 20:36:07 ipaddi /netbsd: attimer0: io 0x40-0x43 irq 0
 Jun 27 20:36:07 ipaddi /netbsd: SPKR (PNP0800) [AT-style speaker sound] at acpi0 not configured
 Jun 27 20:36:07 ipaddi /netbsd: npx0 at acpi0 (FPU, PNP0C04)
 Jun 27 20:36:07 ipaddi /netbsd: npx0: io 0xf0 irq 13
 Jun 27 20:36:07 ipaddi /netbsd: npx0: reported by CPUID; using exception 16
 Jun 27 20:36:07 ipaddi /netbsd: pckbc0 at acpi0 (KBD, PNP0303): kbd port
 Jun 27 20:36:07 ipaddi /netbsd: pckbc0: io 0x60,0x64 irq 1
 Jun 27 20:36:07 ipaddi /netbsd: pckbc1 at acpi0 (MOU, IBM0057): aux port
 Jun 27 20:36:07 ipaddi /netbsd: pckbc1: irq 12
 Jun 27 20:36:07 ipaddi /netbsd: com0 at acpi0 (UART, PNP0501)
 Jun 27 20:36:07 ipaddi /netbsd: com0: io 0x3f8-0x3ff irq 4
 Jun 27 20:36:07 ipaddi /netbsd: com0: ns16550a, working fifo
 Jun 27 20:36:07 ipaddi /netbsd: acpiec0 at acpi0 (EC, PNP0C09-0): ACPI Embedded Controller (disabled)
 Jun 27 20:36:07 ipaddi /netbsd: acpibat0 at acpi0 (BAT0, PNP0C0A-0): ACPI Battery (Control Method)
 Jun 27 20:36:07 ipaddi /netbsd: acpibat0: battery info: Sÿÿÿÿÿÿ, LION, IBM-92P1077   121
 Jun 27 20:36:07 ipaddi /netbsd: acpiacad0 at acpi0 (AC, ACPI0003-0): ACPI AC Adapter
 Jun 27 20:36:07 ipaddi /netbsd: thinkpad0 at acpi0 (HKEY, IBM0068)
 Jun 27 20:36:07 ipaddi /netbsd: thinkpad0: using CMOS at \UCMS
 Jun 27 20:36:07 ipaddi /netbsd: thinkpad0: using EC at acpiecdt0
 Jun 27 20:36:07 ipaddi /netbsd: acpitz0 at acpi0 (THM0): critical 99.0C passive 59.0C, passive cooling
 Jun 27 20:36:07 ipaddi /netbsd: apm0 at acpi0: Power Management spec V1.2
 Jun 27 20:36:07 ipaddi /netbsd: pckbd0 at pckbc0 (kbd slot)
 Jun 27 20:36:07 ipaddi /netbsd: pckbc0: using irq 1 for kbd slot
 Jun 27 20:36:07 ipaddi /netbsd: wskbd0 at pckbd0: console keyboard
 Jun 27 20:36:07 ipaddi /netbsd: pms0 at pckbc0 (aux slot)
 Jun 27 20:36:07 ipaddi /netbsd: pckbc0: using irq 12 for aux slot
 Jun 27 20:36:07 ipaddi /netbsd: wsmouse0 at pms0 mux 0
 Jun 27 20:36:07 ipaddi /netbsd: pci0 at mainbus0 bus 0: configuration mode 1
 Jun 27 20:36:07 ipaddi /netbsd: pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
 Jun 27 20:36:07 ipaddi /netbsd: pchb0 at pci0 dev 0 function 0
 Jun 27 20:36:07 ipaddi /netbsd: pchb0: Intel 82915PM/GM/GMS,82910GML Host Bridge (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: pchb0: timeout reading test samples, RNG disabled.
 Jun 27 20:36:07 ipaddi /netbsd: agp0 at pchb0: can't find internal VGA device config space
 Jun 27 20:36:07 ipaddi /netbsd: ppb0 at pci0 dev 1 function 0: Intel 82915PM/GM PCI Express Bridge (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: pci1 at ppb0 bus 1
 Jun 27 20:36:07 ipaddi /netbsd: pci1: i/o space, memory space enabled, rd/line, wr/inv ok
 Jun 27 20:36:07 ipaddi /netbsd: vga0 at pci1 dev 0 function 0: ATI Technologies FireGL M24 GL 3154 (rev. 0x80)
 Jun 27 20:36:07 ipaddi /netbsd: wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation), using wskbd0
 Jun 27 20:36:07 ipaddi /netbsd: wsmux1: connecting to wsdisplay0
 Jun 27 20:36:07 ipaddi /netbsd: radeondrm0 at vga0: ATI FireGL M24 GL (unit 0)
 Jun 27 20:36:07 ipaddi /netbsd: radeondrm0: Initialized radeon 1.26.0 20060524
 Jun 27 20:36:07 ipaddi /netbsd: ppb1 at pci0 dev 28 function 0: Intel 82801FB/FR PCI Express Port #0 (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: pci2 at ppb1 bus 2
 Jun 27 20:36:07 ipaddi /netbsd: pci2: i/o space, memory space enabled, rd/line, wr/inv ok
 Jun 27 20:36:07 ipaddi /netbsd: bge0 at pci2 dev 0 function 0: Broadcom BCM5751M Gigabit Ethernet
 Jun 27 20:36:07 ipaddi /netbsd: bge0: interrupting at ioapic0 pin 16
 Jun 27 20:36:07 ipaddi /netbsd: bge0: ASIC BCM5751 A1 (0x4101), Ethernet address 00:11:25:b1:41:71
 Jun 27 20:36:07 ipaddi /netbsd: bge0: setting short Tx thresholds
 Jun 27 20:36:07 ipaddi /netbsd: brgphy0 at bge0 phy 1: BCM5750 1000BASE-T media interface, rev. 0
 Jun 27 20:36:07 ipaddi /netbsd: brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
 Jun 27 20:36:07 ipaddi /netbsd: ppb2 at pci0 dev 28 function 2: Intel 82801FB/FR PCI Express Port #2 (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: ppb2: disabling notification events
 Jun 27 20:36:07 ipaddi /netbsd: pci3 at ppb2 bus 3
 Jun 27 20:36:07 ipaddi /netbsd: pci3: i/o space, memory space enabled, rd/line, wr/inv ok
 Jun 27 20:36:07 ipaddi /netbsd: uhci0 at pci0 dev 29 function 0: Intel 82801FB/FR USB UHCI Controller (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: uhci0: interrupting at ioapic0 pin 16
 Jun 27 20:36:07 ipaddi /netbsd: usb0 at uhci0: USB revision 1.0
 Jun 27 20:36:07 ipaddi /netbsd: uhci1 at pci0 dev 29 function 1: Intel 82801FB/FR USB UHCI Controller (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: uhci1: interrupting at ioapic0 pin 17
 Jun 27 20:36:07 ipaddi /netbsd: usb1 at uhci1: USB revision 1.0
 Jun 27 20:36:07 ipaddi /netbsd: uhci2 at pci0 dev 29 function 2: Intel 82801FB/FR USB UHCI Controller (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: uhci2: interrupting at ioapic0 pin 18
 Jun 27 20:36:07 ipaddi /netbsd: usb2 at uhci2: USB revision 1.0
 Jun 27 20:36:07 ipaddi /netbsd: uhci3 at pci0 dev 29 function 3: Intel 82801FB/FR USB UHCI Controller (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: uhci3: interrupting at ioapic0 pin 19
 Jun 27 20:36:07 ipaddi /netbsd: usb3 at uhci3: USB revision 1.0
 Jun 27 20:36:07 ipaddi /netbsd: ehci0 at pci0 dev 29 function 7: Intel 82801FB/FR USB EHCI Controller (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: ehci0: interrupting at ioapic0 pin 19
 Jun 27 20:36:07 ipaddi /netbsd: ehci0: EHCI version 1.0
 Jun 27 20:36:07 ipaddi /netbsd: ehci0: companion controllers, 2 ports each: uhci0 uhci1 uhci2 uhci3
 Jun 27 20:36:07 ipaddi /netbsd: usb4 at ehci0: USB revision 2.0
 Jun 27 20:36:07 ipaddi /netbsd: ppb3 at pci0 dev 30 function 0: Intel 82801BAM Hub-PCI Bridge (rev. 0xd3)
 Jun 27 20:36:07 ipaddi /netbsd: pci4 at ppb3 bus 11
 Jun 27 20:36:07 ipaddi /netbsd: pci4: i/o space, memory space enabled
 Jun 27 20:36:07 ipaddi /netbsd: cbb0 at pci4 dev 0 function 0: Ricoh 5C476 PCI-CardBus bridge (rev. 0x8d)
 Jun 27 20:36:07 ipaddi /netbsd: ath0 at pci4 dev 2 function 0
 Jun 27 20:36:07 ipaddi /netbsd: ath0: interrupting at ioapic0 pin 21
 Jun 27 20:36:07 ipaddi /netbsd: ath0: 11a rates: 6Mbps 9Mbps 12Mbps 18Mbps 24Mbps 36Mbps 48Mbps 54Mbps
 Jun 27 20:36:07 ipaddi /netbsd: ath0: 11b rates: 1Mbps 2Mbps 5.5Mbps 11Mbps
 Jun 27 20:36:07 ipaddi /netbsd: ath0: 11g rates: 1Mbps 2Mbps 5.5Mbps 11Mbps 6Mbps 9Mbps 12Mbps 18Mbps 24Mbps 36Mbps 48Mbps 54Mbps
 Jun 27 20:36:07 ipaddi /netbsd: ath0: mac 5.9 phy 4.3 radio 3.6
 Jun 27 20:36:07 ipaddi /netbsd: cbb0: cacheline 0x0 lattimer 0x40
 Jun 27 20:36:07 ipaddi /netbsd: cbb0: bhlc 0x824000
 Jun 27 20:36:07 ipaddi /netbsd: cbb0: interrupting at ioapic0 pin 16
 Jun 27 20:36:07 ipaddi /netbsd: cardslot0 at cbb0
 Jun 27 20:36:07 ipaddi /netbsd: cardbus0 at cardslot0: bus 12
 Jun 27 20:36:07 ipaddi /netbsd: pcmcia0 at cardslot0
 Jun 27 20:36:07 ipaddi /netbsd: auich0 at pci0 dev 30 function 2: i82801FB (ICH6) AC-97 Audio
 Jun 27 20:36:07 ipaddi /netbsd: auich0: interrupting at ioapic0 pin 22
 Jun 27 20:36:07 ipaddi /netbsd: auich0: ac97: Analog Devices AD1981B codec; headphone, 20 bit DAC, no 3D stereo
 Jun 27 20:36:07 ipaddi /netbsd: auich0: ac97: ext id 601<AC97_22,AMAP,VRA>
 Jun 27 20:36:07 ipaddi /netbsd: ichlpcib0 at pci0 dev 31 function 0
 Jun 27 20:36:07 ipaddi /netbsd: ichlpcib0: Intel 82801FBM ICH6M LPC Interface Bridge (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: timecounter: Timecounter "ichlpcib0" frequency 3579545 Hz quality 1000
 Jun 27 20:36:07 ipaddi /netbsd: ichlpcib0: 24-bit timer
 Jun 27 20:36:07 ipaddi /netbsd: ichlpcib0: TCO (watchdog) timer configured.
 Jun 27 20:36:07 ipaddi /netbsd: piixide0 at pci0 dev 31 function 2
 Jun 27 20:36:07 ipaddi /netbsd: piixide0: Intel 82801FBM Serial ATA Controller (ICH6) (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: piixide0: bus-master DMA support present
 Jun 27 20:36:07 ipaddi /netbsd: piixide0: primary channel wired to compatibility mode
 Jun 27 20:36:07 ipaddi /netbsd: piixide0: primary channel interrupting at ioapic0 pin 14
 Jun 27 20:36:07 ipaddi /netbsd: atabus0 at piixide0 channel 0
 Jun 27 20:36:07 ipaddi /netbsd: piixide0: secondary channel wired to compatibility mode
 Jun 27 20:36:07 ipaddi /netbsd: piixide0: secondary channel interrupting at ioapic0 pin 15
 Jun 27 20:36:07 ipaddi /netbsd: atabus1 at piixide0 channel 1
 Jun 27 20:36:07 ipaddi /netbsd: ichsmb0 at pci0 dev 31 function 3: Intel 82801FB/FR SMBus Controller (rev. 0x03)
 Jun 27 20:36:07 ipaddi /netbsd: ichsmb0: interrupting at ioapic0 pin 23
 Jun 27 20:36:07 ipaddi /netbsd: iic0 at ichsmb0: I2C bus
 Jun 27 20:36:07 ipaddi /netbsd: isa0 at ichlpcib0
 Jun 27 20:36:07 ipaddi /netbsd: aps0 at isa0 port 0x1600-0x161e
 Jun 27 20:36:07 ipaddi /netbsd: aps0: Thinkpad Active Protection System
 Jun 27 20:36:07 ipaddi /netbsd: timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
 Jun 27 20:36:07 ipaddi /netbsd: auich0: measured ac97 link rate at 48001 Hz, will use 48000 Hz
 Jun 27 20:36:07 ipaddi /netbsd: audio0 at auich0: full duplex, mmap, independent
 Jun 27 20:36:07 ipaddi /netbsd: acpiacad0: AC adapter online.
 Jun 27 20:36:07 ipaddi /netbsd: uhub0 at usb0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jun 27 20:36:07 ipaddi /netbsd: uhub0: 2 ports with 2 removable, self powered
 Jun 27 20:36:07 ipaddi /netbsd: uhub1 at usb1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jun 27 20:36:07 ipaddi /netbsd: uhub1: 2 ports with 2 removable, self powered
 Jun 27 20:36:07 ipaddi /netbsd: uhub2 at usb2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jun 27 20:36:07 ipaddi /netbsd: uhub2: 2 ports with 2 removable, self powered
 Jun 27 20:36:07 ipaddi /netbsd: uhub3 at usb3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jun 27 20:36:07 ipaddi /netbsd: uhub3: 2 ports with 2 removable, self powered
 Jun 27 20:36:07 ipaddi /netbsd: uhub4 at usb4: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
 Jun 27 20:36:07 ipaddi /netbsd: uhub4: 8 ports with 8 removable, self powered
 Jun 27 20:36:07 ipaddi /netbsd: wd0 at atabus0 drive 0: <WDC WD2500BEVE-00WZT0>
 Jun 27 20:36:07 ipaddi /netbsd: wd0: drive supports 16-sector PIO transfers, LBA48 addressing
 Jun 27 20:36:07 ipaddi /netbsd: wd0: 232 GB, 484521 cyl, 16 head, 63 sec, 512 bytes/sect x 488397168 sectors
 Jun 27 20:36:07 ipaddi /netbsd: wd0: 32-bit data port
 Jun 27 20:36:07 ipaddi /netbsd: wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 5 (Ultra/100)
 Jun 27 20:36:07 ipaddi /netbsd: wd0(piixide0:0:0): using PIO mode 4, Ultra-DMA mode 5 (Ultra/100) (using DMA)
 Jun 27 20:36:07 ipaddi /netbsd: atapibus0 at atabus1: 2 targets
 Jun 27 20:36:07 ipaddi /netbsd: cd0 at atapibus0 drive 0: <MATSHITADVD-RAM UJ-822S, , 1.03> cdrom removable
 Jun 27 20:36:07 ipaddi /netbsd: cd0: 32-bit data port
 Jun 27 20:36:07 ipaddi /netbsd: cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 2 (Ultra/33)
 Jun 27 20:36:07 ipaddi /netbsd: cd0(piixide0:1:0): using PIO mode 4, Ultra-DMA mode 2 (Ultra/33) (using DMA)
 Jun 27 20:36:07 ipaddi /netbsd: boot device: wd0
 Jun 27 20:36:07 ipaddi /netbsd: root on wd0a dumps on wd0b
 Jun 27 20:36:07 ipaddi /netbsd: root file system type: ffs
 Jun 27 20:36:07 ipaddi /netbsd: ath0: setting keyix 0 w/o power
 Jun 27 20:36:07 ipaddi /netbsd: wsdisplay0: screen 1 added (80x25, vt100 emulation)
 Jun 27 20:36:07 ipaddi /netbsd: wsdisplay0: screen 2 added (80x25, vt100 emulation)
 Jun 27 20:36:07 ipaddi /netbsd: wsdisplay0: screen 3 added (80x25, vt100 emulation)
 Jun 27 20:36:07 ipaddi /netbsd: wsdisplay0: screen 4 added (80x25, vt100 emulation)
 Jun 27 20:36:08 ipaddi /netbsd: Accounting started
 Jun 27 20:36:45 ipaddi /netbsd: ath0: setting keyix 0 w/o power
 Jun 27 20:37:34 ipaddi /netbsd: uhci0: host controller process error
 Jun 27 20:37:34 ipaddi /netbsd: uhci0: host controller halted
 Jun 27 20:37:36 ipaddi /netbsd: uhci1: host controller process error
 Jun 27 20:37:36 ipaddi /netbsd: uhci1: host controller halted
 Jun 27 20:37:36 ipaddi /netbsd: uhci3: host controller process error
 Jun 27 20:37:36 ipaddi /netbsd: uhci3: host controller halted
 Jun 27 20:37:37 ipaddi /netbsd: uhci2: host controller process error
 Jun 27 20:37:37 ipaddi /netbsd: uhci2: host controller halted

 --9amGYk9869ThD9tj--

From: Manuel Bouyer <bouyer@antioche.eu.org>
To: Kurt Schreiner <ks@ub.uni-mainz.de>
Cc: "gnats-bugs@NetBSD.org" <gnats-bugs@NetBSD.org>,
        "kern-bug-people@NetBSD.org" <kern-bug-people@NetBSD.org>,
        "gnats-admin@NetBSD.org" <gnats-admin@NetBSD.org>,
        "netbsd-bugs@NetBSD.org" <netbsd-bugs@NetBSD.org>
Subject: Re: kern/39093: usb doesn't work anymore on IBM T43p
Date: Sun, 6 Jul 2008 21:31:32 +0200

 On Fri, Jul 04, 2008 at 09:42:54PM +0200, Kurt Schreiner wrote:
 > > Do you mean is started failing on Jun 27, or that it worked on Jun 27 and
 > > started failing later ? I commited some changes to the USB drivers on Jun 28.
 > First failure is from Jun 27. Here's the relevant excerpt from /var/log/messages


 OK, so it's probably not caused by uhci.c rev 1.223. You could try reverting
 it to 1.222 to see if it changes anything, but I don't think so.

 > 
 > Hm, there are 41 minutes from finishing boot 'till the errors first appeared.
 > Following boots show the error message w/o "pause"... (see attached parts of
 > /var/log/messages)

 there's still more than one minute before getting the first message (and
 probably more than that because syslog doesn't start right after init).
 So I guess something is corrupting uhci's memory.
 Could you see if not using ath (maybe disabling it with boot -c) would
 avoid the issue ?

 -- 
 Manuel Bouyer <bouyer@antioche.eu.org>
      NetBSD: 26 ans d'experience feront toujours la difference
 --

From: Kurt Schreiner <ks@ub.uni-mainz.de>
To: Manuel Bouyer <bouyer@antioche.eu.org>
Cc: "gnats-bugs@NetBSD.org" <gnats-bugs@NetBSD.org>,
   "kern-bug-people@NetBSD.org" <kern-bug-people@NetBSD.org>,
   "gnats-admin@NetBSD.org" <gnats-admin@NetBSD.org>,
   "netbsd-bugs@NetBSD.org" <netbsd-bugs@NetBSD.org>
Subject: Re: kern/39093: usb doesn't work anymore on IBM T43p
Date: Mon, 7 Jul 2008 10:36:35 +0200

 On Sun, Jul 06, 2008 at 09:31:32PM +0200, Manuel Bouyer wrote:
 > On Fri, Jul 04, 2008 at 09:42:54PM +0200, Kurt Schreiner wrote:
 > > > Do you mean is started failing on Jun 27, or that it worked on Jun 27 and
 > > > started failing later ? I commited some changes to the USB drivers on Jun 28.
 > > First failure is from Jun 27. Here's the relevant excerpt from /var/log/messages
 > 
 > OK, so it's probably not caused by uhci.c rev 1.223. You could try reverting
 > it to 1.222 to see if it changes anything, but I don't think so.
 Over the weekend I played around w/ older kernels from source back to
 Jun 14 20:21 - the problem appears sooner or later... Even the kernel
 compiled on Jun 14 18:43 which (I thought?) worked previously shows
 the problem. I've found a very old kernel from May, 4 which booted fine
 and didn't show the problem but new userland (ifconfig etc) doesn't work
 so well. I'll experiment more later at home...


 > > Hm, there are 41 minutes from finishing boot 'till the errors first appeared.
 > > Following boots show the error message w/o "pause"... (see attached parts of
 > > /var/log/messages)
 > 
 > there's still more than one minute before getting the first message (and
 > probably more than that because syslog doesn't start right after init).
 > So I guess something is corrupting uhci's memory.
 > Could you see if not using ath (maybe disabling it with boot -c) would
 > avoid the issue ?
 Just tried w/ ath disabled using one of the "problematic" kernels built
 saturday and until now no error message! Hmmmmmmm....
 Same w/ a kernel just built from fresh sources: no problems so far...

 So the questions are: What and why is ath doing bad to uhci?

 Maybe this excerpt from /var/log/messages* could give a clue?

 /var/log/messages.9.gz:Jun  7 21:40:17 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.9.gz:Jun  7 21:56:00 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.9.gz:Jun  7 21:56:32 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.5.gz:Jun 19 14:37:29 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.5.gz:Jun 19 14:39:03 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.5.gz:Jun 19 14:44:19 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.5.gz:Jun 19 14:46:39 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.5.gz:Jun 19 15:09:40 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.5.gz:Jun 21 14:10:32 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.5.gz:Jun 21 22:59:35 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 22 23:13:05 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 12:59:18 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 13:04:55 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 13:06:23 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 13:58:39 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 14:41:53 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 14:45:08 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 16:15:41 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 18:04:12 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 18:04:12 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.4.gz:Jun 26 19:48:45 ipaddi /netbsd: ath0: hardware error; resetting
 /var/log/messages.3.gz:Jun 27 20:11:18 ipaddi /netbsd: uhci2: host controller process error
 /var/log/messages.3.gz:Jun 27 20:11:50 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.3.gz:Jun 27 20:11:50 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.3.gz:Jun 27 20:11:50 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.3.gz:Jun 27 20:37:34 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.3.gz:Jun 27 20:37:36 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.3.gz:Jun 27 20:37:36 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.3.gz:Jun 27 20:37:37 ipaddi /netbsd: uhci2: host controller process error
 /var/log/messages.3.gz:Jun 29 13:44:28 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.3.gz:Jun 29 13:44:28 ipaddi /netbsd: uhci2: host controller process error
 /var/log/messages.3.gz:Jun 29 13:44:29 ipaddi /netbsd: uhci1: host controller process error

 /var/log/messages.1.gz:Jul  3 17:26:52 ipaddi /netbsd: ath0: hardware error; resetting
 	*** but this ath0: error came from a kernel w/o uhci! ***

 /var/log/messages.1.gz:Jul  3 18:12:00 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.1.gz:Jul  3 18:12:00 ipaddi /netbsd: uhci2: host controller process error
 /var/log/messages.1.gz:Jul  3 18:12:00 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.1.gz:Jul  3 18:12:02 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.0.gz:Jul  5 09:18:51 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.0.gz:Jul  5 09:18:51 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.0.gz:Jul  5 09:18:51 ipaddi /netbsd: uhci2: host controller process error
 /var/log/messages.0.gz:Jul  5 09:18:51 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.0.gz:Jul  5 11:21:39 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.0.gz:Jul  5 11:21:39 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.0.gz:Jul  5 11:21:39 ipaddi /netbsd: uhci2: host controller process error
 /var/log/messages.0.gz:Jul  5 11:21:39 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.0.gz:Jul  5 12:39:12 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.0.gz:Jul  5 12:39:12 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.0.gz:Jul  5 12:39:13 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.0.gz:Jul  5 12:44:17 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.0.gz:Jul  5 12:44:17 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.0.gz:Jul  5 12:44:17 ipaddi /netbsd: uhci2: host controller process error
 /var/log/messages.0.gz:Jul  5 12:44:17 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.0.gz:Jul  5 12:50:58 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.0.gz:Jul  5 12:50:59 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.0.gz:Jul  5 12:50:59 ipaddi /netbsd: uhci2: host controller process error
 /var/log/messages.0.gz:Jul  5 12:50:59 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.0.gz:Jul  5 13:07:30 ipaddi /netbsd: uhci0: host controller process error
 /var/log/messages.0.gz:Jul  5 13:07:30 ipaddi /netbsd: uhci1: host controller process error
 /var/log/messages.0.gz:Jul  5 13:07:30 ipaddi /netbsd: uhci3: host controller process error
 /var/log/messages.0.gz:Jul  5 13:07:31 ipaddi /netbsd: uhci2: host controller process error

 Kurt

From: Manuel Bouyer <bouyer@antioche.eu.org>
To: Kurt Schreiner <ks@ub.uni-mainz.de>
Cc: "gnats-bugs@NetBSD.org" <gnats-bugs@NetBSD.org>,
        "kern-bug-people@NetBSD.org" <kern-bug-people@NetBSD.org>,
        "gnats-admin@NetBSD.org" <gnats-admin@NetBSD.org>,
        "netbsd-bugs@NetBSD.org" <netbsd-bugs@NetBSD.org>
Subject: Re: kern/39093: usb doesn't work anymore on IBM T43p
Date: Mon, 7 Jul 2008 12:59:09 +0200

 On Mon, Jul 07, 2008 at 10:36:35AM +0200, Kurt Schreiner wrote:
 > On Sun, Jul 06, 2008 at 09:31:32PM +0200, Manuel Bouyer wrote:
 > > On Fri, Jul 04, 2008 at 09:42:54PM +0200, Kurt Schreiner wrote:
 > > > > Do you mean is started failing on Jun 27, or that it worked on Jun 27 and
 > > > > started failing later ? I commited some changes to the USB drivers on Jun 28.
 > > > First failure is from Jun 27. Here's the relevant excerpt from /var/log/messages
 > > 
 > > OK, so it's probably not caused by uhci.c rev 1.223. You could try reverting
 > > it to 1.222 to see if it changes anything, but I don't think so.
 > Over the weekend I played around w/ older kernels from source back to
 > Jun 14 20:21 - the problem appears sooner or later... Even the kernel
 > compiled on Jun 14 18:43 which (I thought?) worked previously shows
 > the problem. I've found a very old kernel from May, 4 which booted fine
 > and didn't show the problem but new userland (ifconfig etc) doesn't work
 > so well. I'll experiment more later at home...

 OK, so it's definitively not related to my changes.

 > > > /var/log/messages)
 > > 
 > > there's still more than one minute before getting the first message (and
 > > probably more than that because syslog doesn't start right after init).
 > > So I guess something is corrupting uhci's memory.
 > > Could you see if not using ath (maybe disabling it with boot -c) would
 > > avoid the issue ?
 > Just tried w/ ath disabled using one of the "problematic" kernels built
 > saturday and until now no error message! Hmmmmmmm....
 > Same w/ a kernel just built from fresh sources: no problems so far...
 > 
 > So the questions are: What and why is ath doing bad to uhci?
 > 
 > Maybe this excerpt from /var/log/messages* could give a clue?
 > 
 > /var/log/messages.9.gz:Jun  7 21:40:17 ipaddi /netbsd: ath0: hardware error; resetting

 I don't know what these "hardware error" really means.
 The cause of the UHCI errors is probably because the UHCI DMA descriptors
 are invalid (or the controller thinks so). This could be because something
 else is writing to memory and corrupts the UHCI DMA memory,
 or because the some other device, or a chipset bug, cause data corruption
 on the PCI bus when the UHCI controllers are doing their DMA reads.

 -- 
 Manuel Bouyer, LIP6, Universite Paris VI.           Manuel.Bouyer@lip6.fr
      NetBSD: 26 ans d'experience feront toujours la difference
 --

From: Kurt Schreiner <ks@ub.uni-mainz.de>
To: Manuel Bouyer <bouyer@antioche.eu.org>
Cc: "gnats-bugs@NetBSD.org" <gnats-bugs@NetBSD.org>,
   "kern-bug-people@NetBSD.org" <kern-bug-people@NetBSD.org>,
   "gnats-admin@NetBSD.org" <gnats-admin@NetBSD.org>,
   "netbsd-bugs@NetBSD.org" <netbsd-bugs@NetBSD.org>
Subject: Re: kern/39093: usb doesn't work anymore on IBM T43p
Date: Mon, 7 Jul 2008 13:33:31 +0200

 On Mon, Jul 07, 2008 at 12:59:09PM +0200, Manuel Bouyer wrote:
 > On Mon, Jul 07, 2008 at 10:36:35AM +0200, Kurt Schreiner wrote:
 > > On Sun, Jul 06, 2008 at 09:31:32PM +0200, Manuel Bouyer wrote:
 > > > On Fri, Jul 04, 2008 at 09:42:54PM +0200, Kurt Schreiner wrote:
 > > > > > Do you mean is started failing on Jun 27, or that it worked on Jun 27 and
 > > > > > started failing later ? I commited some changes to the USB drivers on Jun 28.
 > > > > First failure is from Jun 27. Here's the relevant excerpt from /var/log/messages
 > [...]
 > > the problem. I've found a very old kernel from May, 4 which booted fine
 > [...]
 > OK, so it's definitively not related to my changes.
 Yep!

 > > [...]
 > > /var/log/messages.9.gz:Jun  7 21:40:17 ipaddi /netbsd: ath0: hardware error; resetting
 > 
 > I don't know what these "hardware error" really means.
 Hm, digging for "hardware error" in ath.c brings up the following:

         if (status & HAL_INT_FATAL) {
                 /*
                  * Fatal errors are unrecoverable.  Typically
                  * these are caused by DMA errors.  Unfortunately
                  * the exact reason is not (presently) returned
                  * by the hal.  
                  */

 ...not giving much hints where to look for the real cause of this...

 > The cause of the UHCI errors is probably because the UHCI DMA descriptors
 > are invalid (or the controller thinks so). This could be because something
 > else is writing to memory and corrupts the UHCI DMA memory,
 > or because the some other device, or a chipset bug, cause data corruption
 > on the PCI bus when the UHCI controllers are doing their DMA reads.
 Hm, so everything points to problems w/ DMA... Time to go for the screwdriver
 and take things apart. The problem is hardware releated, I think.

 Very much thanks for your help!
 Kurt

 ps.: Can you close the PR please? I think it's not needed anymore...

State-Changed-From-To: open->closed
State-Changed-By: mrg@NetBSD.org
State-Changed-When: Fri, 23 Aug 2019 07:22:41 +0000
State-Changed-Why:
closed at submitters request.  thanks!


>Unformatted:

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.39 2013/11/01 18:47:49 spz Exp $
$NetBSD: gnats_config.sh,v 1.9 2014/08/02 14:16:04 spz Exp $
Copyright © 1994-2007 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.