NetBSD Problem Report #53814

From www@NetBSD.org  Wed Dec 26 06:45:34 2018
Return-Path: <www@NetBSD.org>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 291CE7A110
	for <gnats-bugs@gnats.NetBSD.org>; Wed, 26 Dec 2018 06:45:34 +0000 (UTC)
Message-Id: <20181226064533.3834D7A1E3@mollari.NetBSD.org>
Date: Wed, 26 Dec 2018 06:45:33 +0000 (UTC)
From: aravind.ss1094@gmail.com
Reply-To: aravind.ss1094@gmail.com
To: gnats-bugs@NetBSD.org
Subject: wm0 device timeout in netbsd 7.1
X-Send-Pr-Version: www-1.0

>Number:         53814
>Category:       kern
>Synopsis:       wm0 device timeout in netbsd 7.1
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    kern-bug-people
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Wed Dec 26 06:50:00 +0000 2018
>Last-Modified:  Wed Jan 23 04:40:01 +0000 2019
>Originator:     Aravind Mani
>Release:        netbsd 7.1
>Organization:
private organization
>Environment:
chip type: I354
>Description:
We use WM_T_I354 chip type.When we reload continuously,we could able to observe device timeout issue. wm_init(),wm_reset() doesn't help to recover from problem state.The only way to recover is to reload the switch.There was no initialization error.
From wm_print_stats() and wm_pkt_stats(),i don't see any value in the registers listed and the packets are not hitting the hardware.
wm_reset also didn't help to recover the issue.

Do you need any other output to investigate further?
Is there any other way to recover from this issue?.
Is there any other fix has been done around this area?.



>How-To-Repeat:
Reload the switch continuously that runs with NetBSD 7.1.
>Fix:

>Audit-Trail:
From: Masanobu SAITOH <msaitoh@execsw.org>
To: gnats-bugs@NetBSD.org, kern-bug-people@netbsd.org,
 gnats-admin@netbsd.org, netbsd-bugs@netbsd.org
Cc: msaitoh@execsw.org
Subject: Re: kern/53814: wm0 device timeout in netbsd 7.1
Date: Thu, 27 Dec 2018 12:38:45 +0900

 On 2018/12/26 15:50, aravind.ss1094@gmail.com wrote:
 >> Number:         53814
 >> Category:       kern
 >> Synopsis:       wm0 device timeout in netbsd 7.1
 >> Confidential:   no
 >> Severity:       serious
 >> Priority:       medium
 >> Responsible:    kern-bug-people
 >> State:          open
 >> Class:          sw-bug
 >> Submitter-Id:   net
 >> Arrival-Date:   Wed Dec 26 06:50:00 +0000 2018
 >> Originator:     Aravind Mani
 >> Release:        netbsd 7.1
 >> Organization:
 > private organization
 >> Environment:
 > chip type: I354
 >> Description:
 > We use WM_T_I354 chip type.When we reload continuously,we could able to observe device timeout issue. wm_init(),wm_reset() doesn't help to recover from problem state.The only way to recover is to reload the switch.There was no initialization error.
 >>From wm_print_stats() and wm_pkt_stats(),i don't see any value in the registers listed and the packets are not hitting the hardware.
 > wm_reset also didn't help to recover the issue.
 > 
 > Do you need any other output to investigate further?
 > Is there any other way to recover from this issue?.
 > Is there any other fix has been done around this area?.
 > 
 > 
 > 
 >> How-To-Repeat:
 > Reload the switch continuously that runs with NetBSD 7.1.
 >> Fix:
 > 

   Are you using modified version of if_wm.c? It has neither wm_print_stats()
 nor wm_pkt_stats().

 > Do you need any other output to investigate further?

 wm(4) has WM_EVENT_COUNTERS option, so it would be good to
 add "options WM_EVENT_COUNTERS" into your kernel configuration
 file and see vmstat -e.

 > Reload the switch continuously that runs with NetBSD 7.1.

 It's little hard to know what triggers the problem because
 I don't know what your switch implementation do in the reload.

 I have SGMII based C2000 machines. I've not tested on others
 (e.g. KX, PCIe SERDES or GMII). It would be good to check your
 PHY configuration and/or status if your system is not SGMII based.


 -- 
 -----------------------------------------------
                  SAITOH Masanobu (msaitoh@execsw.org
                                   msaitoh@netbsd.org)

From: Aravind M <aravind.ss1094@gmail.com>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: kern/53814: wm0 device timeout in netbsd 7.1
Date: Mon, 31 Dec 2018 14:35:05 +0530

 --000000000000331cd7057e4db69c
 Content-Type: text/plain; charset="UTF-8"

 Thanks for your assistance.
 I'll add those options suggested and will get back on this.

 Regards,
 Aravind Mani

 On Thu 27 Dec, 2018, 9:10 AM Masanobu SAITOH <msaitoh@execsw.org wrote:

 > The following reply was made to PR kern/53814; it has been noted by GNATS.
 >
 > From: Masanobu SAITOH <msaitoh@execsw.org>
 > To: gnats-bugs@NetBSD.org, kern-bug-people@netbsd.org,
 >  gnats-admin@netbsd.org, netbsd-bugs@netbsd.org
 > Cc: msaitoh@execsw.org
 > Subject: Re: kern/53814: wm0 device timeout in netbsd 7.1
 > Date: Thu, 27 Dec 2018 12:38:45 +0900
 >
 >  On 2018/12/26 15:50, aravind.ss1094@gmail.com wrote:
 >  >> Number:         53814
 >  >> Category:       kern
 >  >> Synopsis:       wm0 device timeout in netbsd 7.1
 >  >> Confidential:   no
 >  >> Severity:       serious
 >  >> Priority:       medium
 >  >> Responsible:    kern-bug-people
 >  >> State:          open
 >  >> Class:          sw-bug
 >  >> Submitter-Id:   net
 >  >> Arrival-Date:   Wed Dec 26 06:50:00 +0000 2018
 >  >> Originator:     Aravind Mani
 >  >> Release:        netbsd 7.1
 >  >> Organization:
 >  > private organization
 >  >> Environment:
 >  > chip type: I354
 >  >> Description:
 >  > We use WM_T_I354 chip type.When we reload continuously,we could able to
 > observe device timeout issue. wm_init(),wm_reset() doesn't help to recover
 > from problem state.The only way to recover is to reload the switch.There
 > was no initialization error.
 >  >>From wm_print_stats() and wm_pkt_stats(),i don't see any value in the
 > registers listed and the packets are not hitting the hardware.
 >  > wm_reset also didn't help to recover the issue.
 >  >
 >  > Do you need any other output to investigate further?
 >  > Is there any other way to recover from this issue?.
 >  > Is there any other fix has been done around this area?.
 >  >
 >  >
 >  >
 >  >> How-To-Repeat:
 >  > Reload the switch continuously that runs with NetBSD 7.1.
 >  >> Fix:
 >  >
 >
 >    Are you using modified version of if_wm.c? It has neither
 > wm_print_stats()
 >  nor wm_pkt_stats().
 >
 >  > Do you need any other output to investigate further?
 >
 >  wm(4) has WM_EVENT_COUNTERS option, so it would be good to
 >  add "options WM_EVENT_COUNTERS" into your kernel configuration
 >  file and see vmstat -e.
 >
 >  > Reload the switch continuously that runs with NetBSD 7.1.
 >
 >  It's little hard to know what triggers the problem because
 >  I don't know what your switch implementation do in the reload.
 >
 >  I have SGMII based C2000 machines. I've not tested on others
 >  (e.g. KX, PCIe SERDES or GMII). It would be good to check your
 >  PHY configuration and/or status if your system is not SGMII based.
 >
 >
 >  --
 >  -----------------------------------------------
 >                   SAITOH Masanobu (msaitoh@execsw.org
 >                                    msaitoh@netbsd.org)
 >
 >

 --000000000000331cd7057e4db69c
 Content-Type: text/html; charset="UTF-8"
 Content-Transfer-Encoding: quoted-printable

 <div dir=3D"auto">Thanks for your assistance.<div dir=3D"auto">I&#39;ll add=
  those options suggested and will get back on this.<br><br><div data-smartm=
 ail=3D"gmail_signature" dir=3D"auto">Regards,<br>Aravind Mani</div></div></=
 div><br><div class=3D"gmail_quote"><div dir=3D"ltr">On Thu 27 Dec, 2018, 9:=
 10 AM Masanobu SAITOH &lt;<a href=3D"mailto:msaitoh@execsw.org">msaitoh@exe=
 csw.org</a> wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"marg=
 in:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">The following re=
 ply was made to PR kern/53814; it has been noted by GNATS.<br>
 <br>
 From: Masanobu SAITOH &lt;<a href=3D"mailto:msaitoh@execsw.org" target=3D"_=
 blank" rel=3D"noreferrer">msaitoh@execsw.org</a>&gt;<br>
 To: gnats-bugs@NetBSD.org, <a href=3D"mailto:kern-bug-people@netbsd.org" ta=
 rget=3D"_blank" rel=3D"noreferrer">kern-bug-people@netbsd.org</a>,<br>
 =C2=A0<a href=3D"mailto:gnats-admin@netbsd.org" target=3D"_blank" rel=3D"no=
 referrer">gnats-admin@netbsd.org</a>, <a href=3D"mailto:netbsd-bugs@netbsd.=
 org" target=3D"_blank" rel=3D"noreferrer">netbsd-bugs@netbsd.org</a><br>
 Cc: <a href=3D"mailto:msaitoh@execsw.org" target=3D"_blank" rel=3D"noreferr=
 er">msaitoh@execsw.org</a><br>
 Subject: Re: kern/53814: wm0 device timeout in netbsd 7.1<br>
 Date: Thu, 27 Dec 2018 12:38:45 +0900<br>
 <br>
 =C2=A0On 2018/12/26 15:50, <a href=3D"mailto:aravind.ss1094@gmail.com" targ=
 et=3D"_blank" rel=3D"noreferrer">aravind.ss1094@gmail.com</a> wrote:<br>
 =C2=A0&gt;&gt; Number:=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A053814<br>
 =C2=A0&gt;&gt; Category:=C2=A0 =C2=A0 =C2=A0 =C2=A0kern<br>
 =C2=A0&gt;&gt; Synopsis:=C2=A0 =C2=A0 =C2=A0 =C2=A0wm0 device timeout in ne=
 tbsd 7.1<br>
 =C2=A0&gt;&gt; Confidential:=C2=A0 =C2=A0no<br>
 =C2=A0&gt;&gt; Severity:=C2=A0 =C2=A0 =C2=A0 =C2=A0serious<br>
 =C2=A0&gt;&gt; Priority:=C2=A0 =C2=A0 =C2=A0 =C2=A0medium<br>
 =C2=A0&gt;&gt; Responsible:=C2=A0 =C2=A0 kern-bug-people<br>
 =C2=A0&gt;&gt; State:=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 open<br>
 =C2=A0&gt;&gt; Class:=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 sw-bug<br>
 =C2=A0&gt;&gt; Submitter-Id:=C2=A0 =C2=A0net<br>
 =C2=A0&gt;&gt; Arrival-Date:=C2=A0 =C2=A0Wed Dec 26 06:50:00 +0000 2018<br>
 =C2=A0&gt;&gt; Originator:=C2=A0 =C2=A0 =C2=A0Aravind Mani<br>
 =C2=A0&gt;&gt; Release:=C2=A0 =C2=A0 =C2=A0 =C2=A0 netbsd 7.1<br>
 =C2=A0&gt;&gt; Organization:<br>
 =C2=A0&gt; private organization<br>
 =C2=A0&gt;&gt; Environment:<br>
 =C2=A0&gt; chip type: I354<br>
 =C2=A0&gt;&gt; Description:<br>
 =C2=A0&gt; We use WM_T_I354 chip type.When we reload continuously,we could =
 able to observe device timeout issue. wm_init(),wm_reset() doesn&#39;t help=
  to recover from problem state.The only way to recover is to reload the swi=
 tch.There was no initialization error.<br>
 =C2=A0&gt;&gt;From wm_print_stats() and wm_pkt_stats(),i don&#39;t see any =
 value in the registers listed and the packets are not hitting the hardware.=
 <br>
 =C2=A0&gt; wm_reset also didn&#39;t help to recover the issue.<br>
 =C2=A0&gt; <br>
 =C2=A0&gt; Do you need any other output to investigate further?<br>
 =C2=A0&gt; Is there any other way to recover from this issue?.<br>
 =C2=A0&gt; Is there any other fix has been done around this area?.<br>
 =C2=A0&gt; <br>
 =C2=A0&gt; <br>
 =C2=A0&gt; <br>
 =C2=A0&gt;&gt; How-To-Repeat:<br>
 =C2=A0&gt; Reload the switch continuously that runs with NetBSD 7.1.<br>
 =C2=A0&gt;&gt; Fix:<br>
 =C2=A0&gt; <br>
 <br>
 =C2=A0 =C2=A0Are you using modified version of if_wm.c? It has neither wm_p=
 rint_stats()<br>
 =C2=A0nor wm_pkt_stats().<br>
 <br>
 =C2=A0&gt; Do you need any other output to investigate further?<br>
 <br>
 =C2=A0wm(4) has WM_EVENT_COUNTERS option, so it would be good to<br>
 =C2=A0add &quot;options WM_EVENT_COUNTERS&quot; into your kernel configurat=
 ion<br>
 =C2=A0file and see vmstat -e.<br>
 <br>
 =C2=A0&gt; Reload the switch continuously that runs with NetBSD 7.1.<br>
 <br>
 =C2=A0It&#39;s little hard to know what triggers the problem because<br>
 =C2=A0I don&#39;t know what your switch implementation do in the reload.<br=
 >
 <br>
 =C2=A0I have SGMII based C2000 machines. I&#39;ve not tested on others<br>
 =C2=A0(e.g. KX, PCIe SERDES or GMII). It would be good to check your<br>
 =C2=A0PHY configuration and/or status if your system is not SGMII based.<br=
 >
 <br>
 <br>
 =C2=A0-- <br>
 =C2=A0-----------------------------------------------<br>
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 SAITOH Masan=
 obu (<a href=3D"mailto:msaitoh@execsw.org" target=3D"_blank" rel=3D"norefer=
 rer">msaitoh@execsw.org</a><br>
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
 =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0<a href=3D"mailto:msait=
 oh@netbsd.org" target=3D"_blank" rel=3D"noreferrer">msaitoh@netbsd.org</a>)=
 <br>
 <br>
 </blockquote></div>

 --000000000000331cd7057e4db69c--

From: David Holland <dholland-bugs@netbsd.org>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: kern/53814: wm0 device timeout in netbsd 7.1
Date: Mon, 21 Jan 2019 02:10:28 +0000

 Not sent to gnats.
 (gnats traffic should be sent to gnats-bugs@; sometimes this needs to
 be set explicitly if replying to your own postings)

    ------

 From: Aravind M <aravind.ss1094@gmail.com>
 To: kern-bug-people@netbsd.org, gnats-admin@netbsd.org, netbsd-bugs@netbsd.org
 Subject: Re: kern/53814: wm0 device timeout in netbsd 7.1
 Date: Wed, 16 Jan 2019 07:59:25 +0530

 Hi Team,

 Thanks for your patience and assistance on this case.
 We've not removed "wm_pkt_stats" and "wm_print_stats" in NetBSD 7.1 and we
 use WM_T_I354 chip type.
 I've attached the output you've requested. I've taken the kernel live core
 last time when we faced this issue and the WM PHY was active.
 wm_reset doesn't help in to recover the issue state and device timeout log
 keeps on piling after wm_reset.
 Please let me know if any further details is needed.

 Regards,
 Aravind M.

 On Mon, Dec 31, 2018 at 2:40 PM Aravind M <aravind.ss1094@gmail.com> wrote:


 -- 

 with Regards,
 Aravind.

 SStk-1 # vmstat -e
 event                                         total     rate type
 bus_dma loads                              95451577      319 misc
 vmcmd kills                                     661        0 misc
 vmcmd calls                                    3731        0 misc
 vmem static_bt_inuse                            200        0 misc
 vmem static_bt_count                            200        0 misc
 TLB shootdown                                182842        0 intr
 cpu0 runqueue pull                         16763601       56 misc
 cpu0 runqueue push                           218455        0 misc
 cpu0 runqueue stay                         29807214       99 misc
 cpu0 runqueue localize                    199719304      669 misc
 softint net/0                               1172158        3 misc
 softint net block/0                           46424        0 misc
 softint bio/0                                  6245        0 misc
 softint bio block/0                               4        0 misc
 softint clk/0                              29819349       99 misc
 softint clk block/0                          145137        0 misc
 softint ser/0                                 44794        0 misc
 callout late/0                                38366        0 misc
 crosscall unicast                                11        0 misc
 crosscall broadcast                               4        0 misc
 namecache entries collected                   13850        0 misc
 namecache under scan target                  298154        0 misc
 cpu0 timer                                 29826661       99 intr
 cpu0 generic IPI                             548755        1 misc
 cpu0 FPU synch IPI                             3116        0 misc
 cpu0 kpreempt IPI                            235125        0 misc
 cpu1 runqueue pull                         18640375       62 misc
 cpu1 runqueue push                          2168053        7 misc
 cpu1 runqueue stay                         30124219      100 misc
 cpu1 runqueue localize                    158923916      532 misc
 softint net/1                                   365        0 misc
 softint net block/1                             360        0 misc
 softint clk/1                              29817170       99 misc
 softint clk block/1                           28745        0 misc
 softint ser/1                                  8658        0 misc
 callout late/1                                18516        0 misc
 cpu1 timer                                 29826661       99 misc
 cpu1 FPU synch IPI                             4340        0 misc
 cpu1 kpreempt IPI                            173706        0 misc
 ioapic0 pin 20                               172536        0 intr
 wm0 txsstall                                   1088        0 misc
 wm0 txdw                                     183747        0 intr
 wm0 txseg0                                   255914        0 misc
 ioapic0 pin 23                                   18        0 intr
 ioapic0 pin 19                                 6797        0 intr
 ioapic0 pin 4                                 33936        0 intr
 kpreempt defer: critical section               7776        0 misc
 kpreempt defer: kernel_lock                 2793374        9 misc
 kpreempt immediate                           493760        1 misc


 SStk-1 # sysctl -w ddb.command="call wm_pkt_stats(0)"
 Total Pkts Recv     =0
 Missed Pkts Recv    =0
 Good Pkts Recv      =0
 No Buff Pkts Recv   =0
 Mgmt Pkt Recv       =0
 Mgmt Buff Drop Recv =0
 Interrupt Assertion =80

 wm_print_stats:

 0x4000 : 0
 0x4004 : 0
 0x4008 : 0
 0x400c : 0
 0x4010 : 0
 0x4014 : 0
 0x4018 : 0
 0x401c : 0
 0x4020 : 0
 0x4024 : 0
 0x4028 : 0
 0x402c : 0
 0x4030 : 0
 0x4034 : 0
 0x4038 : 0
 0x403c : 0
 0x4040 : 0
 0x4044 : 0
 0x4048 : 0
 0x404c : 0
 0x4050 : 0
 0x4054 : 0
 0x4058 : 0
 0x405c : 0
 0x4060 : 0
 0x4064 : 0
 0x4068 : 0
 0x406c : 0
 0x4070 : 0
 0x4074 : 0
 0x4078 : 0
 0x407c : 0
 0x4080 : 0
 0x4084 : 0
 0x4088 : 0
 0x408c : 0
 0x4090 : 0
 0x4094 : 0
 0x4098 : 0
 0x409c : 0
 0x40a0 : 0
 0x40a4 : 0
 0x40a8 : 0
 0x40ac : 0
 0x40b0 : 0
 0x40b4 : 0
 0x40b8 : 0
 0x40bc : 0
 0x40c0 : 0
 0x40c4 : 0
 0x40c8 : 0
 0x40cc : 0
 0x40d0 : 0
 0x40d4 : 0
 0x40d8 : 0
 0x40dc : 0
 0x40e0 : 0
 0x40e4 : 0
 0x40e8 : 0
 0x40ec : 0
 0x40f0 : 0
 0x40f4 : 0
 0x40f8 : 0
 0x40fc : 0
 0x4100 : 0x24
 0x4104 : 0
 0x4108 : 0
 0x410c : 0
 0x4110 : 0
 0x4114 : 0
 0x4118 : 0
 0x411c : 0
 0x4120 : 0
 0x4124 : 0
 0x4128 : 0
 0x412c : 0
 0x4130 : 0
 0x4134 : 0
 0x4138 : 0
 0x413c : 0
 0x4140 : 0
 0x4144 : 0
 0x4148 : 0
 0x414c : 0
 0x4150 : 0
 0x4154 : 0





From: Aravind M <aravind.ss1094@gmail.com>
To: gnats-bugs@netbsd.org
Cc: kern-bug-people@netbsd.org, gnats-admin@netbsd.org, netbsd-bugs@netbsd.org
Subject: Re: kern/53814: wm0 device timeout in netbsd 7.1
Date: Wed, 23 Jan 2019 10:09:42 +0530

 --000000000000621398058018afda
 Content-Type: text/plain; charset="UTF-8"

 Hi Team,

 Is there any update on this case?.

 Regards,
 Aravind.

 On Mon, Jan 21, 2019 at 7:45 AM David Holland <dholland-bugs@netbsd.org>
 wrote:

 > The following reply was made to PR kern/53814; it has been noted by GNATS.
 >
 > From: David Holland <dholland-bugs@netbsd.org>
 > To: gnats-bugs@netbsd.org
 > Cc:
 > Subject: Re: kern/53814: wm0 device timeout in netbsd 7.1
 > Date: Mon, 21 Jan 2019 02:10:28 +0000
 >
 >  Not sent to gnats.
 >  (gnats traffic should be sent to gnats-bugs@; sometimes this needs to
 >  be set explicitly if replying to your own postings)
 >
 >     ------
 >
 >  From: Aravind M <aravind.ss1094@gmail.com>
 >  To: kern-bug-people@netbsd.org, gnats-admin@netbsd.org,
 > netbsd-bugs@netbsd.org
 >  Subject: Re: kern/53814: wm0 device timeout in netbsd 7.1
 >  Date: Wed, 16 Jan 2019 07:59:25 +0530
 >
 >  Hi Team,
 >
 >  Thanks for your patience and assistance on this case.
 >  We've not removed "wm_pkt_stats" and "wm_print_stats" in NetBSD 7.1 and we
 >  use WM_T_I354 chip type.
 >  I've attached the output you've requested. I've taken the kernel live core
 >  last time when we faced this issue and the WM PHY was active.
 >  wm_reset doesn't help in to recover the issue state and device timeout log
 >  keeps on piling after wm_reset.
 >  Please let me know if any further details is needed.
 >
 >  Regards,
 >  Aravind M.
 >
 >  On Mon, Dec 31, 2018 at 2:40 PM Aravind M <aravind.ss1094@gmail.com>
 > wrote:
 >
 >
 >  --
 >
 >  with Regards,
 >  Aravind.
 >
 >  SStk-1 # vmstat -e
 >  event                                         total     rate type
 >  bus_dma loads                              95451577      319 misc
 >  vmcmd kills                                     661        0 misc
 >  vmcmd calls                                    3731        0 misc
 >  vmem static_bt_inuse                            200        0 misc
 >  vmem static_bt_count                            200        0 misc
 >  TLB shootdown                                182842        0 intr
 >  cpu0 runqueue pull                         16763601       56 misc
 >  cpu0 runqueue push                           218455        0 misc
 >  cpu0 runqueue stay                         29807214       99 misc
 >  cpu0 runqueue localize                    199719304      669 misc
 >  softint net/0                               1172158        3 misc
 >  softint net block/0                           46424        0 misc
 >  softint bio/0                                  6245        0 misc
 >  softint bio block/0                               4        0 misc
 >  softint clk/0                              29819349       99 misc
 >  softint clk block/0                          145137        0 misc
 >  softint ser/0                                 44794        0 misc
 >  callout late/0                                38366        0 misc
 >  crosscall unicast                                11        0 misc
 >  crosscall broadcast                               4        0 misc
 >  namecache entries collected                   13850        0 misc
 >  namecache under scan target                  298154        0 misc
 >  cpu0 timer                                 29826661       99 intr
 >  cpu0 generic IPI                             548755        1 misc
 >  cpu0 FPU synch IPI                             3116        0 misc
 >  cpu0 kpreempt IPI                            235125        0 misc
 >  cpu1 runqueue pull                         18640375       62 misc
 >  cpu1 runqueue push                          2168053        7 misc
 >  cpu1 runqueue stay                         30124219      100 misc
 >  cpu1 runqueue localize                    158923916      532 misc
 >  softint net/1                                   365        0 misc
 >  softint net block/1                             360        0 misc
 >  softint clk/1                              29817170       99 misc
 >  softint clk block/1                           28745        0 misc
 >  softint ser/1                                  8658        0 misc
 >  callout late/1                                18516        0 misc
 >  cpu1 timer                                 29826661       99 misc
 >  cpu1 FPU synch IPI                             4340        0 misc
 >  cpu1 kpreempt IPI                            173706        0 misc
 >  ioapic0 pin 20                               172536        0 intr
 >  wm0 txsstall                                   1088        0 misc
 >  wm0 txdw                                     183747        0 intr
 >  wm0 txseg0                                   255914        0 misc
 >  ioapic0 pin 23                                   18        0 intr
 >  ioapic0 pin 19                                 6797        0 intr
 >  ioapic0 pin 4                                 33936        0 intr
 >  kpreempt defer: critical section               7776        0 misc
 >  kpreempt defer: kernel_lock                 2793374        9 misc
 >  kpreempt immediate                           493760        1 misc
 >
 >
 >  SStk-1 # sysctl -w ddb.command="call wm_pkt_stats(0)"
 >  Total Pkts Recv     =0
 >  Missed Pkts Recv    =0
 >  Good Pkts Recv      =0
 >  No Buff Pkts Recv   =0
 >  Mgmt Pkt Recv       =0
 >  Mgmt Buff Drop Recv =0
 >  Interrupt Assertion =80
 >
 >  wm_print_stats:
 >
 >  0x4000 : 0
 >  0x4004 : 0
 >  0x4008 : 0
 >  0x400c : 0
 >  0x4010 : 0
 >  0x4014 : 0
 >  0x4018 : 0
 >  0x401c : 0
 >  0x4020 : 0
 >  0x4024 : 0
 >  0x4028 : 0
 >  0x402c : 0
 >  0x4030 : 0
 >  0x4034 : 0
 >  0x4038 : 0
 >  0x403c : 0
 >  0x4040 : 0
 >  0x4044 : 0
 >  0x4048 : 0
 >  0x404c : 0
 >  0x4050 : 0
 >  0x4054 : 0
 >  0x4058 : 0
 >  0x405c : 0
 >  0x4060 : 0
 >  0x4064 : 0
 >  0x4068 : 0
 >  0x406c : 0
 >  0x4070 : 0
 >  0x4074 : 0
 >  0x4078 : 0
 >  0x407c : 0
 >  0x4080 : 0
 >  0x4084 : 0
 >  0x4088 : 0
 >  0x408c : 0
 >  0x4090 : 0
 >  0x4094 : 0
 >  0x4098 : 0
 >  0x409c : 0
 >  0x40a0 : 0
 >  0x40a4 : 0
 >  0x40a8 : 0
 >  0x40ac : 0
 >  0x40b0 : 0
 >  0x40b4 : 0
 >  0x40b8 : 0
 >  0x40bc : 0
 >  0x40c0 : 0
 >  0x40c4 : 0
 >  0x40c8 : 0
 >  0x40cc : 0
 >  0x40d0 : 0
 >  0x40d4 : 0
 >  0x40d8 : 0
 >  0x40dc : 0
 >  0x40e0 : 0
 >  0x40e4 : 0
 >  0x40e8 : 0
 >  0x40ec : 0
 >  0x40f0 : 0
 >  0x40f4 : 0
 >  0x40f8 : 0
 >  0x40fc : 0
 >  0x4100 : 0x24
 >  0x4104 : 0
 >  0x4108 : 0
 >  0x410c : 0
 >  0x4110 : 0
 >  0x4114 : 0
 >  0x4118 : 0
 >  0x411c : 0
 >  0x4120 : 0
 >  0x4124 : 0
 >  0x4128 : 0
 >  0x412c : 0
 >  0x4130 : 0
 >  0x4134 : 0
 >  0x4138 : 0
 >  0x413c : 0
 >  0x4140 : 0
 >  0x4144 : 0
 >  0x4148 : 0
 >  0x414c : 0
 >  0x4150 : 0
 >  0x4154 : 0
 >
 >
 >
 >
 >
 >

 -- 

 Regards,
 Aravind.

 --000000000000621398058018afda
 Content-Type: text/html; charset="UTF-8"
 Content-Transfer-Encoding: base64

 PGRpdiBkaXI9Imx0ciI+SGkgVGVhbSw8ZGl2Pjxicj48L2Rpdj48ZGl2PklzIHRoZXJlIGFueSB1
 cGRhdGUgb27CoHRoaXMgY2FzZT8uPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5SZWdhcmRzLDwv
 ZGl2PjxkaXY+QXJhdmluZC48L2Rpdj48L2Rpdj48YnI+PGRpdiBjbGFzcz0iZ21haWxfcXVvdGUi
 PjxkaXYgZGlyPSJsdHIiIGNsYXNzPSJnbWFpbF9hdHRyIj5PbiBNb24sIEphbiAyMSwgMjAxOSBh
 dCA3OjQ1IEFNIERhdmlkIEhvbGxhbmQgJmx0OzxhIGhyZWY9Im1haWx0bzpkaG9sbGFuZC1idWdz
 QG5ldGJzZC5vcmciPmRob2xsYW5kLWJ1Z3NAbmV0YnNkLm9yZzwvYT4mZ3Q7IHdyb3RlOjxicj48
 L2Rpdj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MHB4IDBw
 eCAwcHggMC44ZXg7Ym9yZGVyLWxlZnQ6MXB4IHNvbGlkIHJnYigyMDQsMjA0LDIwNCk7cGFkZGlu
 Zy1sZWZ0OjFleCI+VGhlIGZvbGxvd2luZyByZXBseSB3YXMgbWFkZSB0byBQUiBrZXJuLzUzODE0
 OyBpdCBoYXMgYmVlbiBub3RlZCBieSBHTkFUUy48YnI+DQo8YnI+DQpGcm9tOiBEYXZpZCBIb2xs
 YW5kICZsdDs8YSBocmVmPSJtYWlsdG86ZGhvbGxhbmQtYnVnc0BuZXRic2Qub3JnIiB0YXJnZXQ9
 Il9ibGFuayI+ZGhvbGxhbmQtYnVnc0BuZXRic2Qub3JnPC9hPiZndDs8YnI+DQpUbzogPGEgaHJl
 Zj0ibWFpbHRvOmduYXRzLWJ1Z3NAbmV0YnNkLm9yZyIgdGFyZ2V0PSJfYmxhbmsiPmduYXRzLWJ1
 Z3NAbmV0YnNkLm9yZzwvYT48YnI+DQpDYzogPGJyPg0KU3ViamVjdDogUmU6IGtlcm4vNTM4MTQ6
 IHdtMCBkZXZpY2UgdGltZW91dCBpbiBuZXRic2QgNy4xPGJyPg0KRGF0ZTogTW9uLCAyMSBKYW4g
 MjAxOSAwMjoxMDoyOCArMDAwMDxicj4NCjxicj4NCsKgTm90IHNlbnQgdG8gZ25hdHMuPGJyPg0K
 wqAoZ25hdHMgdHJhZmZpYyBzaG91bGQgYmUgc2VudCB0byBnbmF0cy1idWdzQDsgc29tZXRpbWVz
 IHRoaXMgbmVlZHMgdG88YnI+DQrCoGJlIHNldCBleHBsaWNpdGx5IGlmIHJlcGx5aW5nIHRvIHlv
 dXIgb3duIHBvc3RpbmdzKTxicj4NCjxicj4NCsKgIMKgIC0tLS0tLTxicj4NCjxicj4NCsKgRnJv
 bTogQXJhdmluZCBNICZsdDs8YSBocmVmPSJtYWlsdG86YXJhdmluZC5zczEwOTRAZ21haWwuY29t
 IiB0YXJnZXQ9Il9ibGFuayI+YXJhdmluZC5zczEwOTRAZ21haWwuY29tPC9hPiZndDs8YnI+DQrC
 oFRvOiA8YSBocmVmPSJtYWlsdG86a2Vybi1idWctcGVvcGxlQG5ldGJzZC5vcmciIHRhcmdldD0i
 X2JsYW5rIj5rZXJuLWJ1Zy1wZW9wbGVAbmV0YnNkLm9yZzwvYT4sIDxhIGhyZWY9Im1haWx0bzpn
 bmF0cy1hZG1pbkBuZXRic2Qub3JnIiB0YXJnZXQ9Il9ibGFuayI+Z25hdHMtYWRtaW5AbmV0YnNk
 Lm9yZzwvYT4sIDxhIGhyZWY9Im1haWx0bzpuZXRic2QtYnVnc0BuZXRic2Qub3JnIiB0YXJnZXQ9
 Il9ibGFuayI+bmV0YnNkLWJ1Z3NAbmV0YnNkLm9yZzwvYT48YnI+DQrCoFN1YmplY3Q6IFJlOiBr
 ZXJuLzUzODE0OiB3bTAgZGV2aWNlIHRpbWVvdXQgaW4gbmV0YnNkIDcuMTxicj4NCsKgRGF0ZTog
 V2VkLCAxNiBKYW4gMjAxOSAwNzo1OToyNSArMDUzMDxicj4NCjxicj4NCsKgSGkgVGVhbSw8YnI+
 DQo8YnI+DQrCoFRoYW5rcyBmb3IgeW91ciBwYXRpZW5jZSBhbmQgYXNzaXN0YW5jZSBvbiB0aGlz
 IGNhc2UuPGJyPg0KwqBXZSYjMzk7dmUgbm90IHJlbW92ZWQgJnF1b3Q7d21fcGt0X3N0YXRzJnF1
 b3Q7IGFuZCAmcXVvdDt3bV9wcmludF9zdGF0cyZxdW90OyBpbiBOZXRCU0QgNy4xIGFuZCB3ZTxi
 cj4NCsKgdXNlIFdNX1RfSTM1NCBjaGlwIHR5cGUuPGJyPg0KwqBJJiMzOTt2ZSBhdHRhY2hlZCB0
 aGUgb3V0cHV0IHlvdSYjMzk7dmUgcmVxdWVzdGVkLiBJJiMzOTt2ZSB0YWtlbiB0aGUga2VybmVs
 IGxpdmUgY29yZTxicj4NCsKgbGFzdCB0aW1lIHdoZW4gd2UgZmFjZWQgdGhpcyBpc3N1ZSBhbmQg
 dGhlIFdNIFBIWSB3YXMgYWN0aXZlLjxicj4NCsKgd21fcmVzZXQgZG9lc24mIzM5O3QgaGVscCBp
 biB0byByZWNvdmVyIHRoZSBpc3N1ZSBzdGF0ZSBhbmQgZGV2aWNlIHRpbWVvdXQgbG9nPGJyPg0K
 wqBrZWVwcyBvbiBwaWxpbmcgYWZ0ZXIgd21fcmVzZXQuPGJyPg0KwqBQbGVhc2UgbGV0IG1lIGtu
 b3cgaWYgYW55IGZ1cnRoZXIgZGV0YWlscyBpcyBuZWVkZWQuPGJyPg0KPGJyPg0KwqBSZWdhcmRz
 LDxicj4NCsKgQXJhdmluZCBNLjxicj4NCjxicj4NCsKgT24gTW9uLCBEZWMgMzEsIDIwMTggYXQg
 Mjo0MCBQTSBBcmF2aW5kIE0gJmx0OzxhIGhyZWY9Im1haWx0bzphcmF2aW5kLnNzMTA5NEBnbWFp
 bC5jb20iIHRhcmdldD0iX2JsYW5rIj5hcmF2aW5kLnNzMTA5NEBnbWFpbC5jb208L2E+Jmd0OyB3
 cm90ZTo8YnI+DQo8YnI+DQo8YnI+DQrCoC0tIDxicj4NCjxicj4NCsKgd2l0aCBSZWdhcmRzLDxi
 cj4NCsKgQXJhdmluZC48YnI+DQo8YnI+DQrCoFNTdGstMSAjIHZtc3RhdCAtZTxicj4NCsKgZXZl
 bnTCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oCDCoCDCoHRvdGFswqAgwqAgwqByYXRlIHR5cGU8YnI+DQrCoGJ1c19kbWEgbG9hZHPCoCDCoCDC
 oCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCA5NTQ1MTU3N8KgIMKgIMKgIDMx
 OSBtaXNjPGJyPg0KwqB2bWNtZCBraWxsc8KgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgNjYxwqAgwqAgwqAgwqAgMCBtaXNjPGJyPg0KwqB2bWNt
 ZCBjYWxsc8KgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIDM3MzHCoCDCoCDCoCDCoCAwIG1pc2M8YnI+DQrCoHZtZW0gc3RhdGljX2J0X2ludXNlwqAg
 wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMjAwwqAgwqAgwqAgwqAgMCBt
 aXNjPGJyPg0KwqB2bWVtIHN0YXRpY19idF9jb3VudMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIDIwMMKgIMKgIMKgIMKgIDAgbWlzYzxicj4NCsKgVExCIHNob290ZG93
 bsKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDE4Mjg0MsKg
 IMKgIMKgIMKgIDAgaW50cjxicj4NCsKgY3B1MCBydW5xdWV1ZSBwdWxswqAgwqAgwqAgwqAgwqAg
 wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAxNjc2MzYwMcKgIMKgIMKgIMKgNTYgbWlzYzxicj4NCsKg
 Y3B1MCBydW5xdWV1ZSBwdXNowqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAg
 wqAyMTg0NTXCoCDCoCDCoCDCoCAwIG1pc2M8YnI+DQrCoGNwdTAgcnVucXVldWUgc3RhecKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgMjk4MDcyMTTCoCDCoCDCoCDCoDk5IG1p
 c2M8YnI+DQrCoGNwdTAgcnVucXVldWUgbG9jYWxpemXCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oCDCoCAxOTk3MTkzMDTCoCDCoCDCoCA2NjkgbWlzYzxicj4NCsKgc29mdGludCBuZXQvMMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgMTE3MjE1OMKgIMKgIMKg
 IMKgIDMgbWlzYzxicj4NCsKgc29mdGludCBuZXQgYmxvY2svMMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgNDY0MjTCoCDCoCDCoCDCoCAwIG1pc2M8YnI+DQrCoHNvZnRp
 bnQgYmlvLzDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oCA2MjQ1wqAgwqAgwqAgwqAgMCBtaXNjPGJyPg0KwqBzb2Z0aW50IGJpbyBibG9jay8wwqAgwqAg
 wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqA0wqAgwqAgwqAgwqAgMCBt
 aXNjPGJyPg0KwqBzb2Z0aW50IGNsay8wwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAg
 wqAgwqAgwqAgwqAgMjk4MTkzNDnCoCDCoCDCoCDCoDk5IG1pc2M8YnI+DQrCoHNvZnRpbnQgY2xr
 IGJsb2NrLzDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAxNDUxMzfCoCDC
 oCDCoCDCoCAwIG1pc2M8YnI+DQrCoHNvZnRpbnQgc2VyLzDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoDQ0Nzk0wqAgwqAgwqAgwqAgMCBtaXNjPGJyPg0K
 wqBjYWxsb3V0IGxhdGUvMMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIMKgIDM4MzY2wqAgwqAgwqAgwqAgMCBtaXNjPGJyPg0KwqBjcm9zc2NhbGwgdW5pY2FzdMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDExwqAgwqAgwqAg
 wqAgMCBtaXNjPGJyPg0KwqBjcm9zc2NhbGwgYnJvYWRjYXN0wqAgwqAgwqAgwqAgwqAgwqAgwqAg
 wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqA0wqAgwqAgwqAgwqAgMCBtaXNjPGJyPg0KwqBuYW1l
 Y2FjaGUgZW50cmllcyBjb2xsZWN0ZWTCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoDEzODUw
 wqAgwqAgwqAgwqAgMCBtaXNjPGJyPg0KwqBuYW1lY2FjaGUgdW5kZXIgc2NhbiB0YXJnZXTCoCDC
 oCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAyOTgxNTTCoCDCoCDCoCDCoCAwIG1pc2M8YnI+DQrCoGNw
 dTAgdGltZXLCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oDI5ODI2NjYxwqAgwqAgwqAgwqA5OSBpbnRyPGJyPg0KwqBjcHUwIGdlbmVyaWMgSVBJwqAgwqAg
 wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqA1NDg3NTXCoCDCoCDCoCDCoCAx
 IG1pc2M8YnI+DQrCoGNwdTAgRlBVIHN5bmNoIElQScKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgMzExNsKgIMKgIMKgIMKgIDAgbWlzYzxicj4NCsKgY3B1MCBrcHJl
 ZW1wdCBJUEnCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAyMzUxMjXC
 oCDCoCDCoCDCoCAwIG1pc2M8YnI+DQrCoGNwdTEgcnVucXVldWUgcHVsbMKgIMKgIMKgIMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgMTg2NDAzNzXCoCDCoCDCoCDCoDYyIG1pc2M8YnI+DQrC
 oGNwdTEgcnVucXVldWUgcHVzaMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IDIxNjgwNTPCoCDCoCDCoCDCoCA3IG1pc2M8YnI+DQrCoGNwdTEgcnVucXVldWUgc3RhecKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgMzAxMjQyMTnCoCDCoCDCoCAxMDAgbWlz
 Yzxicj4NCsKgY3B1MSBydW5xdWV1ZSBsb2NhbGl6ZcKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIDE1ODkyMzkxNsKgIMKgIMKgIDUzMiBtaXNjPGJyPg0KwqBzb2Z0aW50IG5ldC8xwqAgwqAg
 wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAzNjXCoCDCoCDC
 oCDCoCAwIG1pc2M8YnI+DQrCoHNvZnRpbnQgbmV0IGJsb2NrLzHCoCDCoCDCoCDCoCDCoCDCoCDC
 oCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoDM2MMKgIMKgIMKgIMKgIDAgbWlzYzxicj4NCsKgc29m
 dGludCBjbGsvMcKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDI5
 ODE3MTcwwqAgwqAgwqAgwqA5OSBtaXNjPGJyPg0KwqBzb2Z0aW50IGNsayBibG9jay8xwqAgwqAg
 wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAyODc0NcKgIMKgIMKgIMKgIDAgbWlz
 Yzxicj4NCsKgc29mdGludCBzZXIvMcKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIDg2NTjCoCDCoCDCoCDCoCAwIG1pc2M8YnI+DQrCoGNhbGxvdXQgbGF0
 ZS8xwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMTg1MTbC
 oCDCoCDCoCDCoCAwIG1pc2M8YnI+DQrCoGNwdTEgdGltZXLCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoDI5ODI2NjYxwqAgwqAgwqAgwqA5OSBtaXNjPGJy
 Pg0KwqBjcHUxIEZQVSBzeW5jaCBJUEnCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oCDCoCDCoCDCoDQzNDDCoCDCoCDCoCDCoCAwIG1pc2M8YnI+DQrCoGNwdTEga3ByZWVtcHQgSVBJ
 wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMTczNzA2wqAgwqAgwqAg
 wqAgMCBtaXNjPGJyPg0KwqBpb2FwaWMwIHBpbiAyMMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgMTcyNTM2wqAgwqAgwqAgwqAgMCBpbnRyPGJyPg0KwqB3bTAg
 dHhzc3RhbGzCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oCDCoDEwODjCoCDCoCDCoCDCoCAwIG1pc2M8YnI+DQrCoHdtMCB0eGR3wqAgwqAgwqAgwqAgwqAg
 wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAxODM3NDfCoCDCoCDCoCDC
 oCAwIGludHI8YnI+DQrCoHdtMCB0eHNlZzDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oCDCoCDCoCDCoCDCoCDCoCDCoCDCoDI1NTkxNMKgIMKgIMKgIMKgIDAgbWlzYzxicj4NCsKgaW9h
 cGljMCBwaW4gMjPCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
 oCDCoCDCoDE4wqAgwqAgwqAgwqAgMCBpbnRyPGJyPg0KwqBpb2FwaWMwIHBpbiAxOcKgIMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgNjc5N8KgIMKgIMKgIMKg
 IDAgaW50cjxicj4NCsKgaW9hcGljMCBwaW4gNMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
 IMKgIMKgIMKgIMKgIMKgIMKgIMKgMzM5MzbCoCDCoCDCoCDCoCAwIGludHI8YnI+DQrCoGtwcmVl
 bXB0IGRlZmVyOiBjcml0aWNhbCBzZWN0aW9uwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqA3Nzc2wqAg
 wqAgwqAgwqAgMCBtaXNjPGJyPg0KwqBrcHJlZW1wdCBkZWZlcjoga2VybmVsX2xvY2vCoCDCoCDC
 oCDCoCDCoCDCoCDCoCDCoCDCoDI3OTMzNzTCoCDCoCDCoCDCoCA5IG1pc2M8YnI+DQrCoGtwcmVl
 bXB0IGltbWVkaWF0ZcKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgNDkz
 NzYwwqAgwqAgwqAgwqAgMSBtaXNjPGJyPg0KPGJyPg0KPGJyPg0KwqBTU3RrLTEgIyBzeXNjdGwg
 LXcgZGRiLmNvbW1hbmQ9JnF1b3Q7Y2FsbCB3bV9wa3Rfc3RhdHMoMCkmcXVvdDs8YnI+DQrCoFRv
 dGFsIFBrdHMgUmVjdsKgIMKgIMKgPTA8YnI+DQrCoE1pc3NlZCBQa3RzIFJlY3bCoCDCoCA9MDxi
 cj4NCsKgR29vZCBQa3RzIFJlY3bCoCDCoCDCoCA9MDxicj4NCsKgTm8gQnVmZiBQa3RzIFJlY3bC
 oCDCoD0wPGJyPg0KwqBNZ210IFBrdCBSZWN2wqAgwqAgwqAgwqA9MDxicj4NCsKgTWdtdCBCdWZm
 IERyb3AgUmVjdiA9MDxicj4NCsKgSW50ZXJydXB0IEFzc2VydGlvbiA9ODA8YnI+DQo8YnI+DQrC
 oHdtX3ByaW50X3N0YXRzOjxicj4NCjxicj4NCsKgMHg0MDAwIDogMDxicj4NCsKgMHg0MDA0IDog
 MDxicj4NCsKgMHg0MDA4IDogMDxicj4NCsKgMHg0MDBjIDogMDxicj4NCsKgMHg0MDEwIDogMDxi
 cj4NCsKgMHg0MDE0IDogMDxicj4NCsKgMHg0MDE4IDogMDxicj4NCsKgMHg0MDFjIDogMDxicj4N
 CsKgMHg0MDIwIDogMDxicj4NCsKgMHg0MDI0IDogMDxicj4NCsKgMHg0MDI4IDogMDxicj4NCsKg
 MHg0MDJjIDogMDxicj4NCsKgMHg0MDMwIDogMDxicj4NCsKgMHg0MDM0IDogMDxicj4NCsKgMHg0
 MDM4IDogMDxicj4NCsKgMHg0MDNjIDogMDxicj4NCsKgMHg0MDQwIDogMDxicj4NCsKgMHg0MDQ0
 IDogMDxicj4NCsKgMHg0MDQ4IDogMDxicj4NCsKgMHg0MDRjIDogMDxicj4NCsKgMHg0MDUwIDog
 MDxicj4NCsKgMHg0MDU0IDogMDxicj4NCsKgMHg0MDU4IDogMDxicj4NCsKgMHg0MDVjIDogMDxi
 cj4NCsKgMHg0MDYwIDogMDxicj4NCsKgMHg0MDY0IDogMDxicj4NCsKgMHg0MDY4IDogMDxicj4N
 CsKgMHg0MDZjIDogMDxicj4NCsKgMHg0MDcwIDogMDxicj4NCsKgMHg0MDc0IDogMDxicj4NCsKg
 MHg0MDc4IDogMDxicj4NCsKgMHg0MDdjIDogMDxicj4NCsKgMHg0MDgwIDogMDxicj4NCsKgMHg0
 MDg0IDogMDxicj4NCsKgMHg0MDg4IDogMDxicj4NCsKgMHg0MDhjIDogMDxicj4NCsKgMHg0MDkw
 IDogMDxicj4NCsKgMHg0MDk0IDogMDxicj4NCsKgMHg0MDk4IDogMDxicj4NCsKgMHg0MDljIDog
 MDxicj4NCsKgMHg0MGEwIDogMDxicj4NCsKgMHg0MGE0IDogMDxicj4NCsKgMHg0MGE4IDogMDxi
 cj4NCsKgMHg0MGFjIDogMDxicj4NCsKgMHg0MGIwIDogMDxicj4NCsKgMHg0MGI0IDogMDxicj4N
 CsKgMHg0MGI4IDogMDxicj4NCsKgMHg0MGJjIDogMDxicj4NCsKgMHg0MGMwIDogMDxicj4NCsKg
 MHg0MGM0IDogMDxicj4NCsKgMHg0MGM4IDogMDxicj4NCsKgMHg0MGNjIDogMDxicj4NCsKgMHg0
 MGQwIDogMDxicj4NCsKgMHg0MGQ0IDogMDxicj4NCsKgMHg0MGQ4IDogMDxicj4NCsKgMHg0MGRj
 IDogMDxicj4NCsKgMHg0MGUwIDogMDxicj4NCsKgMHg0MGU0IDogMDxicj4NCsKgMHg0MGU4IDog
 MDxicj4NCsKgMHg0MGVjIDogMDxicj4NCsKgMHg0MGYwIDogMDxicj4NCsKgMHg0MGY0IDogMDxi
 cj4NCsKgMHg0MGY4IDogMDxicj4NCsKgMHg0MGZjIDogMDxicj4NCsKgMHg0MTAwIDogMHgyNDxi
 cj4NCsKgMHg0MTA0IDogMDxicj4NCsKgMHg0MTA4IDogMDxicj4NCsKgMHg0MTBjIDogMDxicj4N
 CsKgMHg0MTEwIDogMDxicj4NCsKgMHg0MTE0IDogMDxicj4NCsKgMHg0MTE4IDogMDxicj4NCsKg
 MHg0MTFjIDogMDxicj4NCsKgMHg0MTIwIDogMDxicj4NCsKgMHg0MTI0IDogMDxicj4NCsKgMHg0
 MTI4IDogMDxicj4NCsKgMHg0MTJjIDogMDxicj4NCsKgMHg0MTMwIDogMDxicj4NCsKgMHg0MTM0
 IDogMDxicj4NCsKgMHg0MTM4IDogMDxicj4NCsKgMHg0MTNjIDogMDxicj4NCsKgMHg0MTQwIDog
 MDxicj4NCsKgMHg0MTQ0IDogMDxicj4NCsKgMHg0MTQ4IDogMDxicj4NCsKgMHg0MTRjIDogMDxi
 cj4NCsKgMHg0MTUwIDogMDxicj4NCsKgMHg0MTU0IDogMDxicj4NCjxicj4NCjxicj4NCjxicj4N
 Cjxicj4NCjxicj4NCjwvYmxvY2txdW90ZT48L2Rpdj48YnIgY2xlYXI9ImFsbCI+PGRpdj48YnI+
 PC9kaXY+LS0gPGJyPjxkaXYgZGlyPSJsdHIiIGNsYXNzPSJnbWFpbF9zaWduYXR1cmUiPjxkaXYg
 ZGlyPSJsdHIiPjxkaXY+PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2IGRpcj0ibHRyIj48ZGl2IGRp
 cj0ibHRyIj48YnI+PGRpdj48ZGl2IHN0eWxlPSJmb250LXNpemU6c21hbGwiPlJlZ2FyZHMsPC9k
 aXY+PGRpdiBzdHlsZT0iZm9udC1zaXplOnNtYWxsIj5BcmF2aW5kLjwvZGl2PjxkaXYgc3R5bGU9
 ImZvbnQtc2l6ZTpzbWFsbCI+PGJyPjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2
 PjwvZGl2PjwvZGl2PjwvZGl2Pg0K
 --000000000000621398058018afda--

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.43 2018/01/16 07:36:43 maya Exp $
$NetBSD: gnats_config.sh,v 1.9 2014/08/02 14:16:04 spz Exp $
Copyright © 1994-2017 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.