NetBSD Problem Report #50267

From www@NetBSD.org  Wed Sep 23 03:05:26 2015
Return-Path: <www@NetBSD.org>
Received: from mail.netbsd.org (mail.netbsd.org [149.20.53.66])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client CN "mail.netbsd.org", Issuer "Postmaster NetBSD.org" (verified OK))
	by mollari.NetBSD.org (Postfix) with ESMTPS id A3D15A5674
	for <gnats-bugs@gnats.NetBSD.org>; Wed, 23 Sep 2015 03:05:26 +0000 (UTC)
Message-Id: <20150923030523.4F44FA6607@mollari.NetBSD.org>
Date: Wed, 23 Sep 2015 03:05:23 +0000 (UTC)
From: donaldcallen@gmail.com
Reply-To: donaldcallen@gmail.com
To: gnats-bugs@NetBSD.org
Subject: 7.0 RC3 will not boot
X-Send-Pr-Version: www-1.0

>Number:         50267
>Category:       kern
>Synopsis:       7.0 RC3 will not boot
>Confidential:   no
>Severity:       critical
>Priority:       high
>Responsible:    kern-bug-people
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Wed Sep 23 03:10:00 +0000 2015
>Originator:     Donald Allen
>Release:        7.0RC3
>Organization:
Retired
>Environment:
>Description:
After reporting a bug earlier today, in which 7.0RC3 locked up on one of my spare machines, I tried installing on a different machine, with a much-different hardware configuration. In this situation, I was able to install the system, but then when I attempt to boot the installed kernel, I get four messages of the form

coretemp[0-3]: workqueue busy: updates stopped

and that is all she wrote; hung. I tried booting with ACPI off and that failed differently -- persistent command timeouts on mpt0 and sd0. I do find it a bit odd that I had no trouble booting the kernel from the install CD.

Here is the dmesg from the machine that exhibited this problem, obtained by booting from the CD and writing the dmesg to a USB key:

Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
    2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015
    The NetBSD Foundation, Inc.  All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
    The Regents of the University of California.  All rights reserved.

NetBSD 7.0_RC3 (GENERIC.201508110747Z)
total memory = 4093 MB
avail memory = 3957 MB
kern.module.path=/stand/amd64/7.0/modules
timecounter: Timecounters tick every 10.000 msec
timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100
LENOVO 6423CTO (ThinkStation S10)
mainbus0 (root)
ACPI: RSDP 0xf68a0 000024 (v02 PTLTD )
ACPI: XSDT 0x9fe6723d 0000A4 (v01 LENOVO TC-2W    060400D0  LTP 00000000)
ACPI: FACP 0x9fe70d8a 0000F4 (v03 INTEL           060400D0 PTL  00000002)
ACPI: DSDT 0x9fe6a3bb 00695B (v01  INTEL B_LAKE-X 060400D0 MSFT 0100000E)
ACPI: FACS 0x9fe71fc0 000040
ACPI: TCPA 0x9fe70e7e 000032 (v01 LENOVO TC-2W    060400D0 PTL  00000000)
ACPI: _MAR 0x9fe70eb0 000030 (v01 Intel  OEMDMAR  060400D0 LOHR 00000001)
ACPI: MCFG 0x9fe70ee0 00003C (v01 PTLTD    MCFG   060400D0  LTP 00000000)
ACPI: HPET 0x9fe70f1c 000038 (v01 PTLTD  HPETTBL  060400D0  LTP 00000001)
ACPI: APIC 0x9fe70f54 000084 (v01 PTLTD  ? APIC   060400D0  LTP 00000000)
ACPI: BOOT 0x9fe70fd8 000028 (v01 PTLTD  $SBFTBL$ 060400D0  LTP 00000001)
ACPI: SSDT 0x9fe68b2d 00025F (v01  PmRef  Cpu0Tst 00003000 INTL 20050228)
ACPI: SSDT 0x9fe68a87 0000A6 (v01  PmRef  Cpu7Tst 00003000 INTL 20050228)
ACPI: SSDT 0x9fe689e1 0000A6 (v01  PmRef  Cpu6Tst 00003000 INTL 20050228)
ACPI: SSDT 0x9fe6893b 0000A6 (v01  PmRef  Cpu5Tst 00003000 INTL 20050228)
ACPI: SSDT 0x9fe68895 0000A6 (v01  PmRef  Cpu4Tst 00003000 INTL 20050228)
ACPI: SSDT 0x9fe687ef 0000A6 (v01  PmRef  Cpu3Tst 00003000 INTL 20050228)
ACPI: SSDT 0x9fe68749 0000A6 (v01  PmRef  Cpu2Tst 00003000 INTL 20050228)
ACPI: SSDT 0x9fe686a3 0000A6 (v01  PmRef  Cpu1Tst 00003000 INTL 20050228)
ACPI: SSDT 0x9fe672e1 0013C2 (v01  PmRef    CpuPm 00003000 INTL 20050228)
ACPI: All ACPI Tables successfully acquired
ioapic0 at mainbus0 apid 4: pa 0xfec00000, version 0x20, 24 pins
cpu0 at mainbus0 apid 0: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz, id 0x6fb
cpu1 at mainbus0 apid 1: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz, id 0x6fb
cpu2 at mainbus0 apid 2: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz, id 0x6fb
cpu3 at mainbus0 apid 3: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz, id 0x6fb
acpi0 at mainbus0: Intel ACPICA 20131218
acpi0: X/RSDT: OemId <LENOVO,TC-2W   ,060400d0>, AslId < LTP,00000000>
ACPI: SSDT 0x9fe68d8c 0001DD (v01  PmRef  Cpu0Ist 00003000 INTL 20050228)
ACPI: SSDT 0x0 0001DD (v01  PmRef  Cpu0Ist 00003000 INTL 20050228)
ACPI: SSDT 0x9fe68f69 00016E (v01  PmRef  Cpu1Ist 00003000 INTL 20050228)
ACPI: SSDT 0x0 00016E (v01  PmRef  Cpu1Ist 00003000 INTL 20050228)
ACPI: SSDT 0x9fe690d7 00016E (v01  PmRef  Cpu2Ist 00003000 INTL 20050228)
ACPI: SSDT 0x0 00016E (v01  PmRef  Cpu2Ist 00003000 INTL 20050228)
ACPI: SSDT 0x9fe69245 00016E (v01  PmRef  Cpu3Ist 00003000 INTL 20050228)
ACPI: SSDT 0x0 00016E (v01  PmRef  Cpu3Ist 00003000 INTL 20050228)
acpi0: SCI interrupting at int 9
timecounter: Timecounter "ACPI-Fast" frequency 3579545 Hz quality 1000
hpet0 at acpi0: high precision event timer (mem 0xfed00000-0xfed00400)
timecounter: Timecounter "hpet0" frequency 14318180 Hz quality 2000
MBRD (PNP0C02) at acpi0 not configured
pcppi1 at acpi0 (SPKR, PNP0800): io 0x61
midi0 at pcppi1: PC speaker
sysbeep0 at pcppi1
attimer1 at acpi0 (TIMR, PNP0100): io 0x40-0x43,0x50-0x53
FWH (INT0800) at acpi0 not configured
COM1 (PNP0501) at acpi0 not configured
FDC (PNP0700) at acpi0 not configured
TPM (BCM0102) at acpi0 not configured
acpibut0 at acpi0 (PWRB, PNP0C0C): ACPI Power Button
ACPI: Enabled 2 GPEs in block 00 to 3F
ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20131218/hwxface-646)
ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20131218/hwxface-646)
attimer1: attached to pcppi1
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
pchb0 at pci0 dev 0 function 0: vendor 0x8086 product 0x29e0 (rev. 0x01)
ppb0 at pci0 dev 1 function 0: vendor 0x8086 product 0x29e1 (rev. 0x01)
ppb0: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x16 @ 5.0GT/s
pci1 at ppb0 bus 1
pci1: i/o space, memory space enabled, rd/line, wr/inv ok
vga0 at pci1 dev 0 function 0: vendor 0x10de product 0x040a (rev. 0xa1)
wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation)
wsmux1: connecting to wsdisplay0
drm at vga0 not configured
uhci0 at pci0 dev 26 function 0: vendor 0x8086 product 0x2937 (rev. 0x02)
uhci0: interrupting at ioapic0 pin 16
usb0 at uhci0: USB revision 1.0
uhci1 at pci0 dev 26 function 1: vendor 0x8086 product 0x2938 (rev. 0x02)
uhci1: interrupting at ioapic0 pin 17
usb1 at uhci1: USB revision 1.0
ehci0 at pci0 dev 26 function 7: vendor 0x8086 product 0x293c (rev. 0x02)
ehci0: interrupting at ioapic0 pin 18
ehci0: EHCI version 1.0
ehci0: companion controllers, 2 ports each: uhci0 uhci1
usb2 at ehci0: USB revision 2.0
hdaudio0 at pci0 dev 27 function 0: HD Audio Controller
hdaudio0: interrupting at ioapic0 pin 16
hdafg0 at hdaudio0: ADI AD1988A
hdafg0: DAC00 6ch: Speaker [Jack]
hdafg0: ADC01 2ch: Line In [Jack], Mic In [Jack]
hdafg0: DAC02 2ch: HP Out [Jack]
hdafg0: DIG03 2ch: SPDIF Out [Jack]
hdafg0: 6ch/2ch 8000Hz 11025Hz 16000Hz 22050Hz 32000Hz 44100Hz 48000Hz 88200Hz 96000Hz 192000Hz PCM16 PCM20 PCM24 AC3
audio0 at hdafg0: full duplex, playback, capture, mmap, independent
ppb1 at pci0 dev 28 function 0: vendor 0x8086 product 0x2940 (rev. 0x02)
ppb1: PCI Express capability version 1 <Root Port of PCI-E Root Complex> x4 @ 2.5GT/s
pci2 at ppb1 bus 5
pci2: i/o space, memory space enabled, rd/line, wr/inv ok
mpt0 at pci2 dev 0 function 0: vendor 0x1000 product 0x0056 (rev. 0x08)
mpt0: interrupting at ioapic0 pin 16
mpt0: Phy 0: Link Rate 3.0 Gbps
mpt0: Phy 1: Link Rate 3.0 Gbps
mpt0: Unknown async event: 0x21
mpt0: Unknown async event: 0x21
mpt0: Unknown async event: 0xb
scsibus0 at mpt0: 112 targets, 8 luns per target
ppb2 at pci0 dev 28 function 4: vendor 0x8086 product 0x2948 (rev. 0x02)
ppb2: PCI Express capability version 1 <Root Port of PCI-E Root Complex> x1 @ 2.5GT/s
pci3 at ppb2 bus 13
pci3: i/o space, memory space enabled, rd/line, wr/inv ok
bge0 at pci3 dev 0 function 0: Broadcom BCM5755 Gigabit Ethernet
bge0: interrupting at ioapic0 pin 16
bge0: HW config 00000155, 00000015, 00002830, 00000000 00000000
bge0: ASIC BCM5755 A2 (0xa002), Ethernet address 00:1e:37:f4:31:c8
bge0: setting short Tx thresholds
brgphy0 at bge0 phy 1: BCM5755 1000BASE-T media interface, rev. 0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
ppb3 at pci0 dev 28 function 5: vendor 0x8086 product 0x294a (rev. 0x02)
ppb3: PCI Express capability version 1 <Root Port of PCI-E Root Complex> x1 @ 2.5GT/s
pci4 at ppb3 bus 15
pci4: i/o space, memory space enabled, rd/line, wr/inv ok
bge1 at pci4 dev 0 function 0: Broadcom BCM5754 Gigabit Ethernet
bge1: interrupting at ioapic0 pin 17
bge1: HW config 00000155, 00000015, 00002830, 00000000 00000000
bge1: ASIC BCM5754/5787 A2 (0xb002), Ethernet address 00:1e:37:f4:31:c9
bge1: setting short Tx thresholds
brgphy1 at bge1 phy 1: BCM5754/5787 1000BASE-T media interface, rev. 0
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
uhci2 at pci0 dev 29 function 0: vendor 0x8086 product 0x2934 (rev. 0x02)
uhci2: interrupting at ioapic0 pin 16
usb3 at uhci2: USB revision 1.0
uhci3 at pci0 dev 29 function 1: vendor 0x8086 product 0x2935 (rev. 0x02)
uhci3: interrupting at ioapic0 pin 17
usb4 at uhci3: USB revision 1.0
uhci4 at pci0 dev 29 function 2: vendor 0x8086 product 0x2936 (rev. 0x02)
uhci4: interrupting at ioapic0 pin 18
usb5 at uhci4: USB revision 1.0
uhci5 at pci0 dev 29 function 3: vendor 0x8086 product 0x2939 (rev. 0x02)
uhci5: interrupting at ioapic0 pin 19
usb6 at uhci5: USB revision 1.0
ehci1 at pci0 dev 29 function 7: vendor 0x8086 product 0x293a (rev. 0x02)
ehci1: interrupting at ioapic0 pin 16
ehci1: EHCI version 1.0
ehci1: companion controllers, 2 ports each: uhci2 uhci3 uhci4 uhci5
usb7 at ehci1: USB revision 2.0
ppb4 at pci0 dev 30 function 0: vendor 0x8086 product 0x244e (rev. 0x92)
pci5 at ppb4 bus 17
pci5: i/o space, memory space enabled
fwohci0 at pci5 dev 10 function 0: vendor 0x104c product 0x8024 (rev. 0x00)
fwohci0: interrupting at ioapic0 pin 22
fwohci0: OHCI version 1.10 (ROM=1)
fwohci0: No. of Isochronous channels is 4.
fwohci0: EUI64 34:39:33:31:00:00:32:bd
fwohci0: Phy 1394a available S400, 3 ports.
fwohci0: Link S400, max_rec 2048 bytes.
ieee1394if0 at fwohci0: IEEE1394 bus
fwip0 at ieee1394if0: IP over IEEE1394
fwohci0: Initiate bus reset
fwohci1 at pci5 dev 13 function 0: vendor 0x104c product 0x8023 (rev. 0x00)
fwohci1: interrupting at ioapic0 pin 21
fwohci1: OHCI version 1.10 (ROM=0)
fwohci1: No. of Isochronous channels is 4.
fwohci1: EUI64 00:06:1b:00:01:98:a5:0e
fwohci1: Phy 1394a available S400, 2 ports.
fwohci1: Link S400, max_rec 2048 bytes.
ieee1394if1 at fwohci1: IEEE1394 bus
fwip1 at ieee1394if1: IP over IEEE1394
fwohci1: Initiate bus reset
ichlpcib0 at pci0 dev 31 function 0: vendor 0x8086 product 0x2916 (rev. 0x02)
timecounter: Timecounter "ichlpcib0" frequency 3579545 Hz quality 1000
ichlpcib0: 24-bit timer
ichlpcib0: TCO (watchdog) timer configured.
piixide0 at pci0 dev 31 function 2: Intel 82801I Serial ATA Controller (ICH9) (rev. 0x02)
piixide0: bus-master DMA support present
piixide0: primary channel configured to compatibility mode
piixide0: primary channel interrupting at ioapic0 pin 14
atabus0 at piixide0 channel 0
piixide0: secondary channel configured to compatibility mode
piixide0: secondary channel interrupting at ioapic0 pin 15
atabus1 at piixide0 channel 1
ichsmb0 at pci0 dev 31 function 3: vendor 0x8086 product 0x2930 (rev. 0x02)
ichsmb0: interrupting at ioapic0 pin 17
iic0 at ichsmb0: I2C bus
piixide1 at pci0 dev 31 function 5: Intel 82801I Serial ATA Controller (ICH9) (rev. 0x02)
piixide1: bus-master DMA support present
piixide1: primary channel wired to native-PCI mode
piixide1: using ioapic0 pin 18 for native-PCI interrupt
atabus2 at piixide1 channel 0
piixide1: secondary channel wired to native-PCI mode
atabus3 at piixide1 channel 1
vendor 0x8086 product 0x2932 (miscellaneous DASP, revision 0x02) at pci0 dev 31 function 6 not configured
isa0 at ichlpcib0
tpm0 at isa0 iomem 0xfed40000-0xfed44fff irq 7: Broadcom BCM0102 rev 0x2
com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
pckbc0 at isa0 port 0x60-0x64
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
acpicpu0 at cpu0: ACPI CPU
acpicpu0: C1: HLT, lat   0 us, pow     0 mW
acpicpu0: P0: FFH, lat  10 us, pow 35000 mW, 2400 MHz
acpicpu0: P1: FFH, lat  10 us, pow 16000 mW, 1600 MHz
acpicpu0: T0: FFH, lat   1 us, pow 16000 mW, 100 %
acpicpu0: T1: FFH, lat   1 us, pow 14000 mW,  88 %
acpicpu0: T2: FFH, lat   1 us, pow 12000 mW,  75 %
acpicpu0: T3: FFH, lat   1 us, pow 10000 mW,  63 %
acpicpu0: T4: FFH, lat   1 us, pow  8000 mW,  50 %
acpicpu0: T5: FFH, lat   1 us, pow  6000 mW,  38 %
acpicpu0: T6: FFH, lat   1 us, pow  4000 mW,  25 %
acpicpu0: T7: FFH, lat   1 us, pow  2000 mW,  13 %
coretemp0 at cpu0: thermal sensor, 1 C resolution, Tjmax=100
acpicpu1 at cpu1: ACPI CPU
coretemp1 at cpu1: thermal sensor, 1 C resolution, Tjmax=100
acpicpu2 at cpu2: ACPI CPU
coretemp2 at cpu2: thermal sensor, 1 C resolution, Tjmax=100
acpicpu3 at cpu3: ACPI CPU
coretemp3 at cpu3: thermal sensor, 1 C resolution, Tjmax=100
fwohci1: BUS reset
fwohci1: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode
ieee1394if1: 1 nodes, maxhop <= 0 cable IRM irm(0) (me)
ieee1394if1: bus manager 0
fwohci0: BUS reset
fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode
ieee1394if0: 1 nodes, maxhop <= 0 cable IRM irm(0) (me)
ieee1394if0: bus manager 0
timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
scsibus0: waiting 2 seconds for devices to settle...
IPsec: Initialized Security Association Processing.
uhub0 at usb1: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhub1 at usb0: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhub2 at usb4: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhub3 at usb3: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
uhub4 at usb7: vendor 0x8086 EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub4: 8 ports with 8 removable, self powered
uhub5 at usb5: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub5: 2 ports with 2 removable, self powered
uhub6 at usb2: vendor 0x8086 EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub6: 4 ports with 4 removable, self powered
uhub7 at usb6: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub7: 2 ports with 2 removable, self powered
fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
sd0 at scsibus0 target 0 lun 0: <LSILOGIC, Logical Volume, 3000> disk fixed
sd0: 271 GB, 278472 cyl, 16 head, 128 sec, 512 bytes/sect x 570310656 sectors
sd0: tagged queueing
uhub8 at uhub4 port 1: vendor 0x05e3 USB2.0 Hub, class 9/0, rev 2.00/32.98, addr 2
uhub8: single transaction translator
uhub8: 4 ports with 4 removable, self powered
uhidev0 at uhub8 port 1 configuration 1 interface 0
uhidev0: vendor 0x04b3 USB Optical Mouse, rev 2.00/2.00, addr 3, iclass 3/1
ums0 at uhidev0: 3 buttons and Z dir
wsmouse0 at ums0 mux 0
uhidev1 at uhub8 port 2 configuration 1 interface 0
uhidev1: CHESEN PS2 to USB Converter, rev 1.10/0.10, addr 4, iclass 3/1
ukbd0 at uhidev1
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uhidev2 at uhub8 port 2 configuration 1 interface 1
uhidev2: CHESEN PS2 to USB Converter, rev 1.10/0.10, addr 4, iclass 3/1
uhidev2: 3 report ids
ums1 at uhidev2 reportid 1: 5 buttons and Z dir
wsmouse1 at ums1 mux 0
uhid0 at uhidev2 reportid 2: input=1, output=0, feature=0
uhid1 at uhidev2 reportid 3: input=2, output=0, feature=0
atapibus0 at atabus0: 2 targets
cd0 at atapibus0 drive 0: <HL-DT-STDVD-RAM GSA-H60N, M0084E11213, CX04> cdrom removable
cd0: 32-bit data port
cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 5 (Ultra/100)
cd0(piixide0:0:0): using PIO mode 4, Ultra-DMA mode 5 (Ultra/100) (using DMA)
Kernelized RAIDframe activated
pad0: outputs: 44100Hz, 16-bit, stereo
audio1 at pad0: half duplex, playback, capture
boot device: cd0
root on cd0a dumps on cd0b
root file system type: cd9660
warning: no /dev/console
umass0 at uhub4 port 7 configuration 1 interface 0
umass0: Kingston DataTraveler 2.0, rev 2.00/1.00, addr 5
umass0: using SCSI over Bulk-Only
scsibus1 at umass0: 2 targets, 1 lun per target
sd1 at scsibus1 target 0 lun 0: <Kingston, DataTraveler 2.0, PMAP> disk removable
sd1: 7445 MB, 1868 cyl, 255 head, 32 sec, 512 bytes/sect x 15248832 sectors
>How-To-Repeat:
This problem is repeatable on this machine. I tried booting it several times and it failed identically each time.
>Fix:

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.39 2013/11/01 18:47:49 spz Exp $
$NetBSD: gnats_config.sh,v 1.8 2006/05/07 09:23:38 tsutsui Exp $
Copyright © 1994-2014 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.