NetBSD Problem Report #16942

Received: (qmail 11070 invoked from network); 21 May 2002 08:32:33 -0000
Message-Id: <20020521083236.7A86A11137@www.netbsd.org>
Date: Tue, 21 May 2002 01:32:36 -0700 (PDT)
From: manu@netbsd.org
Sender: nobody@netbsd.org
Reply-To: manu@netbsd.org
To: gnats-bugs@gnats.netbsd.org
Subject: panic with softdep and quotas
X-Send-Pr-Version: www-1.0

>Number:         16942
>Category:       kern
>Synopsis:       panic with softdep and quotas
>Confidential:   no
>Severity:       critical
>Priority:       low
>Responsible:    kern-bug-people
>State:          closed
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Tue May 21 08:33:00 +0000 2002
>Closed-Date:    Wed Apr 01 04:04:42 +0000 2009
>Last-Modified:  Wed Apr 01 04:04:42 +0000 2009
>Originator:     Emmanuel Dreyfus
>Release:        NetBSD-1.5.2/i386
>Organization:
The NetBSD Project
>Environment:
NetBSD mayday 1.5.3_ALPHA NetBSD 1.5.3_ALPHA (MAYDAY) #4: Mon Jan 14 12:48:39 CET 2002     manu@melancolie:/usr/src/sys/arch/i386/compile/MAYDAY i386
>Description:
When softdep is turned on, with some disk activity (about 45 clients mounting their home through Samba), the machine panics. By observing & dozen of crash dumps, it seems that it is always the same users that trigger the crash when loging in.

Here is the panic string and the backtrace:

panic: worklist_remove: not on list
#1  0xc0273e23 in cpu_reboot ()
#2  0xc01ac085 in panic ()
#3  0xc024e69a in acquire_lock ()
#4  0xc02533ee in softdep_fsync_mountdev ()
#5  0xc0257556 in ffs_full_fsync ()
#6  0xc02572d6 in ffs_fsync ()
#7  0xc0256334 in ffs_sync ()
#8  0xc01c8390 in sys_sync ()
#9  0xc01c7350 in vfs_shutdown ()
#10 0xc0273dfb in cpu_reboot ()
#11 0xc01ac085 in panic ()
#12 0xc024e90f in worklist_remove ()
#13 0xc0250876 in check_inode_unwritten ()
#14 0xc02507d7 in softdep_freefile ()
#15 0xc024bd3e in ffs_vfree ()
#16 0xc025ea04 in ufs_makeinode ()
#17 0xc025b566 in ufs_create ()
#18 0xc01cc97c in vn_open ()
#19 0xc01c8b52 in sys_open ()
#20 0xc027acf4 in syscall ()
#21 0xc0100ce7 in syscall1 ()


>How-To-Repeat:
Unfortunately, this machine is in production, I cannot crash it until 
I find what is exactly causing the problem.
>Fix:
Turning off softdep is a workaround to the problem.
>Release-Note:
>Audit-Trail:
State-Changed-From-To: open->feedback
State-Changed-By: mrg@netbsd.org
State-Changed-When: Sun, 24 Sep 2006 03:18:16 +0000
State-Changed-Why:
is this still a problem in -current?


From: manu@netbsd.org (Emmanuel Dreyfus)
To: gnats-bugs@NetBSD.org, kern-bug-people@netbsd.org,
	netbsd-bugs@netbsd.org, gnats-admin@netbsd.org, mrg@netbsd.org
Cc: 
Subject: Re: kern/16942 (panic with softdep and quotas)
Date: Sun, 24 Sep 2006 09:14:10 +0200

 <mrg@netbsd.org> wrote:

 > Synopsis: panic with softdep and quotas
 > 
 > State-Changed-From-To: open->feedback
 > State-Changed-By: mrg@netbsd.org
 > State-Changed-When: Sun, 24 Sep 2006 03:18:16 +0000
 > State-Changed-Why:
 > is this still a problem in -current?

 Please read the how-to-repeat section: I will not crash that production
 machine just for fun. I assume that means you can close the PR, but that
 bug is probably still there. It's a pity nobody knowledgable with
 softdep had a look at that PR for 4 years. 

 -- 
 Emmanuel Dreyfus
 http://hcpnet.free.fr/pubz
 manu@netbsd.org

From: Manuel Bouyer <bouyer@antioche.eu.org>
To: Emmanuel Dreyfus <manu@NetBSD.org>
Cc: gnats-bugs@NetBSD.org, kern-bug-people@NetBSD.org,
	netbsd-bugs@NetBSD.org, gnats-admin@NetBSD.org, mrg@NetBSD.org
Subject: Re: kern/16942 (panic with softdep and quotas)
Date: Sun, 24 Sep 2006 21:54:32 +0200

 On Sun, Sep 24, 2006 at 09:14:10AM +0200, Emmanuel Dreyfus wrote:
 > <mrg@netbsd.org> wrote:
 > 
 > > Synopsis: panic with softdep and quotas
 > > 
 > > State-Changed-From-To: open->feedback
 > > State-Changed-By: mrg@netbsd.org
 > > State-Changed-When: Sun, 24 Sep 2006 03:18:16 +0000
 > > State-Changed-Why:
 > > is this still a problem in -current?
 > 
 > Please read the how-to-repeat section: I will not crash that production
 > machine just for fun. I assume that means you can close the PR, but that
 > bug is probably still there. It's a pity nobody knowledgable with
 > softdep had a look at that PR for 4 years. 

 It's still there, there has been a discussion about this on netbsd-users
 this month.
 From memory, this only happens when the quota file itself is on a
 softdep-enabled filesystem.

 -- 
 Manuel Bouyer <bouyer@antioche.eu.org>
      NetBSD: 26 ans d'experience feront toujours la difference
 --

From: manu@netbsd.org (Emmanuel Dreyfus)
To: bouyer@antioche.eu.org (Manuel Bouyer)
Cc: gnats-bugs@NetBSD.org, kern-bug-people@NetBSD.org,
	netbsd-bugs@NetBSD.org, gnats-admin@NetBSD.org, mrg@NetBSD.org
Subject: Re: kern/16942 (panic with softdep and quotas)
Date: Sun, 24 Sep 2006 22:16:10 +0200

 Manuel Bouyer <bouyer@antioche.eu.org> wrote:

 > It's still there, there has been a discussion about this on netbsd-users
 > this month.
 > From memory, this only happens when the quota file itself is on a
 > softdep-enabled filesystem.

 That's my setup.

 -- 
 Emmanuel Dreyfus
 http://hcpnet.free.fr/pubz
 manu@netbsd.org

State-Changed-From-To: feedback->open
State-Changed-By: mrg@netbsd.org
State-Changed-When: Sun, 24 Sep 2006 20:41:57 +0000
State-Changed-Why:
still a problem.


From: Andrew Doran <ad@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc: 
Subject: PR/16942 CVS commit: src
Date: Sun, 22 Feb 2009 20:28:07 +0000 (UTC)

 Module Name:	src
 Committed By:	ad
 Date:		Sun Feb 22 20:28:07 UTC 2009

 Modified Files:
 	src/doc: CHANGES
 	src/lib/libp2k: p2k.c
 	src/sbin/fsck_lfs: lfs.c
 	src/sbin/mount: mount.8
 	src/sbin/newfs_lfs: make_lfs.c
 	src/sbin/tunefs: tunefs.8 tunefs.c
 	src/sys/arch/vax/conf: VAX780
 	src/sys/conf: files
 	src/sys/kern: sys_aio.c vfs_bio.c vfs_subr.c vfs_syscalls.c
 	src/sys/miscfs/specfs: spec_vnops.c
 	src/sys/miscfs/syncfs: sync_subr.c
 	src/sys/modules/ffs: Makefile
 	src/sys/rump/fs/lib/libffs: Makefile
 	src/sys/rump/include/rump: rump.h
 	src/sys/rump/librump/rumpvfs: rump_vfs.c vm_vfs.c
 	src/sys/sys: buf.h vnode.h
 	src/sys/ufs: files.ufs
 	src/sys/ufs/ffs: ffs_alloc.c ffs_balloc.c ffs_extern.h ffs_inode.c
 	    ffs_snapshot.c ffs_vfsops.c ffs_vnops.c ffs_wapbl.c
 	src/sys/ufs/lfs: lfs_rfw.c lfs_vfsops.c lfs_vnops.c
 	src/sys/ufs/ufs: inode.h ufs_dirhash.c ufs_extern.h ufs_inode.c
 	    ufs_lookup.c ufs_readwrite.c ufs_vnops.c ufs_wapbl.c
 	src/sys/uvm: uvm_pager.c
 Removed Files:
 	src/sys/rump/librump/rumpkern/opt: opt_softdep.h
 	src/sys/ufs/ffs: ffs_softdep.c ffs_softdep.stub.c softdep.h

 Log Message:
 PR kern/26878 FFSv2 + softdep = livelock (no free ram)
 PR kern/16942 panic with softdep and quotas
 PR kern/19565 panic: softdep_write_inodeblock: indirect pointer #1 mismatch
 PR kern/26274 softdep panic: allocdirect_merge: ...
 PR kern/26374 Long delay before non-root users can write to softdep partitions
 PR kern/28621 1.6.x "vp != NULL" panic in ffs_softdep.c:4653 while unmounting a softdep (+quota) filesystem
 PR kern/29513 FFS+Softdep panic with unfsck-able file-corruption
 PR kern/31544 The ffs softdep code appears to fail to write dirty bits to disk
 PR kern/31981 stopping scsi disk can cause panic (softdep)
 PR kern/32116 kernel panic in softdep (assertion failure)
 PR kern/32532 softdep_trackbufs deadlock
 PR kern/37191 softdep: locking against myself
 PR kern/40474 Kernel panic after remounting raid root with softdep

 Retire softdep, pass 2. As discussed and later formally announced on the
 mailing lists.


 To generate a diff of this commit:
 cvs rdiff -r1.1191 -r1.1192 src/doc/CHANGES
 cvs rdiff -r1.8 -r1.9 src/lib/libp2k/p2k.c
 cvs rdiff -r1.29 -r1.30 src/sbin/fsck_lfs/lfs.c
 cvs rdiff -r1.65 -r1.66 src/sbin/mount/mount.8
 cvs rdiff -r1.13 -r1.14 src/sbin/newfs_lfs/make_lfs.c
 cvs rdiff -r1.37 -r1.38 src/sbin/tunefs/tunefs.8 src/sbin/tunefs/tunefs.c
 cvs rdiff -r1.1 -r1.2 src/sys/arch/vax/conf/VAX780
 cvs rdiff -r1.942 -r1.943 src/sys/conf/files
 cvs rdiff -r1.22 -r1.23 src/sys/kern/sys_aio.c
 cvs rdiff -r1.215 -r1.216 src/sys/kern/vfs_bio.c
 cvs rdiff -r1.368 -r1.369 src/sys/kern/vfs_subr.c
 cvs rdiff -r1.388 -r1.389 src/sys/kern/vfs_syscalls.c
 cvs rdiff -r1.122 -r1.123 src/sys/miscfs/specfs/spec_vnops.c
 cvs rdiff -r1.36 -r1.37 src/sys/miscfs/syncfs/sync_subr.c
 cvs rdiff -r1.2 -r1.3 src/sys/modules/ffs/Makefile
 cvs rdiff -r1.6 -r1.7 src/sys/rump/fs/lib/libffs/Makefile
 cvs rdiff -r1.9 -r1.10 src/sys/rump/include/rump/rump.h
 cvs rdiff -r1.1 -r0 src/sys/rump/librump/rumpkern/opt/opt_softdep.h
 cvs rdiff -r1.12 -r1.13 src/sys/rump/librump/rumpvfs/rump_vfs.c
 cvs rdiff -r1.3 -r1.4 src/sys/rump/librump/rumpvfs/vm_vfs.c
 cvs rdiff -r1.110 -r1.111 src/sys/sys/buf.h
 cvs rdiff -r1.200 -r1.201 src/sys/sys/vnode.h
 cvs rdiff -r1.18 -r1.19 src/sys/ufs/files.ufs
 cvs rdiff -r1.121 -r1.122 src/sys/ufs/ffs/ffs_alloc.c
 cvs rdiff -r1.51 -r1.52 src/sys/ufs/ffs/ffs_balloc.c
 cvs rdiff -r1.74 -r1.75 src/sys/ufs/ffs/ffs_extern.h
 cvs rdiff -r1.102 -r1.103 src/sys/ufs/ffs/ffs_inode.c
 cvs rdiff -r1.91 -r1.92 src/sys/ufs/ffs/ffs_snapshot.c
 cvs rdiff -r1.116 -r0 src/sys/ufs/ffs/ffs_softdep.c
 cvs rdiff -r1.23 -r0 src/sys/ufs/ffs/ffs_softdep.stub.c
 cvs rdiff -r1.242 -r1.243 src/sys/ufs/ffs/ffs_vfsops.c
 cvs rdiff -r1.110 -r1.111 src/sys/ufs/ffs/ffs_vnops.c
 cvs rdiff -r1.11 -r1.12 src/sys/ufs/ffs/ffs_wapbl.c
 cvs rdiff -r1.11 -r0 src/sys/ufs/ffs/softdep.h
 cvs rdiff -r1.11 -r1.12 src/sys/ufs/lfs/lfs_rfw.c
 cvs rdiff -r1.269 -r1.270 src/sys/ufs/lfs/lfs_vfsops.c
 cvs rdiff -r1.219 -r1.220 src/sys/ufs/lfs/lfs_vnops.c
 cvs rdiff -r1.55 -r1.56 src/sys/ufs/ufs/inode.h
 cvs rdiff -r1.27 -r1.28 src/sys/ufs/ufs/ufs_dirhash.c
 cvs rdiff -r1.60 -r1.61 src/sys/ufs/ufs/ufs_extern.h
 cvs rdiff -r1.77 -r1.78 src/sys/ufs/ufs/ufs_inode.c
 cvs rdiff -r1.100 -r1.101 src/sys/ufs/ufs/ufs_lookup.c
 cvs rdiff -r1.93 -r1.94 src/sys/ufs/ufs/ufs_readwrite.c
 cvs rdiff -r1.172 -r1.173 src/sys/ufs/ufs/ufs_vnops.c
 cvs rdiff -r1.4 -r1.5 src/sys/ufs/ufs/ufs_wapbl.c
 cvs rdiff -r1.93 -r1.94 src/sys/uvm/uvm_pager.c

 Please note that diffs are not public domain; they are subject to the
 copyright notices on the relevant files.

State-Changed-From-To: open->closed
State-Changed-By: dholland@NetBSD.org
State-Changed-When: Wed, 01 Apr 2009 04:04:42 +0000
State-Changed-Why:
softdep (softupdates) has been removed.


>Unformatted:

Home	PR Database Search