NetBSD Problem Report #55922

From www@netbsd.org  Tue Jan 12 14:46:17 2021
Return-Path: <www@netbsd.org>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 98DB91A9217
	for <gnats-bugs@gnats.NetBSD.org>; Tue, 12 Jan 2021 14:46:17 +0000 (UTC)
Message-Id: <20210112144616.BFA521A9248@mollari.NetBSD.org>
Date: Tue, 12 Jan 2021 14:46:16 +0000 (UTC)
From: bsiegert@gmail.com
Reply-To: bsiegert@gmail.com
To: gnats-bugs@NetBSD.org
Subject: Kernel panics with nvme+gpt on Pinebook Pro
X-Send-Pr-Version: www-1.0

>Number:         55922
>Category:       port-arm
>Synopsis:       Kernel panics with nvme+gpt on Pinebook Pro
>Confidential:   no
>Severity:       critical
>Priority:       high
>Responsible:    port-arm-maintainer
>State:          closed
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Tue Jan 12 14:50:00 +0000 2021
>Closed-Date:    Sat Sep 16 10:03:49 +0000 2023
>Last-Modified:  Sat Sep 16 10:03:49 +0000 2023
>Originator:     Benny Siegert
>Release:        NetBSD 9.99.76
>Organization:
The NetBSD Foundation
>Environment:
NetBSD 9.99.76 kernel (since update to 9.99.77) + NetBSD 9 userland, Pinebook Pro, evbarm-aarch64
>Description:
I added an NVMe drive to the Pinebook Pro and created a GPT with some partitions on it (root, EFI, swap, home). The kernel is loaded from eMMC but the root FS is on the NVMe.

Trying to build a Rust program using MAKE_JOBS=6 (thus, highly parallel, using all cores), I can make the machine crash after several minutes of such activity.

gdb is responsive but "sync" hangs for obvious reasons.

Here are two photos I snapped of the backtraces:

https://photos.app.goo.gl/f58UfkoURGxTjF3j8
https://photos.app.goo.gl/JF25NDTEDYK4Uvt26

The backtraces are a little different but both of them are in writes to the file system (below dofilewrite).
>How-To-Repeat:
- aarch64 system (Pinebook Pro)
- root FS on NVME, FFS on GPT
- build some Rust program (in my case, wip/sccache, which is not committed yet).
>Fix:
?

>Release-Note:

>Audit-Trail:
From: matthew green <mrg@eterna.com.au>
To: gnats-bugs@netbsd.org
Cc: port-arm-maintainer@netbsd.org, gnats-admin@netbsd.org,
    netbsd-bugs@netbsd.org
Subject: re: port-arm/55922: Kernel panics with nvme+gpt on Pinebook Pro
Date: Wed, 13 Jan 2021 22:00:52 +1100

 not that i have any particular insight to the crash (the images
 don't show the panic message -- can you get a copy of those?
 from ddb, 'dmesg' should show it all with a pager), and we
 should figure out what is crashing here, but i do not recommend
 using MAKE_JOBS=6 or -j6 on the PBP.

 there are two serious issues:

 - 3.875GiB of ram vs 6 jobs is simply not enough for many
   modern packges.  some use >1GiB each.

 - the PBP battery controller setup is not the best.  it can only
   charge at 15W.  however, the SoC and devices are quite capable
   of using more than 15W, so the battery will drain, even while
   plugged into barrel or usb-c power.


 i strongly recommend using no more than 3 concurrent jobs.


 .mrg.

From: David Holland <dholland-bugs@netbsd.org>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: port-arm/55922: Kernel panics with nvme+gpt on Pinebook Pro
Date: Sun, 25 Jul 2021 03:24:29 +0000

 On Tue, Jan 12, 2021 at 02:50:00PM +0000, bsiegert@gmail.com wrote:
  > https://photos.app.goo.gl/f58UfkoURGxTjF3j8
  > https://photos.app.goo.gl/JF25NDTEDYK4Uvt26

 I went to download these for posterity, but got html blobs back. Can
 you post the real urls?

 (or just email me the pictures if you like)

 -- 
 David A. Holland
 dholland@netbsd.org

From: Benny Siegert <bsiegert@gmail.com>
To: gnats-bugs@netbsd.org
Cc: port-arm-maintainer@netbsd.org, gnats-admin@netbsd.org, 
    netbsd-bugs@netbsd.org, bsiegert@gmail.com
Subject: Re: port-arm/55922: Kernel panics with nvme+gpt on Pinebook Pro
Date: Sun, 8 Aug 2021 09:35:33 +0000 (UTC)

 On Sun, 25 Jul 2021, David Holland wrote:

 > On Tue, Jan 12, 2021 at 02:50:00PM +0000, bsiegert@gmail.com wrote:
 >  > https://photos.app.goo.gl/f58UfkoURGxTjF3j8
 >  > https://photos.app.goo.gl/JF25NDTEDYK4Uvt26
 >
 > I went to download these for posterity, but got html blobs back. Can
 > you post the real urls?

 Direct picture URLs:

 https://storage.googleapis.com/bsiegert/IMG_8220.jpg
 https://storage.googleapis.com/bsiegert/IMG_8241.jpg

 -- 
 Benny

From: David Holland <dholland-bugs@netbsd.org>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: port-arm/55922: Kernel panics with nvme+gpt on Pinebook Pro
Date: Sun, 8 Aug 2021 19:21:06 +0000

 On Sun, Aug 08, 2021 at 09:40:01AM +0000, Benny Siegert wrote:
  >  >  > https://photos.app.goo.gl/f58UfkoURGxTjF3j8
  >  >  > https://photos.app.goo.gl/JF25NDTEDYK4Uvt26
  >  >
  >  > I went to download these for posterity, but got html blobs back. Can
  >  > you post the real urls?
  >  
  >  Direct picture URLs:
  >  
  >  https://storage.googleapis.com/bsiegert/IMG_8220.jpg
  >  https://storage.googleapis.com/bsiegert/IMG_8241.jpg

 Thanks!

 https://www.netbsd.org/~dholland/gnatsblobs/55922/

 -- 
 David A. Holland
 dholland@netbsd.org

From: Nick Hudson <nick.hudson@gmx.co.uk>
To: gnats-bugs@netbsd.org, port-arm-maintainer@netbsd.org,
 gnats-admin@netbsd.org, netbsd-bugs@netbsd.org
Cc: 
Subject: Re: port-arm/55922: Kernel panics with nvme+gpt on Pinebook Pro
Date: Sun, 5 Sep 2021 08:02:42 +0100

 This is a multi-part message in MIME format.
 --------------CA533B3D628B7AF6F55270D4
 Content-Type: text/plain; charset=utf-8; format=flowed
 Content-Transfer-Encoding: 7bit

 I converted the images to text...


 --------------CA533B3D628B7AF6F55270D4
 Content-Type: text/plain; charset=UTF-8;
  name="pr55922.txt"
 Content-Transfer-Encoding: base64
 Content-Disposition: attachment;
  filename="pr55922.txt"

 CgoKNC41MDcwODMxXSBmcCBmZmZmYzAwMDhkNzk3NjQwIG11dGV4X3NwaW5fZXhpdCgpIGF0
 IGZmZmZjMDAwMDA0OTE4MmMgbmV0YnNkOm11dGV4IHNwaW4gZXhpdCtPeDdjCjQuNTE3MDgy
 Nl0gZnAgZmZmZmMwMDA4ZDc5NzY2MCBudW1lX25zX2RvYmlvKCkgYXQgZmZmZmMwMDAwMDFj
 MDIzOCBuZXRic2Q6bnVtZSBucyBkb2JpbysweDIzOAo0LjUxNzA4MjZdIGZwIGZmZmZjMDAw
 OGQ3OTc2ZTAgbGRfbnZtZV9zdGFydCgpIGF0IGZmZmZjMDAwMDAxYzBiOTAgbmV0YnNkQWRu
 dW1lIHN0YXJ0KzB4NjAKNC41MTcwODI2XSBmcCBmZmZmYzAwMDhkNzk3NzAwIGxkX2Rpc2tz
 dGFydCgpIGF0IGZmZmZjMDAwMDAxODk0NzggbmV0YnNkQWRfZGlza3N0YXJ0K094ODgKNC41
 MjcwODIzXSBmcCBmZmZmYzAwMDhkNzk3NzMwIGRrX3N0YXJ0KCkgYXQgZmZmZmMwMDAwMDU1
 ZjkwYyBuZXRic2Q6ZGtfc3RhcnQrT3hlYwo0LjUyNzA4MjNdIGZwIGZmZmZjMDAwOGQ3OTc3
 ODAgc3BlY19zdHJhdGVneSgpIGF0IGZmZmZjMDAwMDA1NWJhYjAgbmV0YnNkOnNwZWNfc3Ry
 YXRlZ3krMHg5MAo0LjUyNzA4MjNdIGZwIGZmZmZjMDAwOGQ3OTc3YjAgVk9QX1NUUkFURUdZ
 KCkgYXQgZmZmZmMwMDAwMDU0ZWY4MCBuZXRic2Q6V1BTVFJBVEVHWSsweDM4CjQuNTI3MDgy
 M10gZnAgZmZmZmMwMDA4ZDc5NzdmMCBka3N0YXJ0KCkgYXQgZmZmZmMwMDAwMDU2MTExOCBu
 ZXRic2Q6ZGtzdGFydCsweDE3OAo0LjUzNzA4MjRdIGZwIGZmZmZjMDAwOGQ3OTc4NTAgc3Bl
 Y19zdHJhdGVneSgpIGF0IGZmZmZjMDAwMDA1NWJhYjAgbmV0YnNkOnNwZWNfc3RyYXRlZ3kr
 MHg5MAo0LjUzNzA4MjRdIGZwIGZmZmZjMDAwOGQ3OTc4ODAgVk9QX1NUUkFURUdZKCkgYXQg
 ZmZmZmMwMDAwMDU0ZWY4MCBuZXRic2Q6V1BfU1RSQVRFR1krMHgzOAo0LjUzNzA4MjRdIGZw
 IGZmZmZjMDAwOGQ3OTc4YzAgZ2VuZnNfZG9faW8oKSBhdCBmZmZmYzAwMDAwNTUwZDg0IG5l
 dGJzZDpnZW5mc19kb19pbysweDE2Ywo0LjU0NzA4MzldIGZwIGZmZmZjMDAwOGQ3OTc5NzAg
 Z2VuZnNfZG9fcHV0cGFnZXMoKSBhdCBmZmZmYzAwMDAwNTUyZDFjIG5ldGJzZDpnZW5mc19k
 b19wdXRwYWdlcysweDdiNAo0LjU0NzA4MzldIGZwIGZmZmZlMDAwOGQ3OTdiOTAgVk9QRl9Q
 VVRQQUdFUygpIGF0IGZmZmZjMDAwMDA1NGYzOWMgbmV0YnNkOlVQX1BVVFBBR0VTKzB4M2MK
 NC41NDcwODM5XSBmcCBmZmZmYzAwMDhkNzk3YmYwIGZmc193cml0ZSgpIGF0IGZmZmZlMDAw
 MDA0MmNkNzggbmV0YnNkOmZmc193cml0ZStPeDI5MAo0LjU0NzA4MzldIGZwIGZmZmZjMDAw
 OGQ3OTdjOTAgVk9QX1dSSVRFKDApIGF0IGZmZmZjMDAwMDA1NGRlZTggbmV0YnNkOlZPUF9X
 UklURSsweDQwCjQuNTU3MDgzNF0gZnAgZmZmZmMwMDA4ZDc5N2NlMCB2bl93cml0ZSgpIGF0
 IGZmZmZjMDAwMDA1NDU3YjggbmV0YnNkOnZuX3dyaXRlKzB4MTA4CjQuNTU3MDgzNF0gZnAg
 ZmZmZmMwMDA4ZDc5N2QzMCBkb2ZpbGV3cml0ZSgpIGF0IGZmZmZjMDAwMDA0ZWRjOTggbmV0
 YnNkOmRvZmlsZXdyaXRlKzB4NzAKNC41NTcwODM0XSBmcCBmZmZmYzAwMDhkNzk3ZGIwIHN5
 c2NhbGwgYXQgZmZmZmMwMDAwMDA4ZjdhYyBuZXRic2Q6c3lzY2FsbCsweDE4Ywo0LjU2NzA4
 NDldIGZwIGZmZmZjMDAwOGQ3OTdlNjAgdHJhcF9lbDBfc3luYygpIGF0IGZmZmZjMDAwMDAw
 OTBjNTggbmV0YnNkOnRyYXBfZUxPX3N5bmMrMHgzNzgKNC41NjcwODQ5XSB0ZiBmZmZmYzAw
 MDhkNzk3ZWQwIGVsMF90cmFwKCkgYXQgZmZmZmMwMDAwMDA5MmZmMCBuZXRic2Q6ZUxPX3Ry
 YXAKNC41NjcwODQ5XSAtLS0tIHRyYXBmcmFtZSAweGZmZmZjMDAwOGQ3OTdlZDAgKDMwNCBi
 eXRlcykgLS0KNC41NjcwODQ5XSAgICAgcGM9MDAwMGY0NzZmYzVjODNhOCwgICBzcHNyPTAw
 MDAwMDAwMDAwMDAwMDAKNC41NjcwODQ5XSAgICBlc3I9MDAwMDAwMDA1NjAwMDAwNCwgICAg
 ZmFyPTAwMDBmNDc2ZmE4ODUwMDAKNC41NjcwODQ5XSAgICAgeDA9MDAwMDAwMDAwMDAwMDAw
 NiwgICAgIHgxPTAwMDBmNDc2ZmE4OTY0MDAKNC41NjcwODQ5XSAgICAgeDI9MDAwMDAwMDAw
 MDAwMDZmOCwgICAgIHgzPTAwMDBmNDc2ZmM2ZWxkZDAKNC41NjcwODQ5XSAgICAgeDQ9MDAw
 MGY0NzZmYzUyYzY4MCwgICAgIHg1PTAwMDBmNDc2ZmNhNWJhODAKNC41NjcwODQ5XSAgICAg
 eDY9MDAwMDAwMDAwMDAwMDAxOCwgICAgIHg3PTAwMDBmNDc2ZmE4NWFkYzAKNC41NjcwODQ5
 XSAgICAgeDg9MDAwMDAxNzgwMDAwMDAxOCAgICAgIHg5PTAwMDAwMDAwMDAwMDAwMDYKNC41
 NjcwODQ5XSAgICB4MTA9MDAwMDAwMDAwMDAwMDA0MCwgICAgeDExPTAwMDAwMDAwMDAwMDAw
 MjcKNC41NjcwODQ5XSAgICB4MTI9MDAwMDAwMDAwMDAwMDAxMCwgICAgeDEzPTAwMDAwMDAw
 MDMwMDBiMzgKNC41NjcwODQ5XSAgICB4MTQ9MDAwMDAwMDAwMDAwMDA0OCwgICAgeDE1PTAw
 MDBmNDc2ZmFiOGY5NzgKNC41NjcwODQ5XSAgICB4MTY9MDAwMGY0NzZmYzc0ZTM5MCwgICAg
 eDE3PTAwMDBmNDc2ZmM1YzgzYTQKNC41NjcwODQ5XSAgICB4MTg9MDAwMGY0NzZmYzc1YmQ3
 YSwgICAgeDE5PTAwMDAwMDAwMDAwMDA2ZjgKNC41NjcwODQ5XSAgICB4MjA9MDAwMGY0NzZm
 Yzc1YmRjMCwgICAgeDIxPTAwMDBmNDc2ZmE4OTY0MDAKNC41NjcwODQ5XSAgICB4MjI9MDAw
 MDAwMDAwMDA0YzU2MCwgICAgeDIzPTAwMDAwMDAwMDAwMDAwMDAKNC41NzcwODQzXSAgICB4
 MjQ9MDAwMGY0NzZmYTg1YWVmOCwgICAgeDI1PTAwMDAwMDAwMDAwMDAwMDAKNC41NzcwODQz
 XSAgICB4MjY9MDAwMDAwMDAwMDAwMDAyOCwgICAgeDI3PTAwMDAwMDAwMDAwMDAwMDMKNC41
 NzcwODQzXSAgICB4Mjg9MDAwMGZmZmZmZjk1YjhjOCwgZnA9eDI5PTAwMDBmZmZmZmY5NWI0
 MzAKNC41NzcwODQzXSBscj14MzA9MDAwMGY0NzZmYzZlMTI3OCwgICAgIHNwPTAwMDBmZmZm
 ZmY5NWI0MzAKNC41NzcwODQzXSAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t
 LS0tLS0tLS0tLS0tLQpjcHUyOiBFbmQgdHJhY2ViYWNrLi4uCi5lZCBpbiBwaWQgMTg5MjQu
 MTg5MjQgKGxkKSBhdCBuZXRic2Q6Y3B1X0RlYnVnZ2VyK094NDoKCgoKWyA0MTU0Ljg2NDYw
 NzNdICAgIHgyND1mZmZmYzAwMDAwYTY5ZjAwLCAgICB4MjU9ZmZmZmMwMDAwMGJmYmNhOApb
 IDQxNTQuODY0NjA3M10gICAgeDI2PWZmZmZjMDAwMDBiZmJjNzAsICAgIHgyNz1mZmZmMDAw
 MDJmZjJiNDAwClsgNDE1NC44NjQ2MDczXSAgICB4Mjg9MDAwMDAwMDAwNWU3NTVjMCwgZnA9
 eDI5PWZmZmZjMDAwOGY2NWY3MDAKWyA0MTU0Ljg2NDYwNzNdIGxyPXgzMD1mZmZmYzAwMDAw
 MTg5NDk4LCAgICAgc3A9ZmZmZmMwMDA4ZjY1ZjcwMApbIDQxNTQuODY0NjA3M10KWyA0MTU0
 Ljg2NDYwNzNdIGZwIGZmZmZjMDAwOGY2NWY3MDAgbXV0ZXhfZXhpdCgpIGF0IGZmZmZjMDAw
 MDAwOGQ5Y2MgbmV0YnNkOm11dGV4IGV4aXQrMHg0ClsgNDE1NC44NjQ2MDczXSBmcCBmZmZm
 YzAwMDhmNjVmNzMwIGRrX3N0YXJ0KCkgYXQgZmZmZmMwMDAwMDU1ZjkwYyBuZXRic2Q6ZGsg
 c3RhcmkrT3hlYwpbIDQxNTQuODY0NjA3M10gZnAgZmZmZmMwMDA4ZjY1Zjc4MCBzcGVjX3N0
 cmF0ZWd5KCkgYXQgZmZmZmMwMDAwMDU1YmFiMCBuZXRiO2Q6c3BlYyBzdHJhdGVneSsweDkw
 ClsgNDE1NC44NjQ2MDczXSBmcCBmZmZmYzAwMDhmNjVmN2IwIFZPUF9TVFJBVEVHWSgpIGF0
 IGZmZmZjMDAwMDA1NGVmODAgbmV0YnNkOldQX1NUUkFURUdZK094MzgKWyA0MTU0Ljg3NDYw
 NjJdIGZwIGZmZmZjMDAwOGY2NWY3ZjAgZGtzdGFydCgpIGF0IGZmZmZjMDAwMDA1NjExMTgg
 bmV0YnNkOmRrc3RhcnQrMHgxNzgKWyA0MTU0Ljg3NDYwNjJdIGZwIGZmZmZjMDAwOGY2NWY4
 NTAgc3BlY19zdHJhdGVneSgpIGF0IGZmZmZjMDAwMDA1NWJhYjAgbmV0YnNkOnNwZWNfc3Ry
 YXRlZ3krMHg5MApbIDQxNTQuODc0NjA2Ml0gZnAgZmZmZmMwMDA4ZjY1Zjg4MCBXUFNUUkFU
 RUdZMCBhdCBmZmZmYy4wMDAwMDU0ZWY4MCBuZXRic2Q6V1BfU1RSQVRFR1krMHgzOApbIDQx
 NTQuODc0NjA2Ml0gZnAgZmZmZmMwMDA4ZjY1ZjhjMCBnZW5mc19kb19pbygpIGF0IGZmZmZj
 MDAwMDA1NTBkODQgbmV0YnNkOmdlbmZzZG9faW8rT3hsNmMKWyA0MTU0Ljg3NDYwNjJdIGZw
 IGZmZmZjMDAwOGY2NWY5NzAgZ2VuZnNfZG9wdXRwYWdlcygpIGF0IGZmZmZjMDAwMDA1NTJk
 MWMgbmV0YnNkOmdlbmZzX2RvX3B1dHBhZ2VzKzB4N2I0ClsgNDE1NC44NzQ2MDYyXSBmcCBm
 ZmZmYzAwMDhmNjVmYjkwIFZPUF9QVVRQQUdFUygpIGF0IGZmZmZjMDAwMDA1NGYzOWMgbmV0
 YnNkOldQX1BVVFBBR0VTKzB4M2MKWyA0MTU0Ljg4NDYwOTRdIGZwIGZmZmZjMDAwOGY2NWZi
 ZjAgZmZzX3dyaXRlKCkgYXQgZmZmZmMwMDAwMDQyYzA4IG5ldGJzZDpmZnNfd3JpdGUrMHgy
 OTAKWyA0MTU0Ljg4NDYwOTRdIGZwIGZmZmZjMDAwOGY2NWZjOTAgVk9QX1dSSVRFKCkgYXQg
 ZmZmZmMwMDAwMDU0ZGVlOCBuZXRic2Q6Vk9QX1dSSVRFK094NDAKWyA0MTU0Ljg4NDYwOTRd
 IGZwIGZmZmZjMDAwOGY2NWZjZTAgdm5fd3JpdGUoKSBhdCBmZmZmYzAwMDAwNTQ1N2I4IG5l
 dGJzZDp2bl93cml0ZStPeDEwOApbIDQxNTQuODg0NjA5NF0gZnAgZmZmZmMwMDA4ZjY1ZmQz
 MCBkb2ZpbGV3cml0ZSgpIGF0IGZmZmZjMDAwMDA0ZWRjOTggbmV0YnNkOmRvZmlMZXdyaXRl
 KzB4NzAKWyA0MTU0Ljg4NDYwOTRdIGZwIGZmZmZjMDAwOGY2NWZkYjAgc3lzY2FsbCgpIGF0
 IGZmZmZjMDAwMDAwOGY3YWMgbmV0YnNkOnN5c2NhbGwrMHhsOGMKWyA0MTU0Ljg4NDYwOTRd
 IGZwIGZmZmZjMDAwOGY2NWZlNjAgdHJhcF9lbDBfc3luYygpIGF0IGZmZmZjMDAwMDAwOTBj
 NTggbmV0YnNkOnRyYXBfZWwwX3N5bmMrMHgzNzgKWyA0MTU0Ljg5NDYxMzhdIHRmIGZmZmZj
 MDAwOGY2NWZlZDAgZWwwX3RyYXAoKSBhdCBmZmZmYzAwMDAwMDkyZmYwIG5ldGJzZDplYUx0
 cmFwClsgNDE1NC44OTQ2MTM4XSAtLS0tIHRyYXBmcmFtZSAweGZmZmZjMDAwOGY2NWZlZDAg
 KDMwNCBieXRlcykgLS0tLQpbIDQxNTQuODk0NjEzOF0gICAgIHBjPTAwMDBmODIyMGU3NTgz
 YTgsICAgc3Bzcj0wMDAwMDAwMDgwMDAwMDAwClsgNDE1NC44OTQ2MTM4XSAgICBlc3I9MDAw
 MDAwMDA1NjAwMDAwNCwgICAgZmFyPTAwMDBmODIyMTA2YjkwMDAKWyA0MTU0Ljg5NDYxMzhd
 ICAgICB4MD0wMDAwMDAwMDAwMDAwMDA4LCAgICAgeDE9MDAwMGY4MjFmODI3YzM0MApbIDQx
 NTQuODk0NjEzOF0gICAgIHgyPTAwMDAwMDAwMDA0N2M5MmIsICAgICB4Mz0wMDAwMDAwMDAw
 MDAwMDAwClsgNDE1NC44OTQ2MTM4XSAgICAgeDQ9MDAwMDAwMDAwMDAwMDA2MSwgICAgIHg1
 PTAwMDAwMDAwNjZiYjRkZTgKWyA0MTU0Ljg5NDYxMzhdICAgICB4Nj0wMDAwZjgyMWMwMDAw
 MDAwLCAgICAgeDc9MDAwMDAwMDAwMDAwMDAwNApbIDQxNTQuODk0NjEzOF0gICAgIHg4PTAw
 MDBmODIyMDhmZjVmYzgsICAgICB4OT0wMDAwZjgyMWZmNjAwMGMwClsgNDE1NC44OTQ2MTM4
 XSAgICB4MTA9MDAwNmY4MjIwODJmNWQ4MSwgICAgeDExPTAwMDAwMDAwMDAwMDAwMTIKWyA0
 MTU0Ljg5NDYxMzhdICAgIHgxMj0wMDAwMDAwMDAwMDAwMDEyLCAgICB4MTM9MDAwMGY4MjIw
 ZThmNThjOApbIDQxNTQuODk0NjEzOF0gICAgeDE0PTAwMDBmODIyMDk0MDA4YzAsICAgIHgx
 NT0wMDAwMDAwMDU5OWZhN2YwClsgNDE1NC44OTQ2MTM4XSAgICB4MTY9MDAwMGY4MjIwOWFm
 MjhjOCwgICAgeDE3PTAwMDBmODIyMGU3NTgzYTQKWyA0MTU0Ljg5NDYxMzhdICAgIHgxOD0w
 MDAwMDAwMDAwMDAwMDY3LCAgICB4MTk9MDAwMGY4MjIwOWFmMjAwMApbIDQxNTQuODk0NjEz
 OF0gICAgeDIwPTAwMDBmODIyMDk4NDYwMDAsICAgIHgyMT0wMDAwMDAwMDAwNDdjOTJiClsg
 NDE1NC44OTQ2MTM4XSAgICB4MjI9MDAwMGY4MjIwOGZmNjA4YywgICAgeDIzPTAwMDBmODIy
 MDhmZjYyNTgKWyA0MTU0Ljg5NDYxMzhdICAgIHgyND0wMDAwZjgyMjA4ZmY1ZmQwLCAgICB4
 MjU9N2ZmZmZmZmZmZmZmZmZmZgpbIDQxNTQuOTA0NjExNV0gICAgeDI2PTAwMDAwMDAwMDIw
 MDAwMDEsICAgIHgyNz0wMDAwZjgyMjA4ZmY2MjIwClsgNDE1NC45MDQ2MTE1XSAgICB4Mjg9
 MDAwMGY4MjIxMjNhYjAzOCwgZnA9eDI5PTAwMDBmODIyMDhmZjVmYTAKWyA0MTU0LjkwNDYx
 MTVdIGxyPXgzMD0wMDAwZjgyMjA5YWQ4NjI4LCAgICAgc3A9MDAwMGY4MjIwOGZmNWZhMApb
 IDQxNTQuOTA0NjExNV0KWyA0MTU0LjkwNDYxMTVdIGNwdTQ6IEVuZCB0cmFjZWJhY2suLi4K
 U3RvcHBlZCBpbiBwaWQgMTE3MjIuMzQ2NCAocnVzdGMpIGF0IG5ldGJzZDpjcHVfRGVidWdn
 ZXIrMHg0OiByZXQKCgoKCg==
 --------------CA533B3D628B7AF6F55270D4--

I hate email... here's the text with some improvements


4.5070831] fp ffffc0008d797640 mutex_spin_exit() at ffffc0000049182c netbsd:mutex_spin exit+Ox7c
4.5170826] fp ffffc0008d797660 nvme_ns_dobio() at ffffc000001c0238 netbsd:nvme_ns_dobio+0x238
4.5170826] fp ffffc0008d7976e0 ld_nvme_start() at ffffc000001c0b90 netbsd:nvme_start+0x60
4.5170826] fp ffffc0008d797700 ld_diskstart() at ffffc00000189478 netbsd:ld_diskstart+Ox88
4.5270823] fp ffffc0008d797730 dk_start() at ffffc0000055f90c netbsd:dk_start+Oxec
4.5270823] fp ffffc0008d797780 spec_strategy() at ffffc0000055bab0 netbsd:spec_strategy+0x90
4.5270823] fp ffffc0008d7977b0 VOP_STRATEGY() at ffffc0000054ef80 netbsd:VOPSTRATEGY+0x38
4.5270823] fp ffffc0008d7977f0 dkstart() at ffffc00000561118 netbsd:dkstart+0x178
4.5370824] fp ffffc0008d797850 spec_strategy() at ffffc0000055bab0 netbsd:spec_strategy+0x90
4.5370824] fp ffffc0008d797880 VOP_STRATEGY() at ffffc0000054ef80 netbsd:VOP_STRATEGY+0x38
4.5370824] fp ffffc0008d7978c0 genfs_do_io() at ffffc00000550d84 netbsd:genfs_do_io+0x16c
4.5470839] fp ffffc0008d797970 genfs_do_putpages() at ffffc00000552d1c netbsd:genfs_do_putpages+0x7b4
4.5470839] fp ffffe0008d797b90 VOPF_PUTPAGES() at ffffc0000054f39c netbsd:VOP_PUTPAGES+0x3c
4.5470839] fp ffffc0008d797bf0 ffs_write() at ffffe0000042cd78 netbsd:ffs_write+Ox290
4.5470839] fp ffffc0008d797c90 VOP_WRITE(0) at ffffc0000054dee8 netbsd:VOP_WRITE+0x40
4.5570834] fp ffffc0008d797ce0 vn_write() at ffffc000005457b8 netbsd:vn_write+0x108
4.5570834] fp ffffc0008d797d30 dofilewrite() at ffffc000004edc98 netbsd:dofilewrite+0x70
4.5570834] fp ffffc0008d797db0 syscall at ffffc0000008f7ac netbsd:syscall+0x18c
4.5670849] fp ffffc0008d797e60 trap_el0_sync() at ffffc00000090c58 netbsd:trap_el0_sync+0x378
4.5670849] tf ffffc0008d797ed0 el0_trap() at ffffc00000092ff0 netbsd:el0_trap
4.5670849] ---- trapframe 0xffffc0008d797ed0 (304 bytes) --
4.5670849]     pc=0000f476fc5c83a8,   spsr=0000000000000000
4.5670849]    esr=0000000056000004,    far=0000f476fa885000
4.5670849]     x0=0000000000000006,     x1=0000f476fa896400
4.5670849]     x2=00000000000006f8,     x3=0000f476fc6eldd0
4.5670849]     x4=0000f476fc52c680,     x5=0000f476fca5ba80
4.5670849]     x6=0000000000000018,     x7=0000f476fa85adc0
4.5670849]     x8=0000017800000018      x9=0000000000000006
4.5670849]    x10=0000000000000040,    x11=0000000000000027
4.5670849]    x12=0000000000000010,    x13=0000000003000b38
4.5670849]    x14=0000000000000048,    x15=0000f476fab8f978
4.5670849]    x16=0000f476fc74e390,    x17=0000f476fc5c83a4
4.5670849]    x18=0000f476fc75bd7a,    x19=00000000000006f8
4.5670849]    x20=0000f476fc75bdc0,    x21=0000f476fa896400
4.5670849]    x22=000000000004c560,    x23=0000000000000000
4.5770843]    x24=0000f476fa85aef8,    x25=0000000000000000
4.5770843]    x26=0000000000000028,    x27=0000000000000003
4.5770843]    x28=0000ffffff95b8c8, fp=x29=0000ffffff95b430
4.5770843] lr=x30=0000f476fc6e1278,     sp=0000ffffff95b430
4.5770843] -----------------------------------------------
cpu2: End traceback...
.ed in pid 18924.18924 (ld) at netbsd:cpu_Debugger+Ox4:



[ 4154.8646073]    x24=ffffc00000a69f00,    x25=ffffc00000bfbca8
[ 4154.8646073]    x26=ffffc00000bfbc70,    x27=ffff00002ff2b400
[ 4154.8646073]    x28=0000000005e755c0, fp=x29=ffffc0008f65f700
[ 4154.8646073] lr=x30=ffffc00000189498,     sp=ffffc0008f65f700
[ 4154.8646073]
[ 4154.8646073] fp ffffc0008f65f700 mutex_exit() at ffffc0000008d9cc netbsd:mutex_exit+0x4
[ 4154.8646073] fp ffffc0008f65f730 dk_start() at ffffc0000055f90c netbsd:dk_start+Oxec
[ 4154.8646073] fp ffffc0008f65f780 spec_strategy() at ffffc0000055bab0 netbsd:spec_strategy+0x90
[ 4154.8646073] fp ffffc0008f65f7b0 VOP_STRATEGY() at ffffc0000054ef80 netbsd:VOP_STRATEGY+Ox38
[ 4154.8746062] fp ffffc0008f65f7f0 dkstart() at ffffc00000561118 netbsd:dkstart+0x178
[ 4154.8746062] fp ffffc0008f65f850 spec_strategy() at ffffc0000055bab0 netbsd:spec_strategy+0x90
[ 4154.8746062] fp ffffc0008f65f880 WPSTRATEGY0 at ffffc.0000054ef80 netbsd:VOP_STRATEGY+0x38
[ 4154.8746062] fp ffffc0008f65f8c0 genfs_do_io() at ffffc00000550d84 netbsd:genfs_do_io+Oxl6c
[ 4154.8746062] fp ffffc0008f65f970 genfs_doputpages() at ffffc00000552d1c netbsd:genfs_do_putpages+0x7b4
[ 4154.8746062] fp ffffc0008f65fb90 VOP_PUTPAGES() at ffffc0000054f39c netbsd:VOP_PUTPAGES+0x3c
[ 4154.8846094] fp ffffc0008f65fbf0 ffs_write() at ffffc0000042c08 netbsd:ffs_write+0x290
[ 4154.8846094] fp ffffc0008f65fc90 VOP_WRITE() at ffffc0000054dee8 netbsd:VOP_WRITE+Ox40
[ 4154.8846094] fp ffffc0008f65fce0 vn_write() at ffffc000005457b8 netbsd:vn_write+Ox108
[ 4154.8846094] fp ffffc0008f65fd30 dofilewrite() at ffffc000004edc98 netbsd:dofilewrite+0x70
[ 4154.8846094] fp ffffc0008f65fdb0 syscall() at ffffc0000008f7ac netbsd:syscall+0xl8c
[ 4154.8846094] fp ffffc0008f65fe60 trap_el0_sync() at ffffc00000090c58 netbsd:trap_el0_sync+0x378
[ 4154.8946138] tf ffffc0008f65fed0 el0_trap() at ffffc00000092ff0 netbsd:eaLtrap
[ 4154.8946138] ---- trapframe 0xffffc0008f65fed0 (304 bytes) ----
[ 4154.8946138]     pc=0000f8220e7583a8,   spsr=0000000080000000
[ 4154.8946138]    esr=0000000056000004,    far=0000f822106b9000
[ 4154.8946138]     x0=0000000000000008,     x1=0000f821f827c340
[ 4154.8946138]     x2=000000000047c92b,     x3=0000000000000000
[ 4154.8946138]     x4=0000000000000061,     x5=0000000066bb4de8
[ 4154.8946138]     x6=0000f821c0000000,     x7=0000000000000004
[ 4154.8946138]     x8=0000f82208ff5fc8,     x9=0000f821ff6000c0
[ 4154.8946138]    x10=0006f822082f5d81,    x11=0000000000000012
[ 4154.8946138]    x12=0000000000000012,    x13=0000f8220e8f58c8
[ 4154.8946138]    x14=0000f822094008c0,    x15=00000000599fa7f0
[ 4154.8946138]    x16=0000f82209af28c8,    x17=0000f8220e7583a4
[ 4154.8946138]    x18=0000000000000067,    x19=0000f82209af2000
[ 4154.8946138]    x20=0000f82209846000,    x21=000000000047c92b
[ 4154.8946138]    x22=0000f82208ff608c,    x23=0000f82208ff6258
[ 4154.8946138]    x24=0000f82208ff5fd0,    x25=7fffffffffffffff
[ 4154.9046115]    x26=0000000002000001,    x27=0000f82208ff6220
[ 4154.9046115]    x28=0000f822123ab038, fp=x29=0000f82208ff5fa0
[ 4154.9046115] lr=x30=0000f82209ad8628,     sp=0000f82208ff5fa0
[ 4154.9046115]
[ 4154.9046115] cpu4: End traceback...
Stopped in pid 11722.3464 (rustc) at netbsd:cpu_Debugger+0x4: ret



From: matthew green <mrg@eterna.com.au>
To: Nick Hudson <nick.hudson@gmx.co.uk>, bsiegert@gmail.com
Cc: gnats-bugs@netbsd.org, port-arm-maintainer@netbsd.org,
    gnats-admin@netbsd.org, netbsd-bugs@netbsd.org
Subject: re: port-arm/55922: Kernel panics with nvme+gpt on Pinebook Pro
Date: Tue, 07 Sep 2021 05:58:22 +1000

 what's the nvme ssd installed?  there are known issues with
 many mid-range to high-end ssds in pbp, due to power supply
 issues.  see this for info about known good bad:

    https://wiki.pine64.org/wiki/Pinebook_Pro_Hardware_Accessory_Compatibil=
 ity#NVMe_SSD_drives

 but also know that all the samsung drives *i* tried did not
 work in the end (this table lists 970 PRO as working, and
 maybe it does work at PS2 setting.)

 you can (should) set the nvme power level to PS2 if you can,
 using nvmectl:

    nvmectl power -p 2 nvme0


 now that i've become more familiar with this failure mode,
 i'm some what convinced this PR is a hardware issue and
 we can't solve it in software.  the mutex spinout happened
 because the hardware stopped answering.


 it's also possible that even with nvme set to ~2W that
 also having the system run -j6 for a long time -- which
 does drain the battery normally -- will lead to a case
 where the battery can't supply power to the nvme and it
 can fail, even with "good low power" nvmes.  i have intel
 660p's in use, and while mostly it can run down on power
 OK, sometimes it will hang IOs and need a reset.


 .mrg.

State-Changed-From-To: open->feedback
State-Changed-By: skrll@NetBSD.org
State-Changed-When: Sun, 15 May 2022 20:00:19 +0000
State-Changed-Why:
A question was asked and hardware is suspected


State-Changed-From-To: feedback->closed
State-Changed-By: bsiegert@NetBSD.org
State-Changed-When: Sat, 16 Sep 2023 10:03:49 +0000
State-Changed-Why:
This is likely a hardware issue, not an OS bug.
Thank you for the informative discussion.


>Unformatted:

NetBSD Home
NetBSD PR Database Search

(Contact us) $NetBSD: query-full-pr,v 1.47 2022/09/11 19:34:41 kim Exp $
$NetBSD: gnats_config.sh,v 1.9 2014/08/02 14:16:04 spz Exp $
Copyright © 1994-2023 The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.