NetBSD Problem Report #57505

From www@netbsd.org  Thu Jul  6 18:32:48 2023
Return-Path: <www@netbsd.org>
Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	(Client CN "mail.NetBSD.org", Issuer "mail.NetBSD.org CA" (not verified))
	by mollari.NetBSD.org (Postfix) with ESMTPS id 23CE51A923D
	for <gnats-bugs@gnats.NetBSD.org>; Thu,  6 Jul 2023 18:32:48 +0000 (UTC)
Message-Id: <20230706183247.020FA1A923E@mollari.NetBSD.org>
Date: Thu,  6 Jul 2023 18:32:46 +0000 (UTC)
From: jspath55@gmail.com
Reply-To: jspath55@gmail.com
To: gnats-bugs@NetBSD.org
Subject: Automated test case ipsecif_basic_ipv6overipv6_esp_null fails  intermittently on different architectures
X-Send-Pr-Version: www-1.0

>Number:         57505
>Category:       misc
>Synopsis:       Automated test case ipsecif_basic_ipv6overipv6_esp_null fails  intermittently on different architectures
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    misc-bug-people
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Thu Jul 06 18:35:00 +0000 2023
>Last-Modified:  Thu Jul 06 18:45:01 +0000 2023
>Originator:     Jim Spath
>Release:        10.0_BETA
>Organization:
>Environment:
NetBSD etc.etc 10.0_BETA NetBSD 10.0_BETA (GENERIC) #0: Sun Feb 12 12:39:37 UTC 2023  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC amd64 x86_64 AMD 686-class NetBSD
>Description:
This test case fails intermittently on each architecture I tested.
Several examples were chosen from the full test suite after observing inconsistent pass/fail on specific tests over many runs.
Tests were run periodically from cron, tuned to avoid overlapping runs while completing as many attempts as feasible based on the system speed.

The set being reported in July 2023 includes failure rates in the one-percent ranges, to be followed by other tests that fail more frequently.

The results for systems used:

System Passes Failures
amd64 1501 5
Pi3 270 1
Pi4 788 3
Pi0W 592 5
Pi02W 881 7
i386 (Intel Atom) 708 2

Example failure message:

tps-count: 1
tp-start: 1687555649.387164, net/net/t_unix, 1
tc-start: 1687555649.387228, sockaddr_un_local_peereid
tc-so:peercred(client) euid=0 egid=0 pid=7950
tc-se:FATAL ERROR: Cannot create results file '/tmp/atf-run.SPz1b2/tcr': Permission denied
tc-se:*** Check failed: /usr/src/tests/net/net/t_unix.c:316: getpeername
tc-end: 1687555649.402980, sockaddr_un_local_peereid, failed, /usr/src/tests/net/net/t_unix.c:445: test(true, true, false, 100): Socket is not connected
tp-end: 1687555649.404253, net/net/t_unix
info: time.end, Fri Jun 23 21:27:29 UTC 2023

Example pass message:

tps-count: 1
tp-start: 1687556306.226567, net/net/t_unix, 1
tc-start: 1687556306.226626, sockaddr_un_local_peereid
tc-so:peer: client socket length: 2
tc-so:peer: client family 1
tc-so:peer: client len 2
tc-so:peer: socket name: 
tc-so:peercred(server) euid=666 egid=999 pid=26814
tc-so:peercred(client) euid=0 egid=0 pid=18122
tc-se:FATAL ERROR: Cannot create results file '/tmp/atf-run.ARVi5C/tcr': Permission denied
tc-so:sock: client socket length: 102
tc-so:sock: client family 1
tc-so:sock: client len 102
tc-so:sock: socket name: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
tc-end: 1687556306.241655, sockaddr_un_local_peereid, passed
tp-end: 1687556306.242938, net/net/t_unix
info: time.end, Fri Jun 23 21:38:26 UTC 2023


>How-To-Repeat:
$ atf-run net/net/t_unix:sockaddr_un_local_peereid

>Fix:
Unknown.

>Audit-Trail:
From: Jim Spath <jspath55@gmail.com>
To: gnats-bugs@netbsd.org
Cc: 
Subject: Re: misc/57505
Date: Thu, 6 Jul 2023 14:41:07 -0400

 Apologies; the posted examples were from a different test. Here are
 examples for the ipsecif_basic_ipv6overipv6_esp_null test case.

 Failure:
 [...]
 tc-se:Fail: stderr not empty
 tc-se:--- /dev/null     2023-06-01 15:15:25.759355544 +0000
 tc-se:+++ /tmp/check.PUKXtg/stderr      2023-06-01 15:15:27.771727676 +0000
 tc-se:@@ -0,0 +1 @@
 tc-se:+rump.ping6: failed to get receiving hop limit
 tc-end: 1685632528.10487, ipsecif_basic_ipv6overipv6_esp_null, failed,
 atf-check failed; see the output of the test for details
 tp-end: 1685632528.11860, net/if_ipsec/t_ipsec
 info: time.end, Thu Jun 1 15:15:28 UTC 2023

 Success:
 [...]
 tc-so:Executing command [ rump.ifconfig shmif0 destroy ]
 tc-so:Executing command [ rump.ifconfig ]
 tc-end: 1685633204.524280, ipsecif_basic_ipv6overipv6_esp_null, passed
 tp-end: 1685633204.526479, net/if_ipsec/t_ipsec
 info: time.end, Thu Jun 1 15:26:44 UTC 2023


 To repeat *this* test:
 atf-run  net/if_ipsec/t_ipsec:ipsecif_basic_ipv6overipv6_esp_null

Home	PR Database Search