NetBSD Problem Report #42885

From martin@aprisoft.de  Fri Feb 26 09:28:22 2010
Return-Path: <martin@aprisoft.de>
Received: from mail.netbsd.org (mail.netbsd.org [204.152.190.11])
	by www.NetBSD.org (Postfix) with ESMTP id F24C963B8DE
	for <gnats-bugs@gnats.NetBSD.org>; Fri, 26 Feb 2010 09:28:21 +0000 (UTC)
Message-Id: <20100226092814.33572AF5818@emmas.aprisoft.de>
Date: Fri, 26 Feb 2010 10:28:14 +0100 (CET)
From: martin@NetBSD.org
Reply-To: martin@NetBSD.org
To: gnats-bugs@gnats.NetBSD.org
Subject: need a way to select non-expensive tests in ATF
X-Send-Pr-Version: 3.95

>Number:         42885
>Category:       toolchain
>Synopsis:       need a way to select non-expensive tests in ATF
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    toolchain-manager
>State:          open
>Class:          change-request
>Submitter-Id:   net
>Arrival-Date:   Fri Feb 26 09:30:00 +0000 2010
>Last-Modified:  Sun Feb 28 22:10:03 +0000 2010
>Originator:     Martin Husemann
>Release:        NetBSD 5.99.24
>Organization:
The NetBSD Foundation, Inc.
>Environment:
System: NetBSD nelly.aprisoft.de 5.99.24 NetBSD 5.99.24 (NELLY.MP) #120: Wed Feb 24 21:49:22 CET 2010 martin@emmas.aprisoft.de:/nelly/usr/src/sys/arch/sparc64/compile/NELLY.MP sparc64
Architecture: sparc64
Machine: sparc64
>Description:

The test in 

   src/tests/lib/libc/string/t_popcount.c

is a very expensive test. It is good to have, but you can't afford to run
it on every test run (it takes multiple hours on a fast amd64 machine,
go fiugre and extrapolate to something like m68k).

It is good to have this complete test, but since there is no way to tell
ATF "no expensive tests right now, please" (which should be the default),
I'm going to disable it for now.

>How-To-Repeat:
s/a

>Fix:

>Audit-Trail:
From: Martin Husemann <martin@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc: 
Subject: PR/42885 CVS commit: src/tests/lib/libc
Date: Fri, 26 Feb 2010 09:35:08 +0000

 Module Name:	src
 Committed By:	martin
 Date:		Fri Feb 26 09:35:08 UTC 2010

 Modified Files:
 	src/tests/lib/libc: Makefile
 	src/tests/lib/libc/string: Makefile

 Log Message:
 Disable population count test for now, please re-enable once
 PR toolchain/42885 is fixed


 To generate a diff of this commit:
 cvs rdiff -u -r1.3 -r1.4 src/tests/lib/libc/Makefile
 cvs rdiff -u -r1.1 -r1.2 src/tests/lib/libc/string/Makefile

 Please note that diffs are not public domain; they are subject to the
 copyright notices on the relevant files.

From: David Holland <dholland-bugs@netbsd.org>
To: gnats-bugs@NetBSD.org
Cc: 
Subject: Re: toolchain/42885: need a way to select non-expensive tests in
	ATF
Date: Sun, 28 Feb 2010 22:08:44 +0000

 On Fri, Feb 26, 2010 at 09:30:00AM +0000, martin@NetBSD.org wrote:
  > It is good to have this complete test, but [...]

 FWIW, I think the test is ridiculous. Exhaustive tests are a copout
 and they don't accomplish anything much anyway over better tests.

 -- 
 David A. Holland
 dholland@netbsd.org

Home	PR Database Search