NetBSD Problem Report #48284
From gson@gson.org Mon Oct 7 09:26:43 2013
Return-Path: <gson@gson.org>
Received: from mail.netbsd.org (mail.netbsd.org [149.20.53.66])
(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
(Client CN "mail.NetBSD.org", Issuer "Postmaster NetBSD.org" (verified OK))
by mollari.NetBSD.org (Postfix) with ESMTPS id AAA6271352
for <gnats-bugs@gnats.NetBSD.org>; Mon, 7 Oct 2013 09:26:43 +0000 (UTC)
Message-Id: <20131007092634.F03FC75FD5@guava.gson.org>
Date: Mon, 7 Oct 2013 12:26:34 +0300 (EEST)
From: gson@gson.org (Andreas Gustafsson)
Reply-To: gson@gson.org (Andreas Gustafsson)
To: gnats-bugs@gnats.NetBSD.org
Subject: Misleading ATF output when command times out
X-Send-Pr-Version: 3.95
>Number: 48284
>Category: bin
>Synopsis: Misleading ATF output when command times out
>Confidential: no
>Severity: serious
>Priority: medium
>Responsible: jmmv
>State: closed
>Class: sw-bug
>Submitter-Id: net
>Arrival-Date: Mon Oct 07 09:30:00 +0000 2013
>Closed-Date: Sat Feb 08 19:20:38 +0000 2014
>Last-Modified: Sat Feb 08 19:20:38 +0000 2014
>Originator: Andreas Gustafsson
>Release: NetBSD 6.1.2
>Organization:
>Environment:
System: NetBSD
Architecture: x86_64
Machine: amd64
>Description:
When a test program written using the ATF shell API contains a
sequence of atf_check commands, as in
atf_check true
atf_check sleep 1000
and one of the commands times out, the atf-run output contains no
mention of the command that actually timed out, thereby giving the
impression that the timeout happened in the command previous to the
one where it actually did:
tc-start: 1381136245.785726, tc1
tc-so:Executing command [ true ]
tc-end: 1381136251.805048, tc1, failed, Test case timed out after 5 seconds
>How-To-Repeat:
cat <<'EOF' >Atffile
Content-Type: application/X-atf-atffile; version="1"
prop: test-suite = "Foo"
tp: t_foo
EOF
cat <<'EOF' >t_foo
#! /usr/bin/env atf-sh
atf_test_case tc1
tc1_head() {
atf_set "descr" "Illustrate misleading atf-run output"
atf_set "timeout" 5
}
tc1_body() {
atf_check true
atf_check sleep 1000
}
atf_init_test_cases() {
atf_add_test_case tc1
}
EOF
chmod 755 t_foo
atf-run t_foo
>Fix:
I'm guessing that flushing stdout in atf-check.cpp between printing
the "Executing command [ ... ]" message and executing the command will
fix this.
>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: bin-bug-people->jmmv
Responsible-Changed-By: jmmv@NetBSD.org
Responsible-Changed-When: Fri, 11 Oct 2013 15:17:32 +0000
Responsible-Changed-Why:
Not sure if the flushing will do the trick but I'll give it a try.
State-Changed-From-To: open->suspended
State-Changed-By: jmmv@NetBSD.org
State-Changed-When: Sun, 13 Oct 2013 11:30:00 +0000
State-Changed-Why:
Change done in revision c03f4ee8. Will be part of the next atf import.
From: "Julio Merino" <jmmv@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc:
Subject: PR/48284 CVS commit: pkgsrc/devel/atf
Date: Sat, 16 Nov 2013 20:26:55 +0000
Module Name: pkgsrc
Committed By: jmmv
Date: Sat Nov 16 20:26:54 UTC 2013
Modified Files:
pkgsrc/devel/atf: Makefile.common distinfo
Log Message:
Update atf to 0.18:
Experimental version released on November 16th, 2013.
* Issue 45: Added require.memory support in atf-run for FreeBSD.
* Fixed an issue with the handling of cin with libc++.
* Issue 64: Fixed various mandoc formatting warnings.
* NetBSD PR bin/48284: Made atf-check flush its progress message to
stdout so that an interrupted test case always shows the last message
being executed.
* NetBSD PR bin/48285: Fixed atf_check examples in atf-sh-api(3).
To generate a diff of this commit:
cvs rdiff -u -r1.5 -r1.6 pkgsrc/devel/atf/Makefile.common
cvs rdiff -u -r1.19 -r1.20 pkgsrc/devel/atf/distinfo
Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.
State-Changed-From-To: suspended->feedback
State-Changed-By: dholland@NetBSD.org
State-Changed-When: Sun, 17 Nov 2013 18:19:58 +0000
State-Changed-Why:
new atf imported, please give it a try
State-Changed-From-To: feedback->open
State-Changed-By: dholland@NetBSD.org
State-Changed-When: Sun, 17 Nov 2013 18:20:57 +0000
State-Changed-Why:
take it back, appears to only be in pkgsrc
From: "Julio Merino" <jmmv@netbsd.org>
To: gnats-bugs@gnats.NetBSD.org
Cc:
Subject: PR/48284 CVS commit: src/external/bsd/atf/dist
Date: Sat, 8 Feb 2014 19:11:34 +0000
Module Name: src
Committed By: jmmv
Date: Sat Feb 8 19:11:34 UTC 2014
Update of /cvsroot/src/external/bsd/atf/dist
In directory ivanova.netbsd.org:/tmp/cvs-serv25966
Log Message:
Import atf 0.19:
Changes in version 0.19
***********************
Experimental version released on February 7th, 2014.
This is the last release to bundle the code for the deprecated tools.
The next release will drop their code and will stop worrying about
backwards compatibility between the ATF libraries and what the old tools
may or may not support.
If you still require the old tools for some reason, grab a copy of the
'tools' directory now. The code in this directory is standalone and
does not depend on any internal details of atf-c++ any longer.
* Various fixes and improvements to support running as part of the FreeBSD
test suite.
* Project hosting moved from Google Code (as a subproject of Kyua) to
GitHub (as a first-class project). The main reason for the change is
the suppression of binary downloads in Google Code on Jan 15th, 2014.
See https://github.com/jmmv/atf/
* Removed builtin help from atf-sh(1) and atf-check(1) for simplicity
reasons. In other words, their -h option is gone.
* Moved the code of the deprecated tools into a 'tools' directory and
completely decoupled their code from the internals of atf-c++. The
reason for this is to painlessly allow a third-party to maintain a
copy of these tools after we delete them because upcoming changes to
atf-c++ would break the stale tools.
Changes in version 0.18
***********************
Experimental version released on November 16th, 2013.
* Issue 45: Added require.memory support in atf-run for FreeBSD.
* Fixed an issue with the handling of cin with libc++.
* Issue 64: Fixed various mandoc formatting warnings.
* NetBSD PR bin/48284: Made atf-check flush its progress message to
stdout so that an interrupted test case always shows the last message
being executed.
* NetBSD PR bin/48285: Fixed atf_check examples in atf-sh-api(3).
Status:
Vendor Tag: GITHUB_JMMV
Release Tags: atf-0-19
U src/external/bsd/atf/dist/atf-c.h
U src/external/bsd/atf/dist/atf-c++.hpp
U src/external/bsd/atf/dist/AUTHORS
U src/external/bsd/atf/dist/COPYING
U src/external/bsd/atf/dist/NEWS
U src/external/bsd/atf/dist/README
U src/external/bsd/atf/dist/Kyuafile
U src/external/bsd/atf/dist/Atffile
C src/external/bsd/atf/dist/atf-c/pkg_config_test.sh
U src/external/bsd/atf/dist/atf-c/defs.h.in
C src/external/bsd/atf/dist/atf-c/atf-c-api.3
U src/external/bsd/atf/dist/atf-c/build.h
U src/external/bsd/atf/dist/atf-c/check.h
U src/external/bsd/atf/dist/atf-c/config.h
U src/external/bsd/atf/dist/atf-c/error.h
U src/external/bsd/atf/dist/atf-c/error_fwd.h
U src/external/bsd/atf/dist/atf-c/macros.h
U src/external/bsd/atf/dist/atf-c/tc.h
U src/external/bsd/atf/dist/atf-c/tp.h
U src/external/bsd/atf/dist/atf-c/utils.h
U src/external/bsd/atf/dist/atf-c/build.c
U src/external/bsd/atf/dist/atf-c/check.c
U src/external/bsd/atf/dist/atf-c/config.c
U src/external/bsd/atf/dist/atf-c/error.c
U src/external/bsd/atf/dist/atf-c/tc.c
U src/external/bsd/atf/dist/atf-c/tp.c
U src/external/bsd/atf/dist/atf-c/utils.c
U src/external/bsd/atf/dist/atf-c/h_build.h
U src/external/bsd/atf/dist/atf-c/atf_c_test.c
U src/external/bsd/atf/dist/atf-c/build_test.c
U src/external/bsd/atf/dist/atf-c/check_test.c
U src/external/bsd/atf/dist/atf-c/config_test.c
U src/external/bsd/atf/dist/atf-c/error_test.c
C src/external/bsd/atf/dist/atf-c/macros_test.c
U src/external/bsd/atf/dist/atf-c/tc_test.c
U src/external/bsd/atf/dist/atf-c/tp_test.c
U src/external/bsd/atf/dist/atf-c/utils_test.c
U src/external/bsd/atf/dist/atf-c/atf-c.pc.in
U src/external/bsd/atf/dist/atf-c/Atffile
U src/external/bsd/atf/dist/atf-c/Kyuafile
U src/external/bsd/atf/dist/atf-c/macros_h_test.c
U src/external/bsd/atf/dist/atf-c/unused_test.c
U src/external/bsd/atf/dist/atf-c/detail/process_helpers.c
C src/external/bsd/atf/dist/atf-c/detail/test_helpers.c
U src/external/bsd/atf/dist/atf-c/detail/test_helpers.h
U src/external/bsd/atf/dist/atf-c/detail/dynstr.c
U src/external/bsd/atf/dist/atf-c/detail/dynstr.h
U src/external/bsd/atf/dist/atf-c/detail/env.c
U src/external/bsd/atf/dist/atf-c/detail/env.h
U src/external/bsd/atf/dist/atf-c/detail/fs.c
U src/external/bsd/atf/dist/atf-c/detail/fs.h
U src/external/bsd/atf/dist/atf-c/detail/list.c
U src/external/bsd/atf/dist/atf-c/detail/list.h
U src/external/bsd/atf/dist/atf-c/detail/map.c
U src/external/bsd/atf/dist/atf-c/detail/map.h
U src/external/bsd/atf/dist/atf-c/detail/process.c
U src/external/bsd/atf/dist/atf-c/detail/process.h
U src/external/bsd/atf/dist/atf-c/detail/sanity.c
U src/external/bsd/atf/dist/atf-c/detail/sanity.h
U src/external/bsd/atf/dist/atf-c/detail/text.c
U src/external/bsd/atf/dist/atf-c/detail/text.h
U src/external/bsd/atf/dist/atf-c/detail/tp_main.c
U src/external/bsd/atf/dist/atf-c/detail/user.c
U src/external/bsd/atf/dist/atf-c/detail/user.h
U src/external/bsd/atf/dist/atf-c/detail/dynstr_test.c
U src/external/bsd/atf/dist/atf-c/detail/env_test.c
U src/external/bsd/atf/dist/atf-c/detail/fs_test.c
U src/external/bsd/atf/dist/atf-c/detail/list_test.c
U src/external/bsd/atf/dist/atf-c/detail/map_test.c
U src/external/bsd/atf/dist/atf-c/detail/process_test.c
U src/external/bsd/atf/dist/atf-c/detail/sanity_test.c
U src/external/bsd/atf/dist/atf-c/detail/text_test.c
U src/external/bsd/atf/dist/atf-c/detail/user_test.c
N src/external/bsd/atf/dist/atf-c/detail/version_helper.c
U src/external/bsd/atf/dist/atf-c/detail/Atffile
U src/external/bsd/atf/dist/atf-c/detail/Kyuafile
U src/external/bsd/atf/dist/atf-c++/macros_hpp_test.cpp
U src/external/bsd/atf/dist/atf-c++/atf-c++-api.3
U src/external/bsd/atf/dist/atf-c++/build.hpp
U src/external/bsd/atf/dist/atf-c++/check.hpp
U src/external/bsd/atf/dist/atf-c++/config.hpp
U src/external/bsd/atf/dist/atf-c++/macros.hpp
C src/external/bsd/atf/dist/atf-c++/tests.hpp
U src/external/bsd/atf/dist/atf-c++/utils.hpp
U src/external/bsd/atf/dist/atf-c++/build.cpp
U src/external/bsd/atf/dist/atf-c++/check.cpp
U src/external/bsd/atf/dist/atf-c++/config.cpp
C src/external/bsd/atf/dist/atf-c++/tests.cpp
U src/external/bsd/atf/dist/atf-c++/utils.cpp
U src/external/bsd/atf/dist/atf-c++/atf_c++_test.cpp
U src/external/bsd/atf/dist/atf-c++/build_test.cpp
U src/external/bsd/atf/dist/atf-c++/check_test.cpp
U src/external/bsd/atf/dist/atf-c++/config_test.cpp
U src/external/bsd/atf/dist/atf-c++/macros_test.cpp
U src/external/bsd/atf/dist/atf-c++/tests_test.cpp
U src/external/bsd/atf/dist/atf-c++/utils_test.cpp
U src/external/bsd/atf/dist/atf-c++/atf-c++.pc.in
U src/external/bsd/atf/dist/atf-c++/Atffile
U src/external/bsd/atf/dist/atf-c++/Kyuafile
C src/external/bsd/atf/dist/atf-c++/pkg_config_test.sh
U src/external/bsd/atf/dist/atf-c++/unused_test.cpp
U src/external/bsd/atf/dist/atf-c++/detail/application_test.cpp
U src/external/bsd/atf/dist/atf-c++/detail/test_helpers.cpp
U src/external/bsd/atf/dist/atf-c++/detail/test_helpers.hpp
U src/external/bsd/atf/dist/atf-c++/detail/application.cpp
U src/external/bsd/atf/dist/atf-c++/detail/application.hpp
U src/external/bsd/atf/dist/atf-c++/detail/auto_array.hpp
U src/external/bsd/atf/dist/atf-c++/detail/env.cpp
U src/external/bsd/atf/dist/atf-c++/detail/env.hpp
U src/external/bsd/atf/dist/atf-c++/detail/exceptions.cpp
U src/external/bsd/atf/dist/atf-c++/detail/exceptions.hpp
U src/external/bsd/atf/dist/atf-c++/detail/fs.cpp
U src/external/bsd/atf/dist/atf-c++/detail/fs.hpp
U src/external/bsd/atf/dist/atf-c++/detail/process.cpp
U src/external/bsd/atf/dist/atf-c++/detail/process.hpp
U src/external/bsd/atf/dist/atf-c++/detail/sanity.hpp
U src/external/bsd/atf/dist/atf-c++/detail/text.cpp
U src/external/bsd/atf/dist/atf-c++/detail/text.hpp
U src/external/bsd/atf/dist/atf-c++/detail/auto_array_test.cpp
U src/external/bsd/atf/dist/atf-c++/detail/env_test.cpp
U src/external/bsd/atf/dist/atf-c++/detail/exceptions_test.cpp
U src/external/bsd/atf/dist/atf-c++/detail/fs_test.cpp
U src/external/bsd/atf/dist/atf-c++/detail/process_test.cpp
U src/external/bsd/atf/dist/atf-c++/detail/sanity_test.cpp
U src/external/bsd/atf/dist/atf-c++/detail/text_test.cpp
N src/external/bsd/atf/dist/atf-c++/detail/version_helper.cpp
U src/external/bsd/atf/dist/atf-c++/detail/Atffile
U src/external/bsd/atf/dist/atf-c++/detail/Kyuafile
U src/external/bsd/atf/dist/atf-sh/atf_check_test.sh
U src/external/bsd/atf/dist/atf-sh/atf-check.1
U src/external/bsd/atf/dist/atf-sh/atf-sh.1
U src/external/bsd/atf/dist/atf-sh/atf-sh-api.3
C src/external/bsd/atf/dist/atf-sh/atf-check.cpp
U src/external/bsd/atf/dist/atf-sh/atf-sh.cpp
U src/external/bsd/atf/dist/atf-sh/libatf-sh.subr
U src/external/bsd/atf/dist/atf-sh/atf-sh.pc.in
U src/external/bsd/atf/dist/atf-sh/Atffile
U src/external/bsd/atf/dist/atf-sh/Kyuafile
U src/external/bsd/atf/dist/atf-sh/misc_helpers.sh
U src/external/bsd/atf/dist/atf-sh/atf-check_test.sh
U src/external/bsd/atf/dist/atf-sh/config_test.sh
U src/external/bsd/atf/dist/atf-sh/integration_test.sh
U src/external/bsd/atf/dist/atf-sh/normalize_test.sh
U src/external/bsd/atf/dist/atf-sh/tc_test.sh
U src/external/bsd/atf/dist/atf-sh/tp_test.sh
U src/external/bsd/atf/dist/doc/atf-test-program.1
C src/external/bsd/atf/dist/doc/atf-test-case.4
U src/external/bsd/atf/dist/test-programs/meta_data_test.sh
U src/external/bsd/atf/dist/test-programs/c_helpers.c
U src/external/bsd/atf/dist/test-programs/cpp_helpers.cpp
U src/external/bsd/atf/dist/test-programs/Atffile
U src/external/bsd/atf/dist/test-programs/Kyuafile
U src/external/bsd/atf/dist/test-programs/common.sh
U src/external/bsd/atf/dist/test-programs/sh_helpers.sh
U src/external/bsd/atf/dist/test-programs/config_test.sh
U src/external/bsd/atf/dist/test-programs/expect_test.sh
U src/external/bsd/atf/dist/test-programs/result_test.sh
U src/external/bsd/atf/dist/test-programs/srcdir_test.sh
C src/external/bsd/atf/dist/tools/atf-config.cpp
N src/external/bsd/atf/dist/tools/defs.hpp.in
C src/external/bsd/atf/dist/tools/atf-config.1
C src/external/bsd/atf/dist/tools/atf-report.1
C src/external/bsd/atf/dist/tools/atf-run.1
C src/external/bsd/atf/dist/tools/atf-version.1
N src/external/bsd/atf/dist/tools/atf-formats.5
N src/external/bsd/atf/dist/tools/application.cpp
N src/external/bsd/atf/dist/tools/application.hpp
N src/external/bsd/atf/dist/tools/atffile.cpp
N src/external/bsd/atf/dist/tools/atffile.hpp
N src/external/bsd/atf/dist/tools/auto_array.hpp
N src/external/bsd/atf/dist/tools/config.cpp
N src/external/bsd/atf/dist/tools/config.hpp
N src/external/bsd/atf/dist/tools/config_file.cpp
N src/external/bsd/atf/dist/tools/config_file.hpp
N src/external/bsd/atf/dist/tools/env.cpp
N src/external/bsd/atf/dist/tools/env.hpp
N src/external/bsd/atf/dist/tools/exceptions.cpp
N src/external/bsd/atf/dist/tools/ui.cpp
N src/external/bsd/atf/dist/tools/exceptions.hpp
N src/external/bsd/atf/dist/tools/fs.cpp
N src/external/bsd/atf/dist/tools/expand.cpp
N src/external/bsd/atf/dist/tools/expand.hpp
N src/external/bsd/atf/dist/tools/fs.hpp
N src/external/bsd/atf/dist/tools/io.cpp
N src/external/bsd/atf/dist/tools/io.hpp
N src/external/bsd/atf/dist/tools/parser.cpp
N src/external/bsd/atf/dist/tools/parser.hpp
N src/external/bsd/atf/dist/tools/process.cpp
N src/external/bsd/atf/dist/tools/process.hpp
N src/external/bsd/atf/dist/tools/reader.cpp
N src/external/bsd/atf/dist/tools/reader.hpp
N src/external/bsd/atf/dist/tools/requirements.cpp
N src/external/bsd/atf/dist/tools/requirements.hpp
N src/external/bsd/atf/dist/tools/signals.cpp
N src/external/bsd/atf/dist/tools/signals.hpp
N src/external/bsd/atf/dist/tools/test-program.cpp
N src/external/bsd/atf/dist/tools/test-program.hpp
N src/external/bsd/atf/dist/tools/test_helpers.hpp
N src/external/bsd/atf/dist/tools/text.cpp
N src/external/bsd/atf/dist/tools/text.hpp
N src/external/bsd/atf/dist/tools/timers.cpp
N src/external/bsd/atf/dist/tools/timers.hpp
N src/external/bsd/atf/dist/tools/ui.hpp
N src/external/bsd/atf/dist/tools/user.cpp
N src/external/bsd/atf/dist/tools/user.hpp
N src/external/bsd/atf/dist/tools/bad_metadata_helper.c
N src/external/bsd/atf/dist/tools/application_test.cpp
C src/external/bsd/atf/dist/tools/atf-report.cpp
C src/external/bsd/atf/dist/tools/atf-run.cpp
C src/external/bsd/atf/dist/tools/atf-version.cpp
N src/external/bsd/atf/dist/tools/atffile_test.cpp
N src/external/bsd/atf/dist/tools/auto_array_test.cpp
N src/external/bsd/atf/dist/tools/requirements_test.cpp
N src/external/bsd/atf/dist/tools/config_file_test.cpp
N src/external/bsd/atf/dist/tools/config_test.cpp
N src/external/bsd/atf/dist/tools/env_test.cpp
N src/external/bsd/atf/dist/tools/expand_test.cpp
N src/external/bsd/atf/dist/tools/expect_helpers.c
N src/external/bsd/atf/dist/tools/fail_helper.cpp
N src/external/bsd/atf/dist/tools/fs_test.cpp
N src/external/bsd/atf/dist/tools/io_test.cpp
N src/external/bsd/atf/dist/tools/misc_helpers.cpp
N src/external/bsd/atf/dist/tools/parser_test.cpp
N src/external/bsd/atf/dist/tools/pass_helper.cpp
N src/external/bsd/atf/dist/tools/process_helpers.c
N src/external/bsd/atf/dist/tools/process_test.cpp
N src/external/bsd/atf/dist/tools/reader_test.cpp
N src/external/bsd/atf/dist/tools/test_program_test.cpp
N src/external/bsd/atf/dist/tools/several_tcs_helper.c
N src/external/bsd/atf/dist/tools/signals_test.cpp
N src/external/bsd/atf/dist/tools/zero_tcs_helper.c
N src/external/bsd/atf/dist/tools/text_test.cpp
N src/external/bsd/atf/dist/tools/ui_test.cpp
N src/external/bsd/atf/dist/tools/user_test.cpp
N src/external/bsd/atf/dist/tools/atf-run_test.sh
N src/external/bsd/atf/dist/tools/Kyuafile
N src/external/bsd/atf/dist/tools/atf.7.in
N src/external/bsd/atf/dist/tools/tests-results.css
N src/external/bsd/atf/dist/tools/tests-results.dtd
N src/external/bsd/atf/dist/tools/tests-results.xsl
N src/external/bsd/atf/dist/tools/Atffile
N src/external/bsd/atf/dist/tools/atf-config_test.sh
N src/external/bsd/atf/dist/tools/atf-report_test.sh
N src/external/bsd/atf/dist/tools/sample/atf-run.hooks
N src/external/bsd/atf/dist/tools/sample/common.conf
N src/external/bsd/atf/dist/tools/share/atf-run.hooks
17 conflicts created by this import.
Use the following command to help the merge:
cvs checkout -jGITHUB_JMMV:yesterday -jGITHUB_JMMV src/external/bsd/atf/dist
State-Changed-From-To: open->closed
State-Changed-By: jmmv@NetBSD.org
State-Changed-When: Sat, 08 Feb 2014 19:20:38 +0000
State-Changed-Why:
I think this should be fixed with the import of atf 0.19.
>Unformatted:
(Contact us)
$NetBSD: query-full-pr,v 1.39 2013/11/01 18:47:49 spz Exp $
$NetBSD: gnats_config.sh,v 1.8 2006/05/07 09:23:38 tsutsui Exp $
Copyright © 1994-2007
The NetBSD Foundation, Inc. ALL RIGHTS RESERVED.