[Automake-commit] [SCM] GNU Automake branch, GSoC/experimental/test-results-work, created. v1.11-898-g2df7238

[Stefano Lattarini]

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "GNU Automake".

http://git.sv.gnu.org/gitweb/?p=automake.git;a=commitdiff;h=2df72384ab57d165c7e1da0f88e513171a0035e8

The branch, GSoC/experimental/test-results-work has been created
        at  2df72384ab57d165c7e1da0f88e513171a0035e8 (commit)

- Log -----------------------------------------------------------------
commit 2df72384ab57d165c7e1da0f88e513171a0035e8
Author: Stefano Lattarini <address@hidden>
Date:   Thu Jun 30 14:55:43 2011 +0200

    parallel-tests: new recognized test result 'ERROR'
    
    * lib/am/check.am ($(TEST_SUITE_LOG)): Recognize a new test result
    `ERROR'.  Use it when encountering unreadable test logs (previously
    a simple `FAIL' was used in this situations).
    * lib/test-driver: Set the global test result to `ERROR' when the
    test exit status is 99.  When doing colorized output, color `ERROR'
    results in magenta.
    * doc/automake.texi (Log files generation and test results
    recording): Update by also listing `ERROR' among the list of valid
    `:test-results:' arguments.
    * tests/trivial-test-driver: Update.
    * tests/parallel-tests.test: Likewise.
    * tests/parallel-tests-harderror.test: Likewise.
    * tests/parallel-tests-no-spurious-summary.test: Likewise.
    * tests/test-driver-global-log.test: Likewise.
    * tests/test-driver-recheck.test: Likewise.
    * tests/test-driver-custom-multitest-recheck.test: Likewise.
    * tests/test-driver-custom-multitest-recheck2.test: Likewise.
    * tests/test-driver-custom-multitest.test: Likewise.
    * tests/test-driver-custom-no-html.test: Likewise.
    * tests/test-driver-end-test-results.test: Likewise.
    * tests/color.test: Likewise, and make stricter.
    * tests/color2.test: Likewise, and improve syncing with color.test.
    * tests/parallel-tests-exit-statuses.test: New test.
    * tests/parallel-tests-console-output.test: New test.
    * tests/Makefile.am (TESTS): Update.

commit 310e80b275ed120af4999e0dad018b8a5732fd02
Author: Stefano Lattarini <address@hidden>
Date:   Wed Jun 29 16:02:52 2011 +0200

    parallel-tests: make parsing of test results safer
    
    The new code for parsing the testsuite-generated `.log' files,
    as introduced in commit `v1.11-872-gc96b881', considers each
    `:test-result:' field anywhere in a `.log' file as a declaration
    of a test result, and accounts for it as such in the testsuite
    summary.  Unfortunately this could easily cause spurious test
    failures being reported in the testsuite summary.  This happened
    in practice with the Automake's own testsuite; for example:
    
      $ make check TESTS='check12-p.test'; echo exit: $?
      ...
      PASS: check12-p.test
      =====================================
      4 of 5 tests failed
      See tests/test-suite.log
      Please report to address@hidden
      =====================================
      make[2]: *** [test-suite.log] Error 1
      make: *** [check-am] Error 2
      exit: 2
    
    This change introduces a new special `:test-result:' "END", that,
    when seen, prevents the rest of the log file from being parsed.
    
    For more information, refer to the thread:
    <http://lists.gnu.org/archive/html/automake-patches/2011-06/msg00199.html>
    
    * lib/am/check.am ($(TEST_SUITE_LOG)): Stop the parsing of a log
    file as soon as the special ":test-result:END" directive is seen.
    Related changes and enhancements.
    * lib/test-driver: Protect the rest of the log after the result
    lined with a ":test-result:END" directive.
    * tests/parallel-tests-no-spurious-summary.test: New test.
    * tests/test-driver-end-test-results.test: Likewise.
    * tests/Makefile.am (TESTS): Update.

-----------------------------------------------------------------------


hooks/post-receive
-- 
GNU Automake