bug#10440: Can't locate TAP/Parser.pm

[Stefano Lattarini]

On 01/06/2012 04:50 PM, Peter Rosin wrote:
> Stefano Lattarini skrev 2012-01-06 13:34:
>> On 01/05/2012 10:54 PM, Peter Rosin wrote:
>>> Hi!
>>>
>> Hi Peter, and thanks for your relentless testing on MinGW/MSYS.
>>
>>> I tried make check on MSYS with the current master, and among other
>>> things, this problem stands out as it FAILs so many test cases.
>>>
>>> I'm using tap-bailout-w.test as an example, no use reporting the
>>> same problem 80+ times, right :-)
> 
> *SNIP*
> 
>> Could you verify that the attached patch solves the issue?  I've tested
>> it by putting a broken TAP::Parser early in @INC, so it should work; but
>> as you know there is no substitute to testing with the "real thing".
> 
> Yes, this works, loads of SKIPs instead of FAILs, as expected (but
> I haven't checked all tests in detail since there's still too much
> noise). Please push anyway as it's a huge improvement even if there
> is some minor perl-tap thing left behind, and thanks for the quick
> fix!
>
OK, I've pushed the patch with this improved commit message:

  tests: skip tests on perl TAP driver if TAP::Parser is not available

  We had so far taken for granted that all the perl installations
  modern enough to correctly run automake also came with a built-in
  TAP::Parser module; unfortunately, testing on MinGW/MSYS has
  shown that this is not always true, and that a lot of spurious
  testsuite failures would take place in such a situation (see
  automake bug#10440).

  Luckily, the perl implementation of the Automake TAP driver is
  only meant to be used for prototyping and consistency checks, the
  "real" Automake TAP driver being the portable one implemented in
  awk.  So we can simply skip the affected tests on systems lacking
  TAP::Parser.

  * tests/defs (fetch_tap_driver): Skip the whole test case if
  the desired tap driver implementation is the perl one but the
  TAP::Parser module is unavailable.
  * tests/tap-bad-prog.tap: Adjust order of calls to `plan_' and
  `fetch_tap_driver', to ensure the test is not skipped after the
  TAP plan has been outputted (which would lead to a spurious
  error).
  * tests/tap-bad-signal.tap: Tweak to avoid the need to source the
  `tap-setup.sh' script, as that might cause a test skip too late,
  i.e., after a TAP plan has been already printed.
  * tests/tap-test-number-0.test: Do not force the test to skip
  when the tested TAP driver implementation is not the perl one.
  On the other hand, when it *is* the perl one, skip the test if
  the TAP::Parser module is unavailable.
  * tests/test-driver-cond.test: Skip the part of the test actually
  running "make check" if the TAP::Parser module is unavailable.
  * tests/get-sysconf.test: Also print the version of the
  `TAP::Parser' module, if available.

  Reported by Peter Rosin.

Thanks for all the testing,
  Stefano