Re: [Discuss-gnuradio] make test failure at qa_constellation_receiver

[Alick Zhao]

On Fri, 13 Apr 2012 13:20:01 -0700, Ben Reynwar wrote:
> 2012/4/12 Alick Zhao <address@hidden>:
>> Hi all,
>>
>> Recently I have upgraded my gnuradio build to v3.5.3 on several
>> computers, and I find that on two machines with Ubuntu 11.10, make test
>> will fail the test qa_constellation_receiver while on the other two with
>> Fedora 16 all tests are passed.
>>
>> To investigate the problem, I add one line in the file
>> `gr-digital/python/qa_constellation_receiver.py` which just print the
>> value of constellation, differential, and correct before the assert.
>> Then I run the script
>> `build/gr-digital/python/qa_constellation_receiver_test.sh`. The output
>> is recorded and attached below. Among them:
>>
>> * test.t41.log is from a Thinkpad T41 with Ubuntu 11.10 32bit installed,
>> * test.t60.log is from a Thinkpad T60 with Ubuntu 11.10 32bit installed,
>> * test.f16.log is from a HP 6531s with Fedora 16 x86_64 installed.
>>
>> Hope these logs are helpful to diagnose the problem.
>>
>> PS: As a side note, my debugging line's output appears later than the
>> result, which is not the case for screen output. I think this is
>> probably related to stdout buffering.
>>
>> PS2: I once changed the REQ_CORRECT to 0.7 on one Ubuntu machine,
>> and then made the test passed. I wonder if it is a valid fix.
>>
> 
> It sounds like this is definitely a bug, but it's hard for me to track
> it down because I can't replicate it.  Does the bug still occur if you
> set FREQUENCY_OFFSET = 0 in the test case?

Yes the bug still occurs.

I just wrote a simple script to ran the test for 50 times on T60 with
Ubuntu, GNU Radio 3.5.3 equipped, before and after FREQUENCY_OFFSET set
to 0. All failed the test. (n_pass is 0/50 in both sets) Every test's
output is almost identical in each set except particular test time
length. The ones before FREQUENCY_OFFSET change is basically the same as
test.t60.log already attached. One of the ones with FREQUENCY_OFFSET set
to 0 is attached below. I guess the almost same contents of output is
due to fixed random seed.

I also ran the script on a Dell desktop with Fedora, and the result is
50/50 pass the test. Then I notice one line in the qa python file says
that seed 1234 fails. However, 50/50 are OK with seed 1234 on the Dell
desktop.

alick

ctest.log.46
Description: Text document

do_repeat_test
Description: Text document