Re: [Discuss-gnuradio] make test errors

[Josh Blum]

On 06/12/2013 08:47 AM, Botany Dave wrote:
> Is there a way to check before I do "make install"? I'm still at the point of 
> trying to resolve issues found while running "make test".
> 

when you configure, cmake ~/src/gnuradio-checkout...
The last thing printed should be the git hash

The best thing you can do is collect all the error verbose, and then OS
version, gr version, and get it on a bug tracker issue so the devs can
replicate and fix it.

-josh

> 
> 
> 
> ________________________________
>  From: Karan Talasila [via GnuRadio] <address@hidden>
> To: Botany Dave <address@hidden> 
> Sent: Wednesday, June 12, 2013 2:29 AM
> Subject: Re: make test errors
>  
> 
> 
> Hi Dave,
>               To know the gnuradio version being used type 
> gnuradio-config-info -v in the terminal.
> 
> 
> 
> On Wed, Jun 12, 2013 at 6:45 AM, Dave L <[hidden email]> wrote:
> 
> The OS is Ubuntu 12.10 (32 bit).
>>
>> Frankly, I'm not sure which version of gnuradio this is, but I installed it 
>> from http://gnuradio.org/git/gnuradio.git/ last week.
>>
>>
>>
>>
>> ________________________________
>> From: Josh Blum <[hidden email]>
>> To: [hidden email] 
>> Sent: Tuesday, June 11, 2013 6:02 PM
>>
>> Subject: Re: [Discuss-gnuradio] make test errors
>>
>>
>>
>>
>> On
>  06/11/2013 07:34 PM, Botany Dave wrote:
>>> ./volk/lib/test-all completes with no errors found.
>>>
>>> Any other suggestions would be very much appreciated.
>>>
>>>
>>>
>>
>> :-(
>>
>> Well, having the volk qa fail would have nicely narrowed it down. I
>> guess that now its potentially ambiguous to blame volk. The good news, I
>> think those tests are related.
>>
>> Can you report the OS name version, 32/64 bit?
>> The version of gnuradio where the tests failed?
>>
>> -josh
>>
>>> ________________________________
>>>   From: Josh Blum-2 [via GnuRadio] <ml-node+[hidden email]>
>>> To: Botany Dave <[hidden email]> 
>>> Sent: Monday, June 10, 2013 7:13 PM
>>> Subject: Re: make test
>  errors
>>>   
>>>
>>>
>>> Run volk/lib/test_all from the build dir 
>>>
>>> If a kernel fails, it will tell you which one, start commenting out its 
>>> implementations in the source dir volk/kernels/volk/volk_*.h until the 
>>> test works. We narrow down suspect implementation and fix. 
>>>
>>> -josh 
>>>
>>> On 06/10/2013 09:57 PM, Dave L wrote: 
>>>
>>>> The CPU on the laptop is an Intel i3-2350M (64 bit). 
>>>>
>>>> What steps should I take (or where can I learn how) to resolve the problem 
>>>> with Volk? 
>>>>
>>>> Dave 
>>>>
>>>>
>>>>
>>>>
>>>> ________________________________ 
>>>>   From: Tom Rondeau <[hidden email]> 
>>>> To: Botany Dave <[hidden email]> 
>>>> Sent: Monday, June 10, 2013 6:41 AM 
>>>> Subject: Re: [Discuss-gnuradio] make test errors 
>>>>   
>>>>
>>>> On Thu, Jun 6, 2013 at 11:52 PM, Botany Dave <[hidden email]> wrote: 
>>>>> I'm new to this, and I'm sure it will show... 
>>>>>
>>>>> I am trying to install and run Gnu Radio in an Ubuntu 12.10 environment. 
>>>>> I 
>>>>> followed the instructions at 
>>>>> http://gnuradio.org/redmine/projects/gnuradio/wiki/UbuntuInstall#Installation-Overview
>>>>> and am getting errors on four modules when I run make test. They are: 
>>>>>
>>>>> 86 - qa_fir_filter 
>>>>> 91 - qa_freq__xlating_fir_filter 
>>>>> 150 - qa_constellation_receiver 
>>>>> 169 - qa_codec2_vocoder 
>>>>>
>>>>> Here is the output of ctest -V -R qa for each of those modules. I'd 
>>>>> really 
>>>>> appreciate any guidance on
>  how to resolve these failures. 
>>>>>
>>>>> 86: Test command: /bin/sh 
>>>>> "/home/dave/gnuradio/build/gr-filter/python/qa_fir_filter_test.sh" 
>>>>> 86: Test timeout computed to be: 9.99988e+06 
>>>>> 86: .........FF 
>>>>> 86: 
>>>>> ====================================================================== 
>>>>> 86: FAIL: test_fir_filter_scc_001 (__main__.test_filter) 
>>>>> 86: 
>>>>> ---------------------------------------------------------------------- 
>>>>> 86: Traceback (most recent call last): 
>>>>> 86:   File "/home/dave/gnuradio/gr-filter/python/qa_fir_filter.py", line 
>>>>> 262, in test_fir_filter_scc_001 
>>>>> 86:     self.assertComplexTuplesAlmostEqual(expected_data, result_data, 
>>>>> 5) 
>>>>> 86:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 74, in assertComplexTuplesAlmostEqual 
>>>>> 86:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>>>> 86:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 47, in assertComplexAlmostEqual 
>>>>> 86:     (msg or '%s != %s within %s places' % (`first`, `second`, 
>>>>> `places` 
>>>>> )) 
>>>>> 86: AssertionError: (0.5+1j) != (nan+nanj) within 5 places 
>>>>> 86: 
>>>>> 86: 
>>>>> ====================================================================== 
>>>>> 86: FAIL: test_fir_filter_scc_002 (__main__.test_filter) 
>>>>> 86: 
>>>>> ---------------------------------------------------------------------- 
>>>>> 86: Traceback (most recent call last): 
>>>>> 86: Using Volk machine: avx_32_mmx 
>>>>> 86:   File
>  "/home/dave/gnuradio/gr-filter/python/qa_fir_filter.py", line 
>>>>> 281, in test_fir_filter_scc_002 
>>>>> 86:     self.assertComplexTuplesAlmostEqual(expected_data, result_data, 
>>>>> 5) 
>>>>> 86:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 74, in assertComplexTuplesAlmostEqual 
>>>>> 86:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>>>> 86:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 47, in assertComplexAlmostEqual 
>>>>> 86:     (msg or '%s != %s within %s places' % (`first`, `second`, 
>>>>> `places` 
>>>>> )) 
>>>>> 86: AssertionError: (0.5+1j) != (nan+nanj) within 5 places 
>>>>> 86: 
>>>>> 86:
>  ---------------------------------------------------------------------- 
>>>>> 86: Ran 11 tests in 0.035s 
>>>>> 86: 
>>>>> 86: FAILED (failures=2) 
>>>>> 1/1 Test #86: qa_fir_filter ....................***Failed    0.30 sec 
>>>>>
>>>>> 0% tests passed, 1 tests failed out of 1 
>>>>>
>>>>> Total Test time (real) =   0.31 sec 
>>>>>
>>>>> The following tests FAILED: 
>>>>>        86 - qa_fir_filter (Failed) 
>>>>> Errors while running CTest 
>>>>>
>>>>>
>>>>> 91: Test command: /bin/sh 
>>>>> "/home/dave/gnuradio/build/gr-filter/python/qa_freq_xlating_fir_filter_test.sh"
>>>>>  
>>>>> 91: Test timeout computed to be: 9.99988e+06 
>>>>> 91: ........FFFF 
>>>>> 91: 
>>>>> ====================================================================== 
>>>>> 91: FAIL: test_fir_filter_scc_001 (__main__.test_freq_xlating_filter) 
>>>>> 91: 
>>>>> ---------------------------------------------------------------------- 
>>>>> 91: Traceback (most recent call last): 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", 
>>>>> line 
>>>>> 412, in test_fir_filter_scc_001 
>>>>> 91:     self.assertComplexTuplesAlmostEqual(expected_data, 
>>>>> result_data[-20:], 5) 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 74, in assertComplexTuplesAlmostEqual 
>>>>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 47, in
>  assertComplexAlmostEqual 
>>>>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, 
>>>>> `places` 
>>>>> )) 
>>>>> 91: AssertionError: (-0.00775564694777+0.0437113791704j) != (nan+nanj) 
>>>>> within 5 places 
>>>>> 91: 
>>>>> 91: 
>>>>> ====================================================================== 
>>>>> 91: Using Volk machine: avx_32_mmx 
>>>>> 91: FAIL: test_fir_filter_scc_002 (__main__.test_freq_xlating_filter) 
>>>>> 91: 
>>>>> ---------------------------------------------------------------------- 
>>>>> 91: Traceback (most recent call last): 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", 
>>>>> line 
>>>>> 442, in test_fir_filter_scc_002 
>>>>> 91:     self.assertComplexTuplesAlmostEqual(expected_data, 
>>>>> result_data[-20:], 5) 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 74, in assertComplexTuplesAlmostEqual 
>>>>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 47, in assertComplexAlmostEqual 
>>>>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, 
>>>>> `places` 
>>>>> )) 
>>>>> 91: AssertionError: (-0.0080680437386-0.00158522999845j) != (nan+nanj) 
>>>>> within 5 places 
>>>>> 91: 
>>>>> 91: 
>>>>> ====================================================================== 
>>>>> 91: FAIL: test_fir_filter_scf_001 (__main__.test_freq_xlating_filter) 
>>>>> 91:
>  ---------------------------------------------------------------------- 
>>>>> 91: Traceback (most recent call last): 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", 
>>>>> line 
>>>>> 352, in test_fir_filter_scf_001 
>>>>> 91:     self.assertComplexTuplesAlmostEqual(expected_data, 
>>>>> result_data[-20:], 5) 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 74, in assertComplexTuplesAlmostEqual 
>>>>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 47, in assertComplexAlmostEqual 
>>>>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`,
>  `places` 
>>>>> )) 
>>>>> 91: AssertionError: (-0.0330070219934+0.101965591311j) != (nan+nanj) 
>>>>> within 
>>>>> 5 places 
>>>>> 91: 
>>>>> 91: 
>>>>> ====================================================================== 
>>>>> 91: FAIL: test_fir_filter_scf_002 (__main__.test_freq_xlating_filter) 
>>>>> 91: 
>>>>> ---------------------------------------------------------------------- 
>>>>> 91: Traceback (most recent call last): 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", 
>>>>> line 
>>>>> 382, in test_fir_filter_scf_002 
>>>>> 91:     self.assertComplexTuplesAlmostEqual(expected_data, 
>>>>> result_data[-20:], 5) 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 74, in
>  assertComplexTuplesAlmostEqual 
>>>>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>>>> 91:   File 
>>>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", 
>>>>> line 
>>>>> 47, in assertComplexAlmostEqual 
>>>>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, 
>>>>> `places` 
>>>>> )) 
>>>>> 91: AssertionError: (0.00824625696987-1.50158575707e-05j) != (nan+nanj) 
>>>>> within 5 places 
>>>>> 91: 
>>>>> 91: 
>>>>> ---------------------------------------------------------------------- 
>>>>> 91: Ran 12 tests in 0.045s 
>>>>> 91: 
>>>>> 91: FAILED (failures=4) 
>>>>> 1/1 Test #91: qa_freq_xlating_fir_filter .......***Failed    0.32 sec 
>>>>>
>>>>> 0% tests passed, 1 tests failed out of 1 
>>>>>
>>>>>
>  Total Test time (real) =   0.34 sec 
>>>>>
>>>>> The following tests FAILED: 
>>>>>        91 - qa_freq_xlating_fir_filter (Failed) 
>>>>> Errors while running CTest 
>>>>>
>>>>>
>>>>> 150: Test command: /bin/sh 
>>>>> "/home/dave/gnuradio/build/gr-digital/python/qa_constellation_receiver_test.sh"
>>>>>  
>>>>> 150: Test timeout computed to be: 9.99988e+06 
>>>>> 150: Segmentation fault (core dumped) 
>>>>> 1/1 Test #150: qa_constellation_receiver ........***Failed   13.64 sec 
>>>>>
>>>>> 0% tests passed, 1 tests failed out of 1 
>>>>>
>>>>> Total Test time (real) =  13.66 sec 
>>>>>
>>>>> The following tests FAILED: 
>>>>>       150 - qa_constellation_receiver (Failed) 
>>>>> Errors while running CTest 
>>>>>
>>>>>
>>>>> 169: Test command: /bin/sh 
>>>>> "/home/dave/gnuradio/build/gr-vocoder/python/qa_codec2_vocoder_test.sh" 
>>>>> 169: Test timeout computed to be: 9.99988e+06 
>>>>> 169: F 
>>>>> 169: 
>>>>> ====================================================================== 
>>>>> 169: FAIL: test001_module_load (__main__.test_codec2_vocoder) 
>>>>> 169: 
>>>>> ---------------------------------------------------------------------- 
>>>>> 169: Traceback (most recent call last): 
>>>>> 169:   File "/home/dave/gnuradio/gr-vocoder/python/qa_codec2_vocoder.py", 
>>>>> line 56, in test001_module_load 
>>>>> 169:     self.assertEqual(expected_data, actual_result) 
>>>>> 169: AssertionError: Tuples differ: (0, 0, 0, 3, 2, 0, 1, 5, 6, 7,... != 
>>>>> (0L, 0L, 0L, 3L, 2L, 0L, 1L, 5... 
>>>>> 169: 
>>>>> 169: First differing element 112: 
>>>>> 169: 24 
>>>>> 169: 25 
>>>>> 169: 
>>>>> 169: Diff is 3978 characters long. Set self.maxDiff to None to see it. 
>>>>> 169: 
>>>>> 169: 
>>>>> ---------------------------------------------------------------------- 
>>>>> 169: Ran 1 test in 0.503s 
>>>>> 169: 
>>>>> 169: FAILED (failures=1) 
>>>>> 1/1 Test #169: qa_codec2_vocoder ................***Failed    0.86 sec 
>>>>>
>>>>> 0% tests passed, 1 tests failed out of 1 
>>>>>
>>>>> Total Test time (real) =   0.87 sec 
>>>>>
>>>>> The following tests FAILED: 
>>>>>       169 - qa_codec2_vocoder (Failed) 
>>>>> Errors while running CTest 
>>
>>>>>
>>>>>
>>>>>
>>>>> I've rerun apt-get on for the following, and all
>  report back as being the 
>>>>> most current release: 
>>>>> python-dev 
>>>>> python-wxgtk2.8 
>>>>> python-numpy 
>>>>> python-cheetah 
>>>>> python-lxml 
>>>> python-qt4 
>>>>> python-qwt5-qt4 
>>>>>
>>>>> Any help you can offer would be very much appreciated. 
>>>>> libqt4-opengl-dev libqwt5-qt4-dev libfontconfig1-dev libxrender-dev 
>>>>
>>>> Dave, 
>>>>
>>>> Thanks for the details in your question. The first three look like 
>>>> Volk issues and the last looks like a precision error. 
>>>>
>>>> What is the computer hardware? Specifically, what processor, processor 
>>>> architecture (32 or 64 bit), and are your running it in a VM? 
>>
>>>>
>>>> Tom 
>>>>
>>>>
>>>>
>>>> _______________________________________________ 
>>>> Discuss-gnuradio
>  mailing list 
>>>> [hidden email] 
>>>> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>>>>
>>> _______________________________________________ 
>> Discuss-gnuradio mailing list 
>>> [hidden email] 
>>> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>>>
>>>
>>> ________________________________
>>>   
>>> If you reply to this email, your message will be added to the discussion 
>>> below:http://gnuradio.4.n7.nabble.com/make-test-errors-tp41841p41904.html 
>>> To unsubscribe from make test errors, click here.
>>> NAML
>>>
>>>
>>>
>>> --
>>> View this message in context: 
>>> http://gnuradio.4.n7.nabble.com/make-test-errors-tp41841p41944.html
>>> Sent from the GnuRadio mailing list archive at Nabble.com.
>>>
>>>
>>>
>>> _______________________________________________
>>> Discuss-gnuradio mailing list
>>> [hidden email]
>>> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>>>
>>
>> _______________________________________________
>> Discuss-gnuradio mailing list
>> [hidden email]
>> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>>
>>
>>
>> _______________________________________________
>> Discuss-gnuradio mailing list
>> [hidden email]
>> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>>
>>
> 
> 
> 
> 
> _______________________________________________
> Discuss-gnuradio mailing list
> address@hidden
> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>