[Gnash-commit] [bug #47054] `getvariable.as` test produces different result on different Flash Player version

[Nutchanon Wetchasit]

URL:
  <http://savannah.gnu.org/bugs/?47054>

                 Summary: `getvariable.as` test produces different result on
different Flash Player version
                 Project: Gnash - The GNU Flash player
            Submitted by: nachanon
            Submitted on: Wed 03 Feb 2016 07:59:17 PM ICT
                Category: testsuite
                Severity: 3 - Normal
                 Release: master
                  Status: None
                 Privacy: Public
             Assigned to: None
             Open/Closed: Open
         Discussion Lock: Any

    _______________________________________________________

Details:

This is a follow-up to @strk's comment on failing test
<https://savannah.gnu.org/bugs/?45840#comment2> in bug #45840.
According to several experiment I have made, the issue might not be actually
a bug in testsuite; more like _Flash Player's own regression_.

But I think Gnash testsuite's code documention could be improved to
document this regression; providing warning for user who tries to run
the test under recent Adobe Flash Player version in the future.

After I run getvariable.as test
<http://git.savannah.gnu.org/cgit/gnash.git/tree/testsuite/actionscript.all/getvariable.as?id=e705394a72888a8791497d94a7cf4c78b2e23f02>
from Gnash testusite under Adobe Flash Player 11.
I found that one check in the test
<http://git.savannah.gnu.org/cgit/gnash.git/tree/testsuite/actionscript.all/getvariable.as?id=e705394a72888a8791497d94a7cf4c78b2e23f02#n105>
is failing:

Text output of `getvariable-v5.swf` under Flash Player 11.2.202.491:

 - xtrace enabled -
SWF5 - LNX 11,2,202,491

[getvariable.as master-22343-e705394]
FAILED: expected: 5.4 obtained:  [./getvariable.as:105]
#passed: 51
#failed: 1
#total tests run: 52


Text output of `getvariable-v6.swf` under Flash Player 11.2.202.491:

 - xtrace enabled -
SWF6 - LNX 11,2,202,491

[getvariable.as master-22343-e705394]
FAILED: expected: 5.4 obtained:  [./getvariable.as:105]
#passed: 57
#failed: 1
#total tests run: 58


Text output of `getvariable-v7.swf` under Flash Player 11.2.202.491:

 - xtrace enabled -
SWF7 - LNX 11,2,202,491

[getvariable.as master-22343-e705394]
FAILED: expected: 5.4 obtained: undefined [./getvariable.as:105]
#passed: 57
#failed: 1
#total tests run: 58


Text output of `getvariable-v8.swf` under Flash Player 11.2.202.491:

 - xtrace enabled -
SWF8 - LNX 11,2,202,491

[getvariable.as master-22343-e705394]
FAILED: expected: 5.4 obtained: undefined [./getvariable.as:105]
#passed: 57
#failed: 1
#total tests run: 58


`getvariable-v5.swf`, `getvariable-v6.swf`, `getvariable-v7.swf`,
`getvariable-v8.swf`, and `Dejagnu.swf` are built from current Gnash
git version codebase.

Gnash testsuite: 0.8.11dev (git e705394 29-Jan-2016)
Flash Player: 11.2 r202 (11.2.202.491) Standalone
System: Debian GNU/Linux 7.0 Wheezy i386





    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?47054>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/