[Buildbot] Should compile and run acceptance suite with -AS3

RESOLVED FIXED in Q3 11 - Serrano

Status

P3
normal
RESOLVED FIXED
9 years ago
8 years ago

People

(Reporter: brbaker, Assigned: dschaffe)

Tracking

unspecified
Q3 11 - Serrano
x86
All
Dependency tree / graph
Bug Flags:
in-testsuite +
flashplayer-qrb +
flashplayer-triage +

Details

(Whiteboard: buildbot)

Attachments

(5 attachments, 2 obsolete attachments)

(Reporter)

Description

9 years ago
Created attachment 392532 [details]
Failures from windows release 

Should have deep testing for compiling and running the acceptance suite with -AS3. There are currently 173 known tests that do NOT pass when compiled with the AS3 class based object model (tests manipulate the prototype chain).

These failures should be accounted for in the testconfig and we should compile and test with the -AS3
Flags: in-testsuite?
Flags: flashplayer-triage+
Flags: flashplayer-qrb?

Comment 1

9 years ago
Should do runs with and w/o -AS3
Assignee: nobody → dschaffe
Status: NEW → ASSIGNED
Flags: flashplayer-qrb? → flashplayer-qrb+

Updated

9 years ago
Priority: -- → P3
Target Milestone: --- → flash10.1
(Assignee)

Comment 2

9 years ago
moving target to future since the bug is not required for 10.1 release.
Target Milestone: flash10.1 → Future
(Reporter)

Comment 3

9 years ago
I think this is being enabled in bug 523863, check patch https://bug523863.bugzilla.mozilla.org/attachment.cgi?id=408155

Comment 4

9 years ago
Patch mentioned above only adds -AS3 flag to performance suite when -optimize is specified.

Comment 5

9 years ago
status?
(Reporter)

Comment 6

8 years ago
QRB: re-target
Component: Tools → Build Config
Flags: flashplayer-qrb+ → flashplayer-qrb?
QA Contact: tools → build-config
Whiteboard: buildbot
(Reporter)

Updated

8 years ago
Duplicate of this bug: 575322

Updated

8 years ago
Target Milestone: Future → flash10.2

Updated

8 years ago
Depends on: 602995
OS: Windows XP → All

Comment 8

8 years ago
Created attachment 482599 [details] [diff] [review]
Changes to runtests framework

runtests.py: code cleanup and slight rearrangement - no change in functionality
runtestBase.py:

Added --addtoconfig command line switch that adds the given string to the generated config (in between os and vm args)

Added ability to specify negative args in --ascargs.  e.g: --ascargs=-no-AS3 will remove -AS3 from any compiler args if specified in an .asc_args file.
Attachment #482599 - Flags: review?(brbaker)

Comment 9

8 years ago
Created attachment 482603 [details] [diff] [review]
update tests to run with -AS3

1. Compile all tests (expect ecma3 & spidermonkey) with -AS3 by using dir.asc_args files.
2. Add as3Enabled():Boolean to detect whether test was compiled with -AS3 to shell.as
3. Update as3/Vector/sort* to check for correct error depending on how it was compiled.
4. Update RuntimeErrors/Error1034TypeCoercionFailed to use code that consistently throws a 1034
5. Update testconfig for vector/map failures w/ -AS3
Attachment #482603 - Flags: review?(brbaker)

Comment 10

8 years ago
Created attachment 482608 [details] [diff] [review]
buildbot: also test -ES run in deep

Buildbot changes to run -ES in deep and to run -ES in codecoverage
Attachment #482608 - Flags: review?(brbaker)

Comment 11

8 years ago
Created attachment 482619 [details] [diff] [review]
updated buildbot patch

Updated buildbot patch based on brbaker feedback
Attachment #482608 - Attachment is obsolete: true
Attachment #482608 - Flags: review?(brbaker)

Updated

8 years ago
Attachment #482599 - Flags: review?(brbaker) → review+

Comment 12

8 years ago
Comment on attachment 482603 [details] [diff] [review]
update tests to run with -AS3

Reviewed with Brent over the phone - got the verbal r+ from him.
Attachment #482603 - Flags: review?(brbaker) → review+

Comment 13

8 years ago
Pushed to redux:
http://hg.mozilla.org/tamarin-redux/rev/e523f4426e83
Status: ASSIGNED → RESOLVED
Last Resolved: 8 years ago
Resolution: --- → FIXED
(Reporter)

Updated

8 years ago
Flags: in-testsuite?
Flags: in-testsuite+
Flags: flashplayer-qrb?
Flags: flashplayer-qrb+

Updated

8 years ago
Status: RESOLVED → REOPENED
Resolution: FIXED → ---

Comment 14

8 years ago
Created attachment 485456 [details] [diff] [review]
Update ecma3 tests to run with -AS3

All the ecma3 tests now run with no error when compiled with -AS3.  Note that the ecma3/dir.asc_args has been removed so that we compile ecma3 with -AS3 by default.  The dir is tested in -ES mode in the deep phase (already present).
Attachment #485456 - Flags: review?(brbaker)
(Reporter)

Comment 15

8 years ago
Comment on attachment 485456 [details] [diff] [review]
Update ecma3 tests to run with -AS3

Can you type the as3Enabled var in the shell.as or is that going to cause issues trying to run -ES? 

- Scanned through the large patch [OK]
- Rebuilt locally                 [OK]
- Ran an acceptance pass          [FAIL]

When I recompiled all of the tests the following testcases failed with your patch, if I revert your change and rebuild the testcases pass:

as3/Definitions/Packages/IdentifierPackageNames.abc : captured output: ReferenceError: Error #1065
as3/Vector/sortInitializers.abc : captured output: Vector.sort(comparefn) | TypeError: Error #1006
as3/Vector/sort.abc : captured output: Vector.sort(comparefn) | TypeError: Error #1006


Please run patch through the sandbox for a sanity check to get all builds.
Attachment #485456 - Flags: review?(brbaker) → review-

Comment 16

8 years ago
Created attachment 486780 [details] [diff] [review]
Update ecma3 tests to run with -AS3

Updated patch that addresses comments.  Ran in sandbox and only had ppc64 jit issues which have been set to expectedfail in testconfig (Bug 608130 and Bug 608132).
Attachment #485456 - Attachment is obsolete: true
Attachment #486780 - Flags: review?(brbaker)
(Reporter)

Comment 17

8 years ago
Comment on attachment 486780 [details] [diff] [review]
Update ecma3 tests to run with -AS3

I am going to remove the review request until it is understood what this change will do to the ecma3 suite with regards to the ability to run all of the ecma3 tests through eval() (bug #608474)
Attachment #486780 - Flags: review?(brbaker)
(Reporter)

Updated

8 years ago
Blocks: 608474

Comment 18

8 years ago
Attachment 486780 [details] [diff] does not add any as3 only constructs.  I would like to land this patch and we can then work on getting the ecma3 dir prepped for an eval run.

Comment 19

8 years ago
ecma3 patch pushed:

http://hg.mozilla.org/tamarin-redux/rev/793a96705159
Status: REOPENED → RESOLVED
Last Resolved: 8 years ago8 years ago
Resolution: --- → FIXED

Comment 20

8 years ago
changeset: 5917:3dbacc7ffe77
user:      Brent Baker <brbaker@adobe.com>
summary:   Bug 508316: make sure to grab new precompiled test media after running an acceptance pass with -ES. (r=brbaker)

http://hg.mozilla.org/tamarin-redux/rev/3dbacc7ffe77
You need to log in before you can comment on or make changes to this bug.