add differential testing scripts for running acceptance tests

VERIFIED FIXED in flash10.1

Status

Tamarin
Build Config
P3
normal
VERIFIED FIXED
10 years ago
9 years ago

People

(Reporter: Dan Schaffer, Assigned: Dan Schaffer)

Tracking

unspecified
flash10.1
x86
Mac OS X
Bug Flags:
flashplayer-qrb +
flashplayer-triage +

Details

Attachments

(1 attachment, 1 obsolete attachment)

(Assignee)

Description

10 years ago
add diffential testing script avmdiff.py.  The script has a configuration file (avmdiff.cfg) where a list of builds and parameters are specfied.  The script
runs an abc file with all of the combinations checking for any differences.

The differential testing reports a failure if any configurations report different output or exit code.  

avmdiff can be hooked into the acceptance runtests to check all acceptance tests.
Flags: flashplayer-triage+
(Assignee)

Comment 1

10 years ago
Created attachment 366571 [details] [diff] [review]
patch for avmdiff.py and configuration 

The patch contains updates to acceptance tests and updated testconfig.txt so differential testing between [release|debug][-debugger] builds all pass.
(Assignee)

Comment 2

10 years ago
Created attachment 366637 [details] [diff] [review]
avmdiff patch
Attachment #366571 - Attachment is obsolete: true

Updated

9 years ago
Assignee: nobody → dschaffe
Status: NEW → ASSIGNED
Flags: flashplayer-qrb+
Priority: -- → P3
Target Milestone: --- → flash10.x
(Assignee)

Comment 3

9 years ago
differential testing is running in the acceptance tests.
Status: ASSIGNED → RESOLVED
Last Resolved: 9 years ago
Resolution: --- → FIXED
(Assignee)

Comment 4

9 years ago
closing bug by marking verified/fixed.
Status: RESOLVED → VERIFIED
You need to log in before you can comment on or make changes to this bug.