add diffential testing script avmdiff.py. The script has a configuration file (avmdiff.cfg) where a list of builds and parameters are specfied. The script runs an abc file with all of the combinations checking for any differences. The differential testing reports a failure if any configurations report different output or exit code. avmdiff can be hooked into the acceptance runtests to check all acceptance tests.
Created attachment 366571 [details] [diff] [review] patch for avmdiff.py and configuration The patch contains updates to acceptance tests and updated testconfig.txt so differential testing between [release|debug][-debugger] builds all pass.
Created attachment 366637 [details] [diff] [review] avmdiff patch
Attachment #366571 - Attachment is obsolete: true
Assignee: nobody → dschaffe
Status: NEW → ASSIGNED
Priority: -- → P3
Target Milestone: --- → flash10.x
differential testing is running in the acceptance tests.
Status: ASSIGNED → RESOLVED
Last Resolved: 9 years ago
Resolution: --- → FIXED
closing bug by marking verified/fixed.
Status: RESOLVED → VERIFIED
You need to log in before you can comment on or make changes to this bug.