Closed Bug 1620642 Opened 2 years ago Closed 2 years ago

reftest-analyzer improvements for analyzing test failures

Categories

(Core :: Graphics: WebRender, enhancement, P3)

Desktop
All
enhancement

Tracking

()

RESOLVED FIXED
mozilla76
Tracking Status
firefox76 --- fixed

People

(Reporter: bpeers, Assigned: bpeers)

Details

Attachments

(3 files)

Follow-up for Bug 1619393 for RefTest-Analyzer improvements. Some ideas:

  1. better heatmap visualization -- color code the differences;
  2. show a histogram of differences
  3. other options to simplify finding good fuzzy ranges/values
  4. quality of life improvements: print fuzzy values in copy-pasteable format; URL link to the actual tests; other ideas from comments on 1619393.
Attached image overview.png

Adding an annotated screenshot to help the code review.

Turn the difference checkbox into a radio that adds "heatmap"; it uses
WebGL to show both images, their absolute difference, and a color-coded
max difference. The quadrants split following the mouse.
This helps to separate large variations (red) from small variations
(green) and helps to compare the images without losing track of where
they are.

Assignee: nobody → bpeers
Status: NEW → ASSIGNED
Attached video 2020-03-06 17-20-52.mkv

Adding a demo video to help the code review.
The shader/perf is not really that choppy, just encoding at 4K at high bitrate :)

Pushed by bpeers@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/263ce25c220a
reftest-analyzer improvements for analyzing test failures r=jgilbert
Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla76
You need to log in before you can comment on or make changes to this bug.