Closed Bug 1414960 Opened 7 years ago Closed 7 years ago

|mach test-info| output is often messy

Categories

(Testing :: General, enhancement)

enhancement
Not set
normal

Tracking

(firefox58 fixed)

RESOLVED FIXED
mozilla58
Tracking Status
firefox58 --- fixed

People

(Reporter: gbrown, Assigned: gbrown)

Details

Attachments

(1 file)

Changes to e10s encoding and the advent of very long names for test platforms has made test-info output untidy, for some tests/platforms:
./mach test-info test_console_binding.html
===== test_console_binding.html =====
Found dom/console/tests/test_console_binding.html in source control.
dom/console/tests/test_console_binding.html found in manifest dom/console/tests/mochitest.ini
  flavor: mochitest
Querying ActiveData...
Found records matching 'dom/console/tests/test_console_binding.html' in ActiveData.

Test results for dom/console/tests/test_console_binding.html on mozilla-central,mozilla-inbound,autoland between 2017-10-30 and 2017-11-06
android-4-3-armv7-api16/debug-chunked:      0 failures in    219 runs
android-4-3-armv7-api16/opt-chunked:      0 failures in    213 runs
linux32-nightly/opt-[u'e10s', u'chunked']:      0 failures in     12 runs
linux32-stylo-disabled/debug-[u'e10s', u'chunked']:      0 failures in    220 runs
linux32-stylo-disabled/opt-[u'e10s', u'chunked']:      0 failures in    210 runs
linux32/debug-[u'e10s', u'chunked']:      0 failures in    219 runs
linux32/opt-[u'e10s', u'chunked']:      0 failures in    216 runs
linux64-nightly/opt-[u'e10s', u'chunked']:      0 failures in     13 runs
linux64-nightly/opt:                0 failures in     11 runs
linux64-stylo-disabled/debug-[u'e10s', u'chunked']:      0 failures in    220 runs
linux64-stylo-disabled/opt-[u'e10s', u'chunked']:      0 failures in    215 runs
linux64/asan-[u'e10s', u'chunked']:      0 failures in    213 runs
linux64/ccov-[u'e10s', u'chunked']:      0 failures in     37 runs
linux64/debug-[u'e10s', u'chunked']:      0 failures in    843 runs
linux64/jsdcov-chunked:             0 failures in     40 runs
linux64/opt-[u'e10s', u'chunked']:      0 failures in    883 runs
linux64/opt-chunked:                0 failures in     40 runs
linux64/opt:                        0 failures in     10 runs
linux64/pgo-[u'e10s', u'chunked']:      0 failures in    213 runs
macosx64-nightly/opt-[u'e10s', u'chunked']:      0 failures in     15 runs
macosx64-stylo-disabled/debug-[u'e10s', u'chunked']:      0 failures in    230 runs
macosx64-stylo-disabled/opt-[u'e10s', u'chunked']:      0 failures in    206 runs
osx-10-10/debug-[u'e10s', u'chunked']:      0 failures in    229 runs
osx-10-10/opt-[u'e10s', u'chunked']:      0 failures in    219 runs
windows10-64-nightly/opt-[u'e10s', u'chunked']:      0 failures in     11 runs
windows10-64-stylo-disabled/debug-[u'e10s', u'chunked']:      0 failures in    209 runs
windows10-64-stylo-disabled/opt-[u'e10s', u'chunked']:      0 failures in    214 runs
windows10-64/debug-[u'e10s', u'chunked']:      0 failures in    817 runs
windows10-64/opt-[u'e10s', u'chunked']:      0 failures in    806 runs
windows10-64/pgo-[u'e10s', u'chunked']:      0 failures in    212 runs
windows7-32-nightly/opt-[u'e10s', u'chunked']:      0 failures in     11 runs
windows7-32-stylo-disabled/debug-[u'e10s', u'chunked']:      0 failures in    218 runs
windows7-32-stylo-disabled/opt-[u'e10s', u'chunked']:      0 failures in    215 runs
windows7-32/debug-[u'e10s', u'chunked']:      0 failures in    712 runs
windows7-32/debug-chunked:          0 failures in    219 runs
windows7-32/opt-[u'e10s', u'chunked']:      0 failures in    217 runs
windows7-32/pgo-[u'e10s', u'chunked']:      0 failures in    211 runs

Total: 0 failures in 9018 runs or 0.000 failures/run

Test durations for dom/console/tests/test_console_binding.html on mozilla-central,mozilla-inbound,autoland between 2017-10-30 and 2017-11-06
android-4-3-armv7-api16/debug-chunked:   4.27 s (2.88 s - 9.47 s over 219 runs)
android-4-3-armv7-api16/opt-chunked:   2.00 s (1.15 s - 5.00 s over 213 runs)
linux32-nightly/opt-[u'e10s', u'chunked']:   0.09 s (0.07 s - 0.12 s over 12 runs)
linux32-stylo-disabled/debug-[u'e10s', u'chunked']:   0.39 s (0.21 s - 1.09 s over 220 runs)
linux32-stylo-disabled/opt-[u'e10s', u'chunked']:   0.08 s (0.06 s - 0.11 s over 210 runs)
linux32/debug-[u'e10s', u'chunked']:   0.36 s (0.22 s - 0.93 s over 219 runs)
linux32/opt-[u'e10s', u'chunked']:   0.08 s (0.06 s - 0.21 s over 216 runs)
linux64-nightly/opt-[u'e10s', u'chunked']:   0.07 s (0.05 s - 0.09 s over 13 runs)
linux64-nightly/opt:             1.01 s (0.92 s - 1.17 s over 11 runs)
linux64-stylo-disabled/debug-[u'e10s', u'chunked']:   0.29 s (0.18 s - 0.76 s over 220 runs)
linux64-stylo-disabled/opt-[u'e10s', u'chunked']:   0.08 s (0.06 s - 0.20 s over 215 runs)
linux64/asan-[u'e10s', u'chunked']:   0.18 s (0.14 s - 0.29 s over 213 runs)
linux64/ccov-[u'e10s', u'chunked']:   0.32 s (0.18 s - 0.83 s over 37 runs)
linux64/debug-[u'e10s', u'chunked']:   0.27 s (0.18 s - 0.73 s over 843 runs)
linux64/jsdcov-chunked:          1.32 s (1.20 s - 1.41 s over 40 runs)
linux64/opt-[u'e10s', u'chunked']:   0.09 s (0.05 s - 0.83 s over 883 runs)
linux64/opt-chunked:             1.32 s (1.20 s - 1.41 s over 40 runs)
linux64/opt:                     1.14 s (0.93 s - 1.50 s over 10 runs)
linux64/pgo-[u'e10s', u'chunked']:   0.07 s (0.05 s - 0.14 s over 213 runs)
macosx64-nightly/opt-[u'e10s', u'chunked']:   0.06 s (0.04 s - 0.07 s over 15 runs)
macosx64-stylo-disabled/debug-[u'e10s', u'chunked']:   0.13 s (0.08 s - 0.37 s over 230 runs)
macosx64-stylo-disabled/opt-[u'e10s', u'chunked']:   0.06 s (0.04 s - 0.08 s over 206 runs)
osx-10-10/debug-[u'e10s', u'chunked']:   0.14 s (0.09 s - 0.28 s over 229 runs)
osx-10-10/opt-[u'e10s', u'chunked']:   0.06 s (0.04 s - 0.09 s over 219 runs)
windows10-64-nightly/opt-[u'e10s', u'chunked']:   0.05 s (0.04 s - 0.06 s over 11 runs)
windows10-64-stylo-disabled/debug-[u'e10s', u'chunked']:   0.09 s (0.08 s - 0.10 s over 209 runs)
windows10-64-stylo-disabled/opt-[u'e10s', u'chunked']:   0.05 s (0.04 s - 0.07 s over 214 runs)
windows10-64/debug-[u'e10s', u'chunked']:   0.09 s (0.07 s - 0.17 s over 817 runs)
windows10-64/opt-[u'e10s', u'chunked']:   0.05 s (0.04 s - 0.08 s over 806 runs)
windows10-64/pgo-[u'e10s', u'chunked']:   0.05 s (0.04 s - 0.07 s over 212 runs)
windows7-32-nightly/opt-[u'e10s', u'chunked']:   0.03 s (0.03 s - 0.04 s over 11 runs)
windows7-32-stylo-disabled/debug-[u'e10s', u'chunked']:   0.09 s (0.07 s - 0.19 s over 218 runs)
windows7-32-stylo-disabled/opt-[u'e10s', u'chunked']:   0.04 s (0.03 s - 0.06 s over 215 runs)
windows7-32/debug-[u'e10s', u'chunked']:   0.09 s (0.07 s - 0.24 s over 712 runs)
windows7-32/debug-chunked:       0.11 s (0.09 s - 0.15 s over 219 runs)
windows7-32/opt-[u'e10s', u'chunked']:   0.04 s (0.03 s - 0.06 s over 217 runs)
windows7-32/pgo-[u'e10s', u'chunked']:   0.03 s (0.03 s - 0.06 s over 211 runs)

Bugzilla quick search for 'dom/console/tests/test_console_binding.html,test_console_binding.html':
Much better now, with distinct columns and simple "e10s" labels:

./mach test-info test_console_binding.html
===== test_console_binding.html =====
Found dom/console/tests/test_console_binding.html in source control.
dom/console/tests/test_console_binding.html found in manifest dom/console/tests/mochitest.ini
  flavor: mochitest
Querying ActiveData...
Found records matching 'dom/console/tests/test_console_binding.html' in ActiveData.

Test results for dom/console/tests/test_console_binding.html on mozilla-central,mozilla-inbound,autoland between 2017-10-30 and 2017-11-06
android-4-3-armv7-api16/debug:                0 failures in    219 runs
android-4-3-armv7-api16/opt:                  0 failures in    213 runs
linux32-nightly/opt-e10s:                     0 failures in     12 runs
linux32-stylo-disabled/debug-e10s:            0 failures in    220 runs
linux32-stylo-disabled/opt-e10s:              0 failures in    210 runs
linux32/debug-e10s:                           0 failures in    219 runs
linux32/opt-e10s:                             0 failures in    216 runs
linux64-nightly/opt-e10s:                     0 failures in     13 runs
linux64-nightly/opt:                          0 failures in     11 runs
linux64-stylo-disabled/debug-e10s:            0 failures in    220 runs
linux64-stylo-disabled/opt-e10s:              0 failures in    215 runs
linux64/asan-e10s:                            0 failures in    213 runs
linux64/ccov-e10s:                            0 failures in     37 runs
linux64/debug-e10s:                           0 failures in    843 runs
linux64/jsdcov:                               0 failures in     40 runs
linux64/opt-e10s:                             0 failures in    883 runs
linux64/opt:                                  0 failures in     40 runs
linux64/opt:                                  0 failures in     10 runs
linux64/pgo-e10s:                             0 failures in    213 runs
macosx64-nightly/opt-e10s:                    0 failures in     15 runs
macosx64-stylo-disabled/debug-e10s:           0 failures in    230 runs
macosx64-stylo-disabled/opt-e10s:             0 failures in    206 runs
osx-10-10/debug-e10s:                         0 failures in    229 runs
osx-10-10/opt-e10s:                           0 failures in    219 runs
windows10-64-nightly/opt-e10s:                0 failures in     11 runs
windows10-64-stylo-disabled/debug-e10s:       0 failures in    209 runs
windows10-64-stylo-disabled/opt-e10s:         0 failures in    214 runs
windows10-64/debug-e10s:                      0 failures in    817 runs
windows10-64/opt-e10s:                        0 failures in    806 runs
windows10-64/pgo-e10s:                        0 failures in    212 runs
windows7-32-nightly/opt-e10s:                 0 failures in     11 runs
windows7-32-stylo-disabled/debug-e10s:        0 failures in    218 runs
windows7-32-stylo-disabled/opt-e10s:          0 failures in    215 runs
windows7-32/debug-e10s:                       0 failures in    712 runs
windows7-32/debug:                            0 failures in    219 runs
windows7-32/opt-e10s:                         0 failures in    217 runs
windows7-32/pgo-e10s:                         0 failures in    211 runs

Total: 0 failures in 9018 runs or 0.000 failures/run

Test durations for dom/console/tests/test_console_binding.html on mozilla-central,mozilla-inbound,autoland between 2017-10-30 and 2017-11-06
android-4-3-armv7-api16/debug:             4.27 s (2.88 s - 9.47 s over 219 runs)
android-4-3-armv7-api16/opt:               2.00 s (1.15 s - 5.00 s over 213 runs)
linux32-nightly/opt-e10s:                  0.09 s (0.07 s - 0.12 s over 12 runs)
linux32-stylo-disabled/debug-e10s:         0.39 s (0.21 s - 1.09 s over 220 runs)
linux32-stylo-disabled/opt-e10s:           0.08 s (0.06 s - 0.11 s over 210 runs)
linux32/debug-e10s:                        0.36 s (0.22 s - 0.93 s over 219 runs)
linux32/opt-e10s:                          0.08 s (0.06 s - 0.21 s over 216 runs)
linux64-nightly/opt-e10s:                  0.07 s (0.05 s - 0.09 s over 13 runs)
linux64-nightly/opt:                       1.01 s (0.92 s - 1.17 s over 11 runs)
linux64-stylo-disabled/debug-e10s:         0.29 s (0.18 s - 0.76 s over 220 runs)
linux64-stylo-disabled/opt-e10s:           0.08 s (0.06 s - 0.20 s over 215 runs)
linux64/asan-e10s:                         0.18 s (0.14 s - 0.29 s over 213 runs)
linux64/ccov-e10s:                         0.32 s (0.18 s - 0.83 s over 37 runs)
linux64/debug-e10s:                        0.27 s (0.18 s - 0.73 s over 843 runs)
linux64/jsdcov:                            1.32 s (1.20 s - 1.41 s over 40 runs)
linux64/opt-e10s:                          0.09 s (0.05 s - 0.83 s over 883 runs)
linux64/opt:                               1.32 s (1.20 s - 1.41 s over 40 runs)
linux64/opt:                               1.14 s (0.93 s - 1.50 s over 10 runs)
linux64/pgo-e10s:                          0.07 s (0.05 s - 0.14 s over 213 runs)
macosx64-nightly/opt-e10s:                 0.06 s (0.04 s - 0.07 s over 15 runs)
macosx64-stylo-disabled/debug-e10s:        0.13 s (0.08 s - 0.37 s over 230 runs)
macosx64-stylo-disabled/opt-e10s:          0.06 s (0.04 s - 0.08 s over 206 runs)
osx-10-10/debug-e10s:                      0.14 s (0.09 s - 0.28 s over 229 runs)
osx-10-10/opt-e10s:                        0.06 s (0.04 s - 0.09 s over 219 runs)
windows10-64-nightly/opt-e10s:             0.05 s (0.04 s - 0.06 s over 11 runs)
windows10-64-stylo-disabled/debug-e10s:    0.09 s (0.08 s - 0.10 s over 209 runs)
windows10-64-stylo-disabled/opt-e10s:      0.05 s (0.04 s - 0.07 s over 214 runs)
windows10-64/debug-e10s:                   0.09 s (0.07 s - 0.17 s over 817 runs)
windows10-64/opt-e10s:                     0.05 s (0.04 s - 0.08 s over 806 runs)
windows10-64/pgo-e10s:                     0.05 s (0.04 s - 0.07 s over 212 runs)
windows7-32-nightly/opt-e10s:              0.03 s (0.03 s - 0.04 s over 11 runs)
windows7-32-stylo-disabled/debug-e10s:     0.09 s (0.07 s - 0.19 s over 218 runs)
windows7-32-stylo-disabled/opt-e10s:       0.04 s (0.03 s - 0.06 s over 215 runs)
windows7-32/debug-e10s:                    0.09 s (0.07 s - 0.24 s over 712 runs)
windows7-32/debug:                         0.11 s (0.09 s - 0.15 s over 219 runs)
windows7-32/opt-e10s:                      0.04 s (0.03 s - 0.06 s over 217 runs)
windows7-32/pgo-e10s:                      0.03 s (0.03 s - 0.06 s over 211 runs)

Bugzilla quick search for 'dom/console/tests/test_console_binding.html,test_console_binding.html':
Attachment #8925673 - Flags: review?(jmaher)
Comment on attachment 8925673 [details] [diff] [review]
simple formatting changes

Review of attachment 8925673 [details] [diff] [review]:
-----------------------------------------------------------------

thanks for the cleanup
Attachment #8925673 - Flags: review?(jmaher) → review+
Pushed by gbrown@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/aefc9e16c571
Improve formatting of |mach test-info| output; r=jmaher
https://hg.mozilla.org/mozilla-central/rev/aefc9e16c571
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla58
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: