798171 - Talos Regression tcheckerboard 1.96e+03% on Android Sept 29

Status: RESOLVED DUPLICATE of bug 770144

(Firefox for Android Graveyard :: General, defect)

Description

[Geoff Brown [:gbrown]]

From dev-tree-management Digest, Vol 45, Issue 185:

3. Talos Regression Robocop Checkerboarding Benchmark
      increase        1.96e+03% on Android 2.2 (Native) mobile

Regression Robocop Checkerboarding Benchmark increase 1.96e+03% on Android 2.2 (Native) mobile
-------------------------------------------------------------------------------------------------
    Previous: avg 172.550 stddev 199.024 of 30 runs up to revision b274e8e3479f
    New     : avg 3546.450 stddev 183.144 of 5 runs since revision b62b229a4d41
    Change  : +3373.900 (1.96e+03% / z=16.952)
    Graph   : http://mzl.la/P2pgDf

Changeset range: http://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=b274e8e3479f&tochange=b62b229a4d41

Changesets:
  * http://hg.mozilla.org/mozilla-central/rev/182c763efa68
    : Philipp von Weitershausen <[e-mail]> - Bug 776832 - Add a scriptable API to assert app permissions through messagemanager. r=smaug
    : http://bugzilla.mozilla.org/show_bug.cgi?id=776832

  * http://hg.mozilla.org/mozilla-central/rev/965397b043c0
    : Philipp von Weitershausen <[e-mail]> - Bug 777508 - Notify parent if child processes are terminated through message manager. r=cjones
    : http://bugzilla.mozilla.org/show_bug.cgi?id=777508

  * http://hg.mozilla.org/mozilla-central/rev/52be204da1cf
    : Philipp von Weitershausen <[e-mail]> - Bug 776663 - Assert permissions for WebTelephony and MobileConnection access. r=cjones
    : http://bugzilla.mozilla.org/show_bug.cgi?id=776663

  * http://hg.mozilla.org/mozilla-central/rev/85a1897826b5
    : Mark Capella <[e-mail]> - Bug 781762 - Add the ability to delete all downloaded files at one time, r=margaret
    : http://bugzilla.mozilla.org/show_bug.cgi?id=781762

  * http://hg.mozilla.org/mozilla-central/rev/005ccc9a2f2f
    : Michael Wu <[e-mail]> - Bug 794598: Fix antenna detection in FMRadio.cpp. r=cjones
    : http://bugzilla.mozilla.org/show_bug.cgi?id=794598

  * http://hg.mozilla.org/mozilla-central/rev/ab977a3ebe90
    : Makoto Kato <[e-mail]> - Bug 786579 - Remove old MSVC (<=2003) support. r=khuey
    : http://bugzilla.mozilla.org/show_bug.cgi?id=786579

  * http://hg.mozilla.org/mozilla-central/rev/dcdda4778cef
    : Cameron McCormack <[e-mail]> - Bug 791434 - Tweak text-shadow/blur-opacty.html to bring it in line with what landed on Aurora.
    : http://bugzilla.mozilla.org/show_bug.cgi?id=791434

  * http://hg.mozilla.org/mozilla-central/rev/cba5ba69091f
    : Gene Lian <[e-mail]> - Bug 789973 - B2G system time: adjust system clock after receiving NITZ timestamp (part 1). r=jlebar
    : http://bugzilla.mozilla.org/show_bug.cgi?id=789973

  * http://hg.mozilla.org/mozilla-central/rev/a2a509184b07
    : Gene Lian <[e-mail]> - Bug 789973 - B2G system time: adjust system clock after receiving NITZ timestamp (part 2). r=philikon
    : http://bugzilla.mozilla.org/show_bug.cgi?id=789973

  * http://hg.mozilla.org/mozilla-central/rev/6786b5f4ee4a
    : Cameron McCormack <[e-mail]> - Bug 655877 - Part 44: Fix some bidi tests whose rendering behavior has changed a bit with the new SVG text support. r=smontagu
    : http://bugzilla.mozilla.org/show_bug.cgi?id=655877

  * http://hg.mozilla.org/mozilla-central/rev/96faff88d792
    : Hsin-Yi Tsai <[e-mail]> - Bug 794766 - B2G Telephony: phone is hanging after a busy call is released by operator. r=philikon
    : http://bugzilla.mozilla.org/show_bug.cgi?id=794766

  * http://hg.mozilla.org/mozilla-central/rev/85a545c8cd49
    : Justin Dolske <[e-mail]> - Bug 784909 - Add support for app-provided HiDPI mouse pointer/cursor. r=josh
    : http://bugzilla.mozilla.org/show_bug.cgi?id=784909

  * http://hg.mozilla.org/mozilla-central/rev/a3b635cad2d8
    : Justin Dolske <[e-mail]> - Bug 792592 - Need HiDPI versions of our custom OS X cursors. images=shorlander r=me
    : http://bugzilla.mozilla.org/show_bug.cgi?id=792592

  * http://hg.mozilla.org/mozilla-central/rev/c1b8d9b1b7f0
    : Cameron McCormack <[e-mail]> - Backout 6786b5f4ee4a (bug 655877 part 44), since it shouldn't've landed before the patch creating the pref.
    : http://bugzilla.mozilla.org/show_bug.cgi?id=655877

  * http://hg.mozilla.org/mozilla-central/rev/97a779a92b92
    : Mounir Lamouri <[e-mail]> - Bug 794023 - Use std::numeric_limits for NECKO_UNKNOWN_APP. f=ehsan r=jduell
    : http://bugzilla.mozilla.org/show_bug.cgi?id=794023

  * and 75 more

Bugs:
  * http://bugzilla.mozilla.org/show_bug.cgi?id=776832 - Add a scriptable API to assert app permissions through messagemanager
  * http://bugzilla.mozilla.org/show_bug.cgi?id=769922 - Intermittent REFTEST TEST-UNEXPECTED-FAIL | test/build/reftest/tests/layout/reftests/bugs/482659-1d.html (or 482659-1c.html) | image comparison (==)
  * http://bugzilla.mozilla.org/show_bug.cgi?id=655877 - SVG text should use CSS text frames to gain support for various text layout features
  * http://bugzilla.mozilla.org/show_bug.cgi?id=785542 - Convert usages of PR_MIN and PR_MAX to NS_MIN and NS_MAX
  * http://bugzilla.mozilla.org/show_bug.cgi?id=791434 - Text shadow with transparency is rendered too light
  * http://bugzilla.mozilla.org/show_bug.cgi?id=794891 - Don't reorder expected failures in parseFailures.py
  * http://bugzilla.mozilla.org/show_bug.cgi?id=784909 - Add support for app-provided HiDPI mouse pointer/cursor
  * http://bugzilla.mozilla.org/show_bug.cgi?id=794766 - B2G Telephony: phone is hanging after a busy call is released by operator
  * http://bugzilla.mozilla.org/show_bug.cgi?id=792592 - Need HiDPI versions of our custom OS X cursors
  * http://bugzilla.mozilla.org/show_bug.cgi?id=752786 - Intermittent test_bug469613.xul | Starting a 0-delta scroll shouldn't cancel a pending async scroll. - got 0, expected 10
  * http://bugzilla.mozilla.org/show_bug.cgi?id=786579 - Remove old MSVC (<=2003) support
  * http://bugzilla.mozilla.org/show_bug.cgi?id=772357 - B2G RIL: Support network depersonalization
  * http://bugzilla.mozilla.org/show_bug.cgi?id=777508 - Notify parent if child processes are terminated through message manager
  * http://bugzilla.mozilla.org/show_bug.cgi?id=794023 - NECKO_UNKNOWN_APP should use std::numeric_limits
  * http://bugzilla.mozilla.org/show_bug.cgi?id=768126
  * and 26 more

I cannot find a d-t-m alert for m-i.

Comment 1

[Geoff Brown [:gbrown]]

(In reply to Geoff Brown [:gbrown] (PTO Oct 5 - Oct 15) from comment #0)
> I cannot find a d-t-m alert for m-i.

I see now - it happened the day before and goes back to DLBI - bug 539356. See https://bugzilla.mozilla.org/show_bug.cgi?id=539356#c344.

Comment 2

[Brad Lassey [:blassey] (use needinfo?)]

DLBI is supposed to be a step back so we can take a couple steps forward. We'll just live with this one.

Comment 4

[Geoff Brown [:gbrown]]

For completeness, I'll mention: there were also smaller tcheck2 (real-user) and tcheck3 (real-user, no screenshot) regressions at the same time. I cannot find an alert for those on m-i or m-c, but the aurora uplift triggered one for tcheck3:

Subject: Talos Regression Robocop Checkerboarding No Snapshot
        Benchmark        increase 66.2% on Android 2.2 (Native) Mozilla-Aurora

Regression Robocop Checkerboarding No Snapshot Benchmark increase 66.2% on Android 2.2 (Native) Mozilla-Aurora
-----------------------------------------------------------------------------------------------------------------
    Previous: avg 1264.448 stddev 227.055 of 30 runs up to revision 0bbdc9620ccb
    New     : avg 2102.000 stddev 169.186 of 5 runs since revision a58424e10a73
    Change  : +837.552 (66.2% / z=3.689)
    Graph   : http://mzl.la/Turooo

and looking back at the graphs on m-i, they go back to the same DLBI check-in.