Closed Bug 1387532 Opened 3 years ago Closed 3 years ago

Beta is scheduling multiple Win8 opt reftest-noaccel runs on every push

Categories

(Release Engineering :: General, defect)

defect
Not set

Tracking

(firefox56 fixed, firefox57 fixed)

RESOLVED FIXED
Tracking Status
firefox56 --- fixed
firefox57 --- fixed

People

(Reporter: RyanVM, Assigned: Callek)

Details

Attachments

(2 files)

I noticed this yesterday. Callek and Johan have already done some digging into the root cause.
For posterity, current buildbot builders of reftest-no-accel were gathered from allthethings.json


callek@Centaurus:/tmp$ jq '.["builders"]|keys' < ./allthethings.json | grep reftest-no-accel | sort
  "Windows 7 VM-GFX 32-bit ash opt test reftest-no-accel-1",
  "Windows 7 VM-GFX 32-bit ash opt test reftest-no-accel-2",
  "Windows 7 VM-GFX 32-bit ash opt test reftest-no-accel-3",
  "Windows 7 VM-GFX 32-bit ash opt test reftest-no-accel-4",
  "Windows 7 VM-GFX 32-bit ash opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit ash pgo test reftest-no-accel-1",
  "Windows 7 VM-GFX 32-bit ash pgo test reftest-no-accel-2",
  "Windows 7 VM-GFX 32-bit ash pgo test reftest-no-accel-3",
  "Windows 7 VM-GFX 32-bit ash pgo test reftest-no-accel-4",
  "Windows 7 VM-GFX 32-bit ash pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit autoland opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit autoland opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit autoland pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit autoland pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit date opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit date opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit date pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit date pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit DevEdition jamun opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit DevEdition jamun opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit DevEdition mozilla-beta opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit DevEdition mozilla-beta opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit larch opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit larch opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit larch pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit larch pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-beta opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-beta opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-beta pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-beta pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-central opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-central opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-central pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-central pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-esr52 debug test reftest-no-accel-1",
  "Windows 7 VM-GFX 32-bit mozilla-esr52 debug test reftest-no-accel-2",
  "Windows 7 VM-GFX 32-bit mozilla-esr52 debug test reftest-no-accel-e10s-1",
  "Windows 7 VM-GFX 32-bit mozilla-esr52 debug test reftest-no-accel-e10s-2",
  "Windows 7 VM-GFX 32-bit mozilla-esr52 opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-esr52 opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-esr52 pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-esr52 pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-inbound opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-inbound opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-inbound pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-inbound pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-release debug test reftest-no-accel-1",
  "Windows 7 VM-GFX 32-bit mozilla-release debug test reftest-no-accel-2",
  "Windows 7 VM-GFX 32-bit mozilla-release debug test reftest-no-accel-e10s-1",
  "Windows 7 VM-GFX 32-bit mozilla-release debug test reftest-no-accel-e10s-2",
  "Windows 7 VM-GFX 32-bit mozilla-release opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-release opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit mozilla-release pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit mozilla-release pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit oak opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit oak opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit oak pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit oak pgo test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit try opt test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit try opt test reftest-no-accel-e10s",
  "Windows 7 VM-GFX 32-bit try pgo test reftest-no-accel",
  "Windows 7 VM-GFX 32-bit try pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit ash debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit ash debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit ash opt test reftest-no-accel-e10s",
  "Windows 8 64-bit ash pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit autoland debug test reftest-no-accel-1",
  "Windows 8 64-bit autoland debug test reftest-no-accel-2",
  "Windows 8 64-bit autoland debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit autoland debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit autoland opt test reftest-no-accel",
  "Windows 8 64-bit autoland opt test reftest-no-accel-e10s",
  "Windows 8 64-bit autoland pgo test reftest-no-accel",
  "Windows 8 64-bit autoland pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit date debug test reftest-no-accel-1",
  "Windows 8 64-bit date debug test reftest-no-accel-2",
  "Windows 8 64-bit date debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit date debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit date opt test reftest-no-accel",
  "Windows 8 64-bit date opt test reftest-no-accel-e10s",
  "Windows 8 64-bit date pgo test reftest-no-accel",
  "Windows 8 64-bit date pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit DevEdition jamun opt test reftest-no-accel",
  "Windows 8 64-bit DevEdition jamun opt test reftest-no-accel-e10s",
  "Windows 8 64-bit DevEdition mozilla-beta opt test reftest-no-accel",
  "Windows 8 64-bit DevEdition mozilla-beta opt test reftest-no-accel-e10s",
  "Windows 8 64-bit graphics debug test reftest-no-accel-1",
  "Windows 8 64-bit graphics debug test reftest-no-accel-2",
  "Windows 8 64-bit graphics debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit graphics debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit graphics opt test reftest-no-accel",
  "Windows 8 64-bit graphics opt test reftest-no-accel-e10s",
  "Windows 8 64-bit larch debug test reftest-no-accel-1",
  "Windows 8 64-bit larch debug test reftest-no-accel-2",
  "Windows 8 64-bit larch debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit larch debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit larch opt test reftest-no-accel",
  "Windows 8 64-bit larch opt test reftest-no-accel-e10s",
  "Windows 8 64-bit larch pgo test reftest-no-accel",
  "Windows 8 64-bit larch pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-beta debug test reftest-no-accel-1",
  "Windows 8 64-bit mozilla-beta debug test reftest-no-accel-2",
  "Windows 8 64-bit mozilla-beta debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit mozilla-beta debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit mozilla-beta opt test reftest-no-accel",
  "Windows 8 64-bit mozilla-beta opt test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-beta pgo test reftest-no-accel",
  "Windows 8 64-bit mozilla-beta pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-central debug test reftest-no-accel-1",
  "Windows 8 64-bit mozilla-central debug test reftest-no-accel-2",
  "Windows 8 64-bit mozilla-central debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit mozilla-central debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit mozilla-central opt test reftest-no-accel",
  "Windows 8 64-bit mozilla-central opt test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-central pgo test reftest-no-accel",
  "Windows 8 64-bit mozilla-central pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-esr52 debug test reftest-no-accel-1",
  "Windows 8 64-bit mozilla-esr52 debug test reftest-no-accel-2",
  "Windows 8 64-bit mozilla-esr52 debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit mozilla-esr52 debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit mozilla-esr52 opt test reftest-no-accel",
  "Windows 8 64-bit mozilla-esr52 opt test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-esr52 pgo test reftest-no-accel",
  "Windows 8 64-bit mozilla-esr52 pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-inbound debug test reftest-no-accel-1",
  "Windows 8 64-bit mozilla-inbound debug test reftest-no-accel-2",
  "Windows 8 64-bit mozilla-inbound debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit mozilla-inbound debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit mozilla-inbound opt test reftest-no-accel",
  "Windows 8 64-bit mozilla-inbound opt test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-inbound pgo test reftest-no-accel",
  "Windows 8 64-bit mozilla-inbound pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-release debug test reftest-no-accel-1",
  "Windows 8 64-bit mozilla-release debug test reftest-no-accel-2",
  "Windows 8 64-bit mozilla-release debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit mozilla-release debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit mozilla-release opt test reftest-no-accel",
  "Windows 8 64-bit mozilla-release opt test reftest-no-accel-e10s",
  "Windows 8 64-bit mozilla-release pgo test reftest-no-accel",
  "Windows 8 64-bit mozilla-release pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit oak debug test reftest-no-accel-1",
  "Windows 8 64-bit oak debug test reftest-no-accel-2",
  "Windows 8 64-bit oak debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit oak debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit oak opt test reftest-no-accel",
  "Windows 8 64-bit oak opt test reftest-no-accel-e10s",
  "Windows 8 64-bit oak pgo test reftest-no-accel",
  "Windows 8 64-bit oak pgo test reftest-no-accel-e10s",
  "Windows 8 64-bit pine debug test reftest-no-accel-1",
  "Windows 8 64-bit pine debug test reftest-no-accel-2",
  "Windows 8 64-bit pine debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit pine debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit pine opt test reftest-no-accel",
  "Windows 8 64-bit pine opt test reftest-no-accel-e10s",
  "Windows 8 64-bit try debug test reftest-no-accel-1",
  "Windows 8 64-bit try debug test reftest-no-accel-2",
  "Windows 8 64-bit try debug test reftest-no-accel-e10s-1",
  "Windows 8 64-bit try debug test reftest-no-accel-e10s-2",
  "Windows 8 64-bit try opt test reftest-no-accel",
  "Windows 8 64-bit try opt test reftest-no-accel-e10s",
  "Windows 8 64-bit try pgo test reftest-no-accel",
  "Windows 8 64-bit try pgo test reftest-no-accel-e10s",
Comment on attachment 8893919 [details]
Bug 1387532 - Enforce that we don't schedule multiple chunks for the same test without passing buildbot the required chunking information.

https://reviewboard.mozilla.org/r/164982/#review170394
Attachment #8893919 - Flags: review?(catlee) → review+
Comment on attachment 8893918 [details]
Bug 1387532 - Beta is scheduling multiple Win8 opt reftest-noaccel runs on every push.

https://reviewboard.mozilla.org/r/164980/#review170396
Attachment #8893918 - Flags: review?(catlee) → review+
Pushed by Callek@gmail.com:
https://hg.mozilla.org/integration/autoland/rev/a9609c397507
Beta is scheduling multiple Win8 opt reftest-noaccel runs on every push. r=catlee
https://hg.mozilla.org/integration/autoland/rev/710c01ee0566
Enforce that we don't schedule multiple chunks for the same test without passing buildbot the required chunking information. r=catlee
Whiteboard: [checkin-needed-beta]
Assignee: nobody → bugspam.Callek
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.