1169663 - Buildbot sometimes changes the revision for a job between running.js and builds4hr.js

Status: RESOLVED DUPLICATE of bug 782874

(Release Engineering :: General, defect)

Description

[Cameron Dawson [:camd]]

I found this when investigating Bug 1164545.  There was a job with buildername: "Android 4.0 armv7 API 11+ mozilla-inbound debug test plain-reftest-8" that was assigned to revision 879bc9b3298d5aebd45870717606cf07177e1b9f while in running.js.  But when it showed up in builds4hr, its revision had changed to 7f649ef7ef39eb1863483b9eb7c5b4e3e0b6a430 (the next push for m-i)

This caused a few issues in the UI of Treeherder.  Updating job changes got a little wonky.

Comment 1

[Cameron Dawson [:camd]]

The attachments in bug 1164545 may shed additional light on this issue, fwiw.

Comment 2

[Ed Morley [:emorley]]

From builds-running.js:

{

    "submitted_at": 1432839633,
    "buildername": "Android 4.0 armv7 API 11+ mozilla-inbound debug test plain-reftest-8",
    "start_time": 1432840556,
    "number": 1396,
    "claimed_by_name": "buildbot-master102.bb.releng.scl3.mozilla.com:/builds/buildbot/tests1-panda/master",
    "request_ids": 

        [
            70903115,
            70903141,
            70903128
        ],
        "last_heartbeat": 1432840830,
        "id": 72176728,
        "revision": "879bc9b3298d5aebd45870717606cf07177e1b9f"
    },
    "type": "json",
    "id": 51518396,
    "name": "buildapi_running",
    "job_id": 10239430

}


From builds-4hr:

    {
      "builder_id": 372533, 
      "buildnumber": 1396, 
      "endtime": 1432842791, 
      "id": 66877380, 
      "master_id": 188, 
      "properties": {
        "basedir": "/builds/panda-0162/test", 
        "blobber_files": "{\"5d7054e7-e9f2-3359-551e2dec-66011acf.dmp\": \"http://mozilla-releng-blobs.s3.amazonaws.com/blobs/mozilla-inbound/sha512/eb5ddf477a7174d6bbefe968af30afad1c179bfe36cd232635b0725186c9e8d0e488fd63d012477aeb2c46d60ab46aae0c32afe1eea33d85747d75e606033121\", \"5d7054e7-e9f2-3359-551e2dec-66011acf.extra\": \"http://mozilla-releng-blobs.s3.amazonaws.com/blobs/mozilla-inbound/sha512/b3cd7a95cc2c4ccbb0994497ea78a89b67bd43d71d2d61a3580161ee3e7d6cf5f770ca4f6d2765d18fae0d0f68ad5232decc66e90accf1f1848d0f6a9dfb027b\", \"logcat.log\": \"http://mozilla-releng-blobs.s3.amazonaws.com/blobs/mozilla-inbound/sha512/3bb7668f4e266ad6ac5fdfd0ba88fb2ba4e856d01a926862125d67aa2763664d466017cc3977176ff996a2e6d2f9f1c1bc51bcdbd9b8427191c4d6e504e16e3a\"}", 
        "branch": "mozilla-inbound", 
        "build_url": "https://queue.taskcluster.net/v1/task/MUkk7wI_T1KWdJxGnSSH4A/artifacts/public/build/fennec-41.0a1.en-US.android-arm.apk", 
        "buildername": "Android 4.0 armv7 API 11+ mozilla-inbound debug test plain-reftest-8", 
        "buildid": "20150528111242", 
        "buildnumber": 1396, 
        "builduid": "ac13056ef6ec4879bf2aedaea8f5526d", 
        "http_port": "30162", 
        "log_url": "http://ftp.mozilla.org/pub/mozilla.org/mobile/tinderbox-builds/mozilla-inbound-android-api-11-debug/1432836762/mozilla-inbound_panda_android-debug_test-plain-reftest-8-bm102-tests1-panda-build1396.txt.gz", 
        "master": "http://buildbot-master102.bb.releng.scl3.mozilla.com:8201/", 
        "pgo_build": "False", 
        "platform": "android-api-11", 
        "product": "mobile", 
        "project": "", 
        "repo_path": "integration/mozilla-inbound", 
        "repository": "", 
        "request_ids": [
          70903115, 
          70903141, 
          70903128
        ], 
        "request_times": {
          "70903115": 1432839633, 
          "70903128": 1432839633, 
          "70903141": 1432839633
        }, 
        "revision": "7f649ef7ef39eb1863483b9eb7c5b4e3e0b6a430", 
        "scheduler": "tests-mozilla-inbound-panda_android-debug-unittest", 
        "script_repo_revision": "aa543babe6b7", 
        "script_repo_url": "https://hg.mozilla.org/build/mozharness", 
        "slavebuilddir": "test", 
        "slavename": "panda-0162", 
        "ssl_port": "31162", 
        "stage_platform": "android-api-11", 
        "symbols_url": "https://queue.taskcluster.net/v1/task/MUkk7wI_T1KWdJxGnSSH4A/artifacts/public/build/fennec-41.0a1.en-US.android-arm.crashreporter-symbols.zip"
      }, 
      "reason": "scheduler", 
      "request_ids": [
        70903115, 
        70903141, 
        70903128
      ], 
      "requesttime": 1432839633, 
      "result": 2, 
      "slave_id": 2870, 
      "starttime": 1432840556
    },

Comment 3

[Ed Morley [:emorley]]

Sorry, I mis-pasted it. the builds-running.js snippet was:

{
    "submitted_at": 1432839633,
    "buildername": "Android 4.0 armv7 API 11+ mozilla-inbound debug test plain-reftest-8",
    "start_time": 1432840556,
    "number": 1396,
    "claimed_by_name": "buildbot-master102.bb.releng.scl3.mozilla.com:/builds/buildbot/tests1-panda/master",
    "request_ids": 
        [
            70903115,
            70903141,
            70903128
        ],
    "last_heartbeat": 1432840830,
    "id": 72176728,
    "revision": "879bc9b3298d5aebd45870717606cf07177e1b9f"
},

Chris, can you shed any light on this? It's causing quite a few issues with Treeherder ingestion, since it's not presumed that a job can change revision once it is already running.

Comment 4

[Chris AtLee [:catlee]]

dupe of 782874?

Comment 5

[Ed Morley [:emorley]]

(In reply to Chris AtLee [:catlee] from comment #4)
> dupe of 782874?

Yeah maybe