Closed Bug 1648902 Opened 4 years ago Closed 4 years ago

Permafailing tier 2 performance tests raptor.py: error: WebRender is only supported when running Raptor on Firefox Desktop or GeckoView-based Android browsers! before Return code: 2

Categories

(Testing :: Performance, defect, P5)

Product:
Testing
Component:
Performance
Type:
defect

Tracking

(firefox-esr68 unaffected, firefox-esr78 unaffected, firefox77 unaffected, firefox78 unaffected, firefox79 fixed, firefox80 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla80
Tracking Flags:
Tracking Status
firefox-esr68 --- unaffected
firefox-esr78 --- unaffected
firefox77 --- unaffected
firefox78 --- unaffected
firefox79 --- fixed
firefox80 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: alexandrui)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Attachments

(1 file)

Bug 1648902 Remove webrender variant from fennec r?#perftest,sparky
47 bytes, text/x-phabricator-request
Details | Review

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=307727298&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/aDeV2Zi1SMOHd4RwZMYglQ/runs/0/artifacts/public/logs/live_backing.log

[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - Calling ['/builds/task_1593234230/workspace/build/venv/bin/python', u'/builds/task_1593234230/workspace/build/tests/raptor/raptor/raptor.py', u'--enable-webrender', u'--no-conditioned-profile', u'--browsertime-node', '/builds/task_1593234230/fetches/node/bin/node', u'--browsertime-browsertimejs', '/builds/task_1593234230/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', u'--browsertime-chromedriver', '/builds/task_1593234230/fetches/{}chromedriver', u'--browsertime-ffmpeg', '/builds/task_1593234230/fetches/ffmpeg-4.1.4-i686-static/ffmpeg', u'--browsertime-geckodriver', '/builds/task_1593234230/fetches/geckodriver', u'--browsertime-video', u'--browsertime', u'--installerpath', u'/builds/task_1593234230/workspace/build/target.apk', u'--binary', 'org.mozilla.firefox', u'--device-name', 'g5', u'--app', 'fennec', u'--activity', 'org.mozilla.gecko.BrowserApp', u'--conditioned-profile-scenario', u'settled', u'--host', u'127.0.0.1', u'--symbolsPath', u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/G_7pni_tQ9iHZVyZc-w8BA/artifacts/public/build/en-US/target.crashreporter-symbols.zip', u'--test', 'jianshu', u'--log-tbpl-level=debug'] with output_timeout 3600
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - usage: raptor.py [-h] -t TEST
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--app {chrome-m,geckoview,firefox,fenix,refbrow,chrome,chromium,fennec}]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [-b BINARY] [-a ACTIVITY] [-i INTENT] [--host HOST]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--power-test] [--memory-test] [--cpu-test] [--live-sites]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--is-release-build] [--gecko-profile]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--gecko-profile-entries GECKO_PROFILE_ENTRIES]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--gecko-profile-interval GECKO_PROFILE_INTERVAL]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--gecko-profile-thread GECKO_PROFILE_THREADS]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--symbolsPath SYMBOLS_PATH] [--page-cycles PAGE_CYCLES]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--page-timeout PAGE_TIMEOUT]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--post-startup-delay POST_STARTUP_DELAY]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--browser-cycles BROWSER_CYCLES] [--project PROJECT]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--test-url-params TEST_URL_PARAMS] [--print-tests]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--debug-mode] [--disable-e10s] [--enable-webrender]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--no-conditioned-profile] [--device-name DEVICE_NAME]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--enable-fission] [--setpref EXTRA_PREFS] [--run-local]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--obj-path OBJ_PATH] [--noinstall]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--installerpath INSTALLERPATH] [--disable-perf-tuning]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--conditioned-profile-scenario CONDITIONED_PROFILE_SCENARIO]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--cold] [--browsertime]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--browsertime-node BROWSERTIME_NODE]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--browsertime-browsertimejs BROWSERTIME_BROWSERTIMEJS]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--browsertime-chromedriver BROWSERTIME_CHROMEDRIVER]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--browsertime-video]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--browsertime-ffmpeg BROWSERTIME_FFMPEG]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--browsertime-geckodriver BROWSERTIME_GECKODRIVER]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--verbose] [--log-raw LOG_RAW] [--log-html LOG_HTML]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--log-tbpl LOG_TBPL] [--log-xunit LOG_XUNIT]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--log-unittest LOG_UNITTEST] [--log-grouped LOG_GROUPED]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--log-mach LOG_MACH] [--log-raw-level LOG_RAW_LEVEL]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--log-tbpl-compact] [--log-tbpl-level LOG_TBPL_LEVEL]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--log-tbpl-buffer LOG_TBPL_BUFFER] [--log-mach-verbose]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--log-mach-screenshot] [--log-mach-level LOG_MACH_LEVEL]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--log-mach-buffer LOG_MACH_BUFFER]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - [--log-mach-no-screenshot]
[task 2020-06-27T05:05:38.982Z] 05:05:11 INFO - raptor.py: error: WebRender is only supported when running Raptor on Firefox Desktop or GeckoView-based Android browsers!
[task 2020-06-27T05:05:38.982Z] 05:05:12 ERROR - Return code: 2
[task 2020-06-27T05:05:38.982Z] 05:05:12 WARNING - setting return code to 2
[task 2020-06-27T05:05:38.982Z] 05:05:12 INFO - Killing logcat pid 663.
[task 2020-06-27T05:05:38.982Z] 05:05:12 INFO - Copying Raptor results to upload dir:
[task 2020-06-27T05:05:38.982Z] 05:05:12 INFO - /builds/task_1593234230/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2020-06-27T05:05:38.982Z] 05:05:12 INFO - Copying raptor results from /builds/task_1593234230/workspace/build/raptor.json to /builds/task_1593234230/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2020-06-27T05:05:38.982Z] 05:05:12

These failures point to Bug 1623421.
:ahal, :acreskey could you please double check this? Thank you.

Flags: needinfo?(ahal)
Flags: needinfo?(acreskey)

Looks like these tests are triggered by this cron task: https://firefox-ci-tc.services.mozilla.com/tasks/IDlF3PLTSumGRMv7x8iG_A that runs every saturday at 5:00 AM UTC , https://searchfox.org/mozilla-central/source/.cron.yml#99-108

Flags: needinfo?(aionescu)

The error is coming from this line:
https://searchfox.org/mozilla-central/rev/21f2b48e01f2e14a94e8d39a665b56fcc08ecbdb/testing/raptor/raptor/cmdline.py#243-245

Ah yes, in the failure case we are trying to run WebRender tests on fennec.
But fennec doesn't support webRender.
Removing the fennec variant of this test should fix this.

Flags: needinfo?(acreskey)

This issue doesn't look relevant to me.

Flags: needinfo?(ahal)
Assignee: nobody → aionescu
Status: NEW → ASSIGNED
Pushed by aionescu@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/468596449d86
Remove webrender variant from fennec r=perftest-reviewers,Bebe

https://hg.mozilla.org/mozilla-central/rev/468596449d86

Status: ASSIGNED → RESOLVED
Closed: 4 years ago
status-firefox80: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla80

Set release status flags based on info from the regressing bug 1623421

status-firefox78: --- → unaffected
status-firefox79: --- → affected
status-firefox-esr68: --- → unaffected
status-firefox-esr78: --- → unaffected
status-firefox77: --- → unaffected
Flags: needinfo?(aionescu)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: