1788561 - Intermittent org.mozilla.geckoview.test.GeolocationTest#jsContentRequestForLocation | java.lang.AssertionError: Mocked longitude matches.

Status: RESOLVED INCOMPLETE

(GeckoView :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=389097167&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BqVvTt_fQuuUGCdUpqZnIQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-09-01T02:58:27.806Z] 02:58:27     INFO -  TEST-START | org.mozilla.geckoview.test.GeolocationTest#jsContentRequestForLocation
[task 2022-09-01T02:58:29.272Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=939
[task 2022-09-01T02:58:29.272Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2022-09-01T02:58:29.272Z] 02:58:29     INFO -  org.mozilla.geckoview.test | Error in jsContentRequestForLocation(org.mozilla.geckoview.test.GeolocationTest):
[task 2022-09-01T02:58:29.272Z] 02:58:29     INFO -  org.mozilla.geckoview.test | java.lang.AssertionError: Mocked longitude matches.
[task 2022-09-01T02:58:29.272Z] 02:58:29     INFO -  org.mozilla.geckoview.test | Expected: <2.2222>
[task 2022-09-01T02:58:29.273Z] 02:58:29     INFO -  org.mozilla.geckoview.test |      but: was <-122.08400000000002>
[task 2022-09-01T02:58:29.273Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2022-09-01T02:58:29.273Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.junit.Assert.assertThat(Assert.java:956)
[task 2022-09-01T02:58:29.273Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2022-09-01T02:58:29.273Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2022-09-01T02:58:29.273Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2022-09-01T02:58:29.273Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:903)
[task 2022-09-01T02:58:29.274Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:145)
[task 2022-09-01T02:58:29.274Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.GeolocationTest.jsContentRequestForLocation(GeolocationTest.kt:114)
[task 2022-09-01T02:58:29.274Z] 02:58:29     INFO -  org.mozilla.geckoview.test |
[task 2022-09-01T02:58:29.274Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2022-09-01T02:58:29.274Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=jsContentRequestForLocation
[task 2022-09-01T02:58:29.274Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.GeolocationTest
[task 2022-09-01T02:58:29.274Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: Mocked longitude matches.
[task 2022-09-01T02:58:29.274Z] 02:58:29     INFO -  org.mozilla.geckoview.test | Expected: <2.2222>
[task 2022-09-01T02:58:29.275Z] 02:58:29     INFO -  org.mozilla.geckoview.test |      but: was <-122.08400000000002>
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.junit.Assert.assertThat(Assert.java:956)
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:903)
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:145)
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.GeolocationTest.jsContentRequestForLocation(GeolocationTest.kt:114)
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test |
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=339
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: -2
[task 2022-09-01T02:58:29.276Z] 02:58:29     INFO -  Printing logcat for test:
[task 2022-09-01T02:58:29.324Z] 02:58:29     INFO -  09-01 02:58:27.588 E/GeckoSessionTestRule( 3362): test_start 1f0befec-3ff2-40ff-89cf-b127eb38b1ec jsContentRequestForLocation(org.mozilla.geckoview.test.GeolocationTest)
[task 2022-09-01T02:58:29.324Z] 02:58:29     INFO -  09-01 02:58:27.588 E/GeckoSessionTestRule( 3362): before prepareStatement jsContentRequestForLocation(org.mozilla.geckoview.test.GeolocationTest)
[task 2022-09-01T02:58:29.325Z] 02:58:29     INFO -  09-01 02:58:27.607 D/GeckoViewStartup( 3362): onEvent GeckoView:StorageDelegate:Attached
<...>
[task 2022-09-01T02:58:29.354Z] 02:58:29     INFO -  09-01 02:58:28.335 D/GeckoViewContent( 3362): handleEvent: DOMWindowClose
[task 2022-09-01T02:58:29.354Z] 02:58:29     INFO -  09-01 02:58:28.335 D/GeckoViewConsole( 3362): onEvent GeckoView:WebExtension:List null
[task 2022-09-01T02:58:29.354Z] 02:58:29     INFO -  09-01 02:58:28.336 E/GeckoSessionTestRule( 3362): test_end c5ee677f-bc83-49bd-9e28-2d35f3d0f059 jsContentRequestForLocation(org.mozilla.geckoview.test.GeolocationTest)
[task 2022-09-01T02:58:29.354Z] 02:58:29  WARNING -  TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.GeolocationTest#jsContentRequestForLocation | java.lang.AssertionError: Mocked longitude matches.
[task 2022-09-01T02:58:29.354Z] 02:58:29     INFO -  TEST-INFO took 1517ms
[task 2022-09-01T02:58:29.375Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=939
[task 2022-09-01T02:58:29.375Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2022-09-01T02:58:29.375Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2022-09-01T02:58:29.376Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=accurateProviderSelected
[task 2022-09-01T02:58:29.376Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.GeolocationTest
[task 2022-09-01T02:58:29.376Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=340
[task 2022-09-01T02:58:29.376Z] 02:58:29     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: 1
[task 2022-09-01T02:58:29.377Z] 02:58:29     INFO -  TEST-START | org.mozilla.geckoview.test.GeolocationTest#accurateProviderSelected

Comment 1

[Olivia Hall [:olivia]]

It looks like the mocked location is going stale (if it takes longer than 6s to return), and the test is now pulling a new device location. (Bug 1765835 corrected an issue with caching locations/never requesting new locations.)

A similar intermittent test issue was found during original testing of bug 1765835 in the test locationOnBackground.

The solution to the intermittent locationOnBackground was to add this snippet into the test, to ensure that mocked location does not go stale:

Handler(Looper.getMainLooper()).postDelayed({
    try {
        sessionRule.setMockLocation(locManager, locProvider, <<lat>>, <<lon>>)
    } catch (e: Exception) { }
}, 5000)

Likely adding this to jsContentRequestForLocation will correct the issue.

Comment 2

[Olivia Hall [:olivia]]

Tested posting an updated location to the background using the looper. This fixed that test, but impacting the mock location of another test (location posted while another test was running). Background posting technique probably worked on locationOnBackground because that test is much slower.

Will try adjusting the test to expect new locations after a certain test runtime. (These intermittent geolocation issues mostly show up on fission and e10s runs.)

Comment 3

[Intermittent Failures Robot]

9 failures in 3537 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 4

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 3
  • opt: 3
• android-em-7-0-x86_64-qr: 3
  • debug-isolated-process: 1
  • debug: 2
• android-em-7-0-x86_64-shippable-lite-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-08-29&endday=2022-09-04&tree=all

Comment 4

[Olivia Hall [:olivia]]

Attachment: Bug 1788561 - Intermittent GeolocationTest jsContentRequestForLocation

The mock location is going out-of-date on the jsContentRequestForLocation
test. Added a check to ensure the test is within the mock location
timeframe.

Comment 5

[Intermittent Failures Robot]

14 failures in 3616 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 4

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 9
  • debug: 4
  • debug-isolated-process: 3
  • opt: 2
• android-em-7-0-x86_64-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-lite-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-09-05&endday=2022-09-11&tree=all

Comment 6

[Olivia Hall [:olivia]]

Attachment: Bug 1788561 - Intermittent GeolocationTest jsContentRequestForLocation

GeckoView is sometimes selecting a provider other than the named mock
provider. Changed the mock provider to override the gps provider for
testing.

Comment 7

[Intermittent Failures Robot]

23 failures in 3023 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #42 most frequent failure this week.

Repository breakdown:

• autoland: 19
• try: 2
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 2
  • opt: 2
• android-em-7-0-x86_64-qr: 17
  • debug: 8
  • opt: 4
  • debug-isolated-process: 5
• android-em-7-0-x86_64-lite-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-09-12&endday=2022-09-18&tree=all

Comment 8

[Intermittent Failures Robot]

18 failures in 2909 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 16
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 14
  • debug: 7
  • opt: 4
  • debug-isolated-process: 3
• android-em-7-0-x86_64-shippable-qr: 3
  • opt: 3
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-09-19&endday=2022-09-25&tree=all

Comment 9

[Intermittent Failures Robot]

12 failures in 2041 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 10
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 9
  • debug-isolated-process: 4
  • opt: 2
  • debug: 3
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-09-26&endday=2022-10-02&tree=all

Comment 10

[Intermittent Failures Robot]

14 failures in 2449 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 6
• autoland: 6
• mozilla-beta: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 4
  • opt: 4
• android-em-7-0-x86_64-qr: 9
  • debug-isolated-process: 5
  • debug: 3
  • opt: 1
• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-10-03&endday=2022-10-09&tree=all

Comment 11

[Intermittent Failures Robot]

9 failures in 3034 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 7

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 3
  • opt: 3
• android-em-7-0-x86_64-qr: 4
  • debug-isolated-process: 2
  • debug: 1
  • opt: 1
• android-em-7-0-x86_64-lite-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-10-10&endday=2022-10-16&tree=all

Comment 12

[Intermittent Failures Robot]

16 failures in 2793 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5
• autoland: 9
• try: 1
• mozilla-beta: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 9
  • debug-isolated-process: 4
  • debug: 5
• android-em-7-0-x86_64-shippable-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-lite-qr: 3
  • opt: 3
• android-em-7-0-x86_64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-10-17&endday=2022-10-23&tree=all

Comment 13

[Intermittent Failures Robot]

20 failures in 3743 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-release: 1
• mozilla-central: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 10
  • debug-isolated-process: 6
  • debug: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-qr: 5
  • opt: 5
• android-em-7-0-x86_64-shippable-lite-qr: 4
  • opt: 4
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-10-24&endday=2022-10-30&tree=all

Comment 14

[Intermittent Failures Robot]

18 failures in 3626 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-central: 2
• mozilla-beta: 1
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 12
  • debug: 7
  • debug-isolated-process: 5
• android-em-7-0-x86_64-shippable-lite-qr: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-qr: 4
  • opt: 4
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-10-31&endday=2022-11-06&tree=all

Comment 15

[Intermittent Failures Robot]

12 failures in 3445 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 8
  • debug: 4
  • debug-isolated-process: 4
• android-em-7-0-x86_64-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-11-07&endday=2022-11-13&tree=all

Comment 16

[Intermittent Failures Robot]

5 failures in 3589 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 4

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1
• android-em-7-0-x86_64-qr: 3
  • debug-isolated-process: 2
  • debug: 1
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2022-11-14&endday=2022-11-20&tree=all

Comment 17

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 18

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=402548175&repo=autoland

Comment 19

[Intermittent Failures Robot]

1 failures in 3717 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1788561&startday=2023-01-16&endday=2023-01-22&tree=all

Comment 20

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.