1445164 - Intermittent /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be table and are considered block -- img elements - assert_not_equals: got disallowed value 2236

Status: RESOLVED INCOMPLETE

(Core :: CSS Parsing and Computation, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=167607155&repo=autoland

https://queue.taskcluster.net/v1/task/QZlD1-vGS4-TcSdjxBCecA/runs/0/artifacts/public/logs/live_backing.log

[task 2018-03-13T07:23:46.247Z] 07:23:46     INFO - TEST-START | /css/css-tables/table-model-fixup-2.html
[task 2018-03-13T07:23:46.467Z] 07:23:46     INFO - 
[task 2018-03-13T07:23:46.467Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements inside a table cannot be table-column and are considered inline -- img elements 
[task 2018-03-13T07:23:46.468Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements inside a table cannot be table-cell and are considered inline -- input elements 
[task 2018-03-13T07:23:46.468Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements inside a table cannot be table-cell and are considered inline -- img elements 
[task 2018-03-13T07:23:46.469Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be inline-table and are considered inline -- input=text elements 
[task 2018-03-13T07:23:46.469Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be inline-table and are considered inline -- input=button elements 
[task 2018-03-13T07:23:46.469Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be inline-table and are considered inline -- input=file elements 
[task 2018-03-13T07:23:46.470Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be inline-table and are considered inline -- img elements 
[task 2018-03-13T07:23:46.470Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be table and are considered block -- input=text elements 
[task 2018-03-13T07:23:46.470Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be table and are considered block -- input=button elements 
[task 2018-03-13T07:23:46.471Z] 07:23:46     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be table and are considered block -- input=file elements 
[task 2018-03-13T07:23:46.471Z] 07:23:46     INFO - TEST-UNEXPECTED-FAIL | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be table and are considered block -- img elements - assert_not_equals: got disallowed value 2236
[task 2018-03-13T07:23:46.471Z] 07:23:46     INFO - assertUnequalOffsetTops@http://web-platform.test:8000/css/css-tables/table-model-fixup-2.html:47:9
[task 2018-03-13T07:23:46.471Z] 07:23:46     INFO - @http://web-platform.test:8000/css/css-tables/table-model-fixup-2.html:252:9
[task 2018-03-13T07:23:46.478Z] 07:23:46     INFO - ................
[task 2018-03-13T07:23:46.478Z] 07:23:46     INFO - TEST-OK | /css/css-tables/table-model-fixup-2.html | took 220ms
[task 2018-03-13T07:23:46.588Z] 07:23:46     INFO - PID 2667 | JavaScript error: resource:///modules/AsyncTabSwitcher.jsm, line 253: TypeError: browser.frameLoader is null
[task 2018-03-13T07:23:46.757Z] 07:23:46     INFO - PID 2667 | *** UTM:SVC TimerManager:registerTimer called after profile-before-change notification. Ignoring timer registration for id: telemetry_modules_ping
[task 2018-03-13T07:23:47.088Z] 07:23:47     INFO - Browser exited with return code 0
[task 2018-03-13T07:23:47.088Z] 07:23:47  WARNING - u'runner_teardown': ()
[task 2018-03-13T07:23:47.211Z] 07:23:47     INFO - Setting up ssl
[task 2018-03-13T07:23:47.340Z] 07:23:47     INFO - certutil | 
[task 2018-03-13T07:23:47.462Z] 07:23:47     INFO - certutil | 
[task 2018-03-13T07:23:47.482Z] 07:23:47     INFO - certutil | 
[task 2018-03-13T07:23:47.483Z] 07:23:47     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-03-13T07:23:47.483Z] 07:23:47     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-03-13T07:23:47.483Z] 07:23:47     INFO - 
[task 2018-03-13T07:23:47.483Z] 07:23:47     INFO - web-platform-tests                                           CT,, 
[task 2018-03-13T07:23:47.483Z] 07:23:47     INFO - 
[task 2018-03-13T07:23:47.560Z] 07:23:47     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpWk3tvL.mozrunner
[task 2018-03-13T07:23:47.576Z] 07:23:47     INFO - Starting runner
[task 2018-03-13T07:23:49.840Z] 07:23:49     INFO - PID 2857 | 1520925829834	Marionette	INFO	Listening on port 2828

Comment 1

[Intermittent Failures Robot]

18 failures in 123 pushes (0.146 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-beta: 7
* autoland: 4
* try: 3
* mozilla-inbound: 2
* mozilla-central: 2

Platform breakdown:
* linux64: 4
* macosx64-devedition: 3
* linux64-stylo-disabled: 2
* linux64-nightly: 2
* linux32-stylo-disabled: 2
* linux32: 2
* macosx64-nightly: 1
* linux32-nightly: 1
* linux32-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1445164&startday=2018-03-15&endday=2018-03-15&tree=all

Comment 2

[Intermittent Failures Robot]

47 failures in 814 pushes (0.058 failures/push) were associated with this bug in the last 7 days. 

This is the #25 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 14
* mozilla-beta: 10
* try: 8
* mozilla-inbound: 8
* mozilla-central: 7

Platform breakdown:
* linux32-stylo-disabled: 12
* linux64: 8
* linux32: 8
* linux64-stylo-disabled: 5
* linux64-nightly: 5
* macosx64-devedition: 3
* linux32-nightly: 2
* linux32-devedition: 2
* macosx64-nightly: 1
* linux64-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1445164&startday=2018-03-12&endday=2018-03-18&tree=all

Comment 3

[Eliza Balazs [:ebalazs_]]

In the last 7 days we have 36 failures.
They occur on Linux (opt and debug), Linux x64 (opt, debug, pgo), linux32-stylo-disabled (opt, debug), 	linux64-stylo-disabled (opt).
Here is a recent log example: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=169102825&lineNumber=2042
and a relevant part of it:
[task 2018-03-20T02:34:34.782Z] 02:34:34     INFO - TEST-UNEXPECTED-FAIL | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be table and are considered block -- img elements - assert_not_equals: got disallowed value 2236

Comment 4

[Intermittent Failures Robot]

42 failures in 148 pushes (0.284 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 21
* mozilla-inbound: 17
* try: 3
* mozilla-beta: 1

Platform breakdown:
* linux64-qr: 36
* linux64: 4
* linux64-devedition: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-03-22&endday=2018-03-22&tree=trunk

Comment 5

[Intermittent Failures Robot]

36 failures in 124 pushes (0.29 failures/push) were associated with this bug yesterday.    

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* mozilla-inbound: 18
* autoland: 16
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* linux64-qr: 32
* linux64: 2
* linux64-devedition: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-03-23&endday=2018-03-23&tree=trunk

Comment 6

[Emilio Cobos Álvarez [:emilio]]

This test looks racy. Running locally under high system load I get 8 / 9 unexpected failures consistently.

Comment 7

[Emilio Cobos Álvarez [:emilio]]

Webkit also fails intermittently the same test as us, fwiw, and all browsers agree on failing the other 8 tests. This test looks somewhat broken, I'll file.

Comment 8

[Emilio Cobos Álvarez [:emilio]]

Joel, do we have a decent way of tracking which tests are disabled for intermittents and try to re-enable them sometime?

If not, is there any plan for something like that?

I'd be fine with disabling this test, but this is a useful test (as in, what it's testing is non-trivial and important), and if it gets fixed upstream in https://github.com/w3c/web-platform-tests/issues/10165, it'd be a shame to not run it because we just didn't notice it.

Comment 9

[Joel Maher ( :jmaher ) (UTC -8)]

we have the bug marked as leave-open after disabling.  This allows for the people who watch bugs in the component know which tests have been disabled.  As for web-platform-tests, in general web-platform-tests are automatically checked on try and the manifests annotated before landing.  I am not clear if the import process tries to run disabled tests.

:jgraham, could you point to some docs or clarify the process for importing new tests and if you try to run disabled tests as part of this?

Comment 10

[James Graham [:jgraham]]

We don't try to run disabled tests as part of an import. One can imagine re-enabling disabled tests that got changed upstream, but that work is not currently planned.

Comment 11

[James Graham [:jgraham]]

One thing we can do is just mark this one subtest as disabled, which basically means we ignore the result. But we still need  to remember to  re-enable it once the test is fixed.

Comment 12

[Intermittent Failures Robot]

177 failures in 822 pushes (0.215 failures/push) were associated with this bug in the last 7 days. 

This is the #3 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* mozilla-inbound: 76
* autoland: 64
* mozilla-central: 14
* try: 13
* mozilla-beta: 10

Platform breakdown:
* linux64-qr: 135
* linux64: 13
* linux32-stylo-disabled: 6
* linux32: 6
* linux64-devedition: 4
* linux32-nightly: 4
* linux64-nightly: 3
* linux32-devedition: 3
* linux64-jsdcov: 2
* linux64-stylo-disabled: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-03-20&endday=2018-03-26&tree=trunk

Comment 13

[Intermittent Failures Robot]

62 failures in 168 pushes (0.369 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 25
* mozilla-inbound: 23
* mozilla-central: 7
* mozilla-beta: 4
* try: 3

Platform breakdown:
* linux64-qr: 46
* linux64: 8
* linux32: 4
* linux64-devedition: 2
* linux64-nightly: 1
* linux64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-03-27&endday=2018-03-27&tree=trunk

Comment 14

[Intermittent Failures Robot]

48 failures in 161 pushes (0.298 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 25
* mozilla-inbound: 16
* try: 3
* mozilla-beta: 3
* mozilla-central: 1

Platform breakdown:
* linux64-qr: 40
* linux64: 3
* linux32-nightly: 3
* linux64-nightly: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-03-28&endday=2018-03-28&tree=trunk

Comment 15

[Intermittent Failures Robot]

25 failures in 120 pushes (0.208 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 14
* mozilla-inbound: 6
* try: 3
* mozilla-central: 2

Platform breakdown:
* linux64-qr: 19
* linux32: 2
* linux64-nightly: 1
* linux64-devedition: 1
* linux64: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-03-29&endday=2018-03-29&tree=trunk

Comment 16

[Intermittent Failures Robot]

17 failures in 94 pushes (0.181 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 10
* mozilla-central: 3
* autoland: 2
* try: 1
* mozilla-beta: 1

Platform breakdown:
* linux64-qr: 10
* linux64: 5
* linux64-nightly: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-03-30&endday=2018-03-30&tree=trunk

Comment 17

[Intermittent Failures Robot]

198 failures in 718 pushes (0.276 failures/push) were associated with this bug in the last 7 days. 

This is the #3 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* mozilla-inbound: 78
* autoland: 75
* try: 19
* mozilla-central: 15
* mozilla-beta: 11

Platform breakdown:
* linux64-qr: 149
* linux64: 20
* linux32-nightly: 9
* linux32: 8
* linux64-nightly: 6
* linux64-devedition: 3
* linux64-jsdcov: 2
* linux64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-03-26&endday=2018-04-01&tree=trunk

Comment 18

[Intermittent Failures Robot]

50 failures in 82 pushes (0.61 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 20
* mozilla-inbound: 17
* try: 5
* mozilla-central: 4
* mozilla-beta: 4

Platform breakdown:
* linux64-qr: 34
* linux32: 5
* linux64-devedition: 3
* linux64: 3
* linux32-nightly: 2
* windows10-64: 1
* linux64-nightly: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-04-02&endday=2018-04-02&tree=trunk

Comment 19

[Arthur Iakab [arthur_iakab]]

This bug has failed 194 times in the last 7 days on Linux affecting opt, pgo, debug build types. Failing test: web-platform-tests-e10s.

Link to a recent log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=171624184&lineNumber=5265

Part of tht log: 
[task 2018-04-03T12:48:17.677Z] 12:48:17     INFO - TEST-PASS | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be table and are considered block -- input=file elements 
[task 2018-04-03T12:48:17.677Z] 12:48:17     INFO - TEST-UNEXPECTED-FAIL | /css/css-tables/table-model-fixup-2.html | Replaced elements outside a table cannot be table and are considered block -- img elements - assert_not_equals: got disallowed value 2236
[task 2018-04-03T12:48:17.678Z] 12:48:17     INFO - assertUnequalOffsetTops@http://web-platform.test:8000/css/css-tables/table-model-fixup-2.html:47:9
[task 2018-04-03T12:48:17.678Z] 12:48:17     INFO - @http://web-platform.test:8000/css/css-tables/table-model-fixup-2.html:252:9
[task 2018-04-03T12:48:17.683Z] 12:48:17     INFO - ................
[task 2018-04-03T12:48:17.684Z] 12:48:17     INFO - TEST-OK | /css/css-tables/table-model-fixup-2.html | took 873ms 

:jet do you have any update on this bug?
:jmaher should we disable this test?

Comment 20

[Joel Maher ( :jmaher ) (UTC -8)]

Arthur, lets disable this- we would be depending on code from upstream and the failure rate here is extremely high.

Comment 21

[Intermittent Failures Robot]

54 failures in 165 pushes (0.327 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 24
* mozilla-inbound: 20
* try: 4
* mozilla-central: 3
* mozilla-beta: 3

Platform breakdown:
* linux64-qr: 44
* linux64: 4
* linux64-devedition: 2
* linux32: 2
* linux64-nightly: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-04-03&endday=2018-04-03&tree=trunk

Comment 22

[Jet Villegas (inactive)]

(In reply to Joel Maher ( :jmaher) (UTC-5) from comment #20)
> Arthur, lets disable this- we would be depending on code from upstream and
> the failure rate here is extremely high.

It may not be that simple. This test happens to be the first of similar other tests that depends on a specific image resource being loaded. Disabling this test will likely move the race to the next test (which now works because this test places the needed image in the browser cache.)

Comment 23

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: disable test on linux64-qr

thanks for the warning :jet, I pushed to try and verified this was a single issue instead of more test issues- I believe we are good and restricting this to webrender keeps the test running.

here is a try push:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=e148ce677be724dbd5579ba7fbd2f9707a5aee2f

you can see this fails once on linux64-opt, which is good since we are not disabling it on that platform.

Comment 25

[Intermittent Failures Robot]

96 failures in 158 pushes (0.608 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 39
* mozilla-inbound: 37
* try: 12
* mozilla-central: 7
* mozilla-beta: 1

Platform breakdown:
* linux64-qr: 81
* linux64: 9
* linux64-nightly: 3
* linux32: 2
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-04-04&endday=2018-04-04&tree=trunk

Comment 26

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/4e90aae043ba
Disable /css/css-tables/table-model-fixup-2.html on linux64-qr. r=jet

Comment 27

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/4e90aae043ba

Comment 28

[Intermittent Failures Robot]

33 failures in 147 pushes (0.224 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 14
* mozilla-inbound: 7
* try: 6
* mozilla-central: 4
* mozilla-beta: 2

Platform breakdown:
* linux64-qr: 21
* linux64: 3
* linux32: 3
* linux64-nightly: 2
* linux32-devedition: 2
* linux64-devedition: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-04-05&endday=2018-04-05&tree=trunk

Comment 29

[Intermittent Failures Robot]

262 failures in 765 pushes (0.342 failures/push) were associated with this bug in the last 7 days. 

This is the #3 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* autoland: 101
* mozilla-inbound: 91
* try: 38
* mozilla-central: 20
* mozilla-beta: 12

Platform breakdown:
* linux64-qr: 184
* linux64: 32
* linux32: 21
* linux64-nightly: 9
* linux64-devedition: 6
* linux32-devedition: 5
* linux32-nightly: 4
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-04-02&endday=2018-04-08&tree=trunk

Comment 30

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/fea2069a6e26
Disable /css/css-tables/table-model-fixup-2.html on linux. r=me

Comment 31

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/28514415973b

Comment 32

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/fea2069a6e26

Comment 33

[Intermittent Failures Robot]

15 failures in 792 pushes (0.019 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 6
* mozilla-central: 4
* mozilla-inbound: 2
* autoland: 2
* mozilla-beta: 1

Platform breakdown:
* linux64: 5
* linux32: 5
* linux32-devedition: 3
* linux64-qr: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445164&startday=2018-04-09&endday=2018-04-15&tree=trunk

Comment 34

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.