1318769 - Emoji no longer appearing on getemoji.com and twitter.com, on Android

Status: RESOLVED FIXED

(Firefox for Android Graveyard :: General, defect)

Description

[Thomas Wisniewski]

In version 49, emoji appear on getemoji.com. In 50 and up, almost none of them do (testing on pristine profiles on my Android 4.4.1 phone). The page itself just specifies the CSS font family as Segoe UI Emoji, nothing fancy.

Comment 1

[Kartikaya Gupta (email:[e-mail])]

Tim, could this be a regression from bug 1231701?

Comment 2

[Tim Guan-tin Chien [:timdream] (please needinfo)]

Bug 1231701 did not land on Firefox for Android so it's unlikely the cause. It would be great if someone could use the remote debugger to figure out which font Gecko selects (incorrectly).

Comment 3

[Thomas Wisniewski]

Sure. Interestingly, remote debugging in both 49 and 53/nightly reveals the same values.

The console gives this for one of the <p> elements (which has 'style="font-family:Segoe UI Emoji; font-size:3.5em"'):
>getComputedStyle(elem, null).getPropertyValue("font-family")
>>Segoe UI Emoji

The fonts panel in devtools shows these system fonts:
>Clear Sans
>Droid Sans Fallback
>Noto Color Emoji
>SamsungEmoji

Comment 5

[Daniel Holbert [:dholbert]]

[Tracking Requested - why for this release]:
Graphical regression on major site (Twitter).
=====

This affects twitter, too (which I initially filed independently as bug 1326365).  See screenshots on that bug. Sample affected URL: https://mobile.twitter.com/rizmc/status/813726874941558784

mozregression (using my OnePlus One phone & CyanogenMod 13 / Android 6) says this is a regression from bug 725119. Requesting tracking, since this is a serious graphical regression on a major site, which we're about to ship in 51.

Comment 6

[Lee Salzman [:lsalzman]]

Attachment: make SkFontHost_cairo match cairo-ft's handling of FcPattern embeddedbitmap option

The main problem for Android is that we always defaulted the embedded bitmap flag to off. On Linux we had a similar issue, though Fontconfig was supposed to get involved to override that.

I went and investigated what cairo-ft actually does and tried to match it as best as we can, so that both appearance and metrics line up again. So cairo-ft does:

1) On Android without fontconfig, never disable bitmaps.
2) On Linux with fontconfig, it is a bit inane. It only ever disables bitmaps if AA is enabled, and then only if embeddedbitmap was not explicitly assigned true. So without AA, it always leaves bitmaps enabled.

In the future when we are no longer bound by matching Cairo, we probably want saner parsing of embeddedbitmap, but for now, we match Cairo again and emoji will show up now.

Comment 7

[Lee Salzman [:lsalzman]]

Attachment: make SkFontHost_cairo match cairo-ft's handling of FcPattern embeddedbitmap option

... Better version of the above patch.

This one makes the decision to disable bitmaps depend only on the fontconfig AA setting, not on our user-supplied AA overrides. This is yet closer to how Cairo behaves. It should increase consistency and prevent some possible accidents where bitmaps would show up in some cases but not others depending on whether we internally allowed AA or not regardless of what fontconfig wanted.

Comment 8

[Jonathan Kew [:jfkthame]]

Please also nominate this for uplift as soon as it's safely landed and confirmed to fix the issue.

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/277613c55806
make SkFontHost_cairo match cairo-ft's handling of FcPattern embeddedbitmap option. r=jfkthame

Comment 10

[Phil Ringnalda (:philor)]

https://hg.mozilla.org/mozilla-central/rev/277613c55806

Comment 11

[Lee Salzman [:lsalzman]]

Daniel, can you verify if this issue is now fixed?

Comment 12

[Thomas Wisniewski]

I can verify that the sample URLs are showing emoji again on my Android devices in today's nightly.

Comment 13

[Daniel Holbert [:dholbert]]

Seems fixed to me as well, using https://mobile.twitter.com/rizmc/status/813726874941558784 and http://getemoji.com/ , in today's Android Nightly. Thanks!

Kicking needinfo back over to Lee for backport approvals.

Comment 14

[Ioana Chiorean]

Attachment: swarm.png

I am seeing this on swarm year in review page (I think it is the same issue) and it is fixed in Nightly indeed, Beta still affected. I will be waiting for uplifts and check again. 
Link: https://t.co/JR5S5EcCbr

Comment 15

[Lee Salzman [:lsalzman]]

Comment on attachment 8822816 [details] [diff] [review]
make SkFontHost_cairo match cairo-ft's handling of FcPattern embeddedbitmap option

Approval Request Comment
[Feature/Bug causing the regression]: bug 725119, 51+
[User impact if declined]: Emoji fail to show up on Android and Linux.
[Is this code covered by automated tests?]: no
[Has the fix been verified in Nightly?]: yes
[Needs manual test from QE? If yes, steps to reproduce]: no 
[List of other uplifts needed for the feature/fix]: aurora, beta
[Is the change risky?]: no
[Why is the change risky/not risky?]: Small change to how fonts are loaded that should make us match our retired Cairo content rendering backend.
[String changes made/needed]: None

Comment 16

[Lee Salzman [:lsalzman]]

Attachment: add reftest to verify that color emoji show up

Comment 17

[Jeff Muizelaar [:jrmuizel]]

Comment on attachment 8823390 [details] [diff] [review]
add reftest to verify that color emoji show up

Review of attachment 8823390 [details] [diff] [review]:
-----------------------------------------------------------------

This may need to be special case to only pass on platforms that have color emoji fonts.

Comment 18

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/8c207c957193
add reftest to verify that color emoji show up. r=jrmuizel

Comment 19

[Julien Cristau [:jcristau]]

Comment on attachment 8822816 [details] [diff] [review]
make SkFontHost_cairo match cairo-ft's handling of FcPattern embeddedbitmap option

fix recent regression for emojis on android, take in aurora52

Comment 20

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/8c207c957193

Comment 21

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/releases/mozilla-aurora/rev/50730a14e12a
https://hg.mozilla.org/releases/mozilla-aurora/rev/601f420a4734

Comment 22

[Lee Salzman [:lsalzman]]

Sylvestre, can you get this uplifted to beta soon? Otherwise as of 51 release we will have broken emoji everywhere on Android...

Comment 23

[Milan Sreckovic [:milan] (needinfo for best results)]

Can't have twitter without emojis

Comment 24

[Liz Henry (:lizzard) (relman/hg->git project)]

Comment on attachment 8822816 [details] [diff] [review]
make SkFontHost_cairo match cairo-ft's handling of FcPattern embeddedbitmap option

Let's land this for the beta 13 build today.

Comment 25

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/releases/mozilla-beta/rev/fdc8e436aa0a
https://hg.mozilla.org/releases/mozilla-beta/rev/e2a728f8db97

Comment 26

[u549602]

Verified as fixed on all branches (Nightly 53.0a1/10.01, Aurora 52.0a2/11.01 and Beta 51.0b13) on a Nexus 9 (Android 6.0.2) and on a Xiaomi mi i4 (Android 5.0.2).

Comment 27

[Gerry Chang [:gchang]]

Track 51+ as regression related to emoji.

Comment 28

[Ileana]

On this one http://www.get-emoji.com/ , it seems that the emoji appear.
On a Samsung galaxy S4 , android version 5.0.1