Google Now on-tap doesn't work with Firefox

NEW
Unassigned

Status

()

Firefox for Android
General
2 years ago
2 years ago

People

(Reporter: snorp, Unassigned)

Tracking

(Blocks: 1 bug)

Firefox Tracking Flags

(Not tracked)

Details

I get no results even though I'm viewing a page with a ton of stuff it could look up. It tries to get the text that's showing in the app, so I have no idea how it could do that unless we specifically implement support for it. Maybe some a11y API?
Excerpt from a Quora question[1]: 

> Google Now on Tap make use of View Hierarchy and Assist API features of Android.
> 
> View Hierarchy scans the words you're seeing on your screen, identifies the most relevant terms and pass them to Google search, and then comes back with the info it thinks you need in a nicely structured card format.
> This process is invoked by user and works with any application.

Shows that it should "just work" but its Google Now On Tap that doesn't work well right now with a lot of applications, which is something Google would have to fix themselves.

Also, the Assist API mentioned above requires API 23 or above..

[1]: https://www.quora.com/Is-Google-Now-on-Tap-scraping-your-screen
(In reply to Jonathan Almeida (:jonalmeida) from comment #1)
> Also, the Assist API mentioned above requires API 23 or above..

We're not on targetSdkVersion=23 yet (bug 1207194). Perhaps that's why?
Yeah, looks like we probably want to implement that Assist API stuff. Opt-in, probably?
(In reply to Michael Comella (:mcomella) from comment #2)
> (In reply to Jonathan Almeida (:jonalmeida) from comment #1)
> > Also, the Assist API mentioned above requires API 23 or above..
> 
> We're not on targetSdkVersion=23 yet (bug 1207194). Perhaps that's why?

Most likely. I'm guessing it also can't read anything on the current webpage since it might not show in the view hierarchy? So the Assist API would be the only way so share info on the webpage then, assuming that's the case.

I found a better guide[1] on the Android docs to implementing this.


[1]: http://developer.android.com/training/articles/assistant.html
You need to log in before you can comment on or make changes to this bug.