Bug 1100203 (foxeye)

[FoxEye][Meta] Project FoxEye: Bring modern computer vision and image processing technology to the Web.

NEW
Assigned to

Status

()

defect
P5
normal
5 years ago
a year ago

People

(Reporter: ctai, Assigned: ctai)

Tracking

(Depends on 5 bugs, {meta})

unspecified
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(tracking-b2g:backlog)

Details

User Story

https://wiki.mozilla.org/Project_FoxEye
The goal of this project is bringing the power of computer vision and image processing to the Web. By extending the spec of Media Capture and Streams, the web developers can write video processing related applications in better way. The primary idea is to incorporate Worker-based JavaScript video processing with MediaStreamTrack. The user's video processing script can do the real image processing and analysis works frame by frame.
Assignee: nobody → ctai

Comment 1

5 years ago
Short of a strong signal from other implementors, bug 961689 (which is "only" an optimization, no new API) seems like a more realistic approach than bugs 801176 and 709490 (new APIs available to web workers) if the goal is to bring something to the Web.
The main spirit of this project is not bugs 801176 and bug 709490. The whole blue print is in https://wiki.mozilla.org/Project_FoxEye . Since it is still in early stage, the wiki will be changed frequently.



(In reply to David Bruant from comment #1)
> Short of a strong signal from other implementors, bug 961689 (which is
> "only" an optimization, no new API) seems like a more realistic approach
> than bugs 801176 and 709490 (new APIs available to web workers) if the goal
> is to bring something to the Web.

Updated

5 years ago
User Story: (updated)
Depends on: 1108950
In current Web technology, we don't have a good(generic) way to do video/camera processing/analysis task. That limited the application developers to show their creative ideas on Web platform with camera and video. Those kind of features are important for mobile OS. There are of lots of popular Apps about camera/video processing area. For example, Amazon firefly, WeVideo, WordLens, Waygo, AR effects are popular apps in Android and iOS. 

Project FoxEye unleash those constraints by providing MediaStreamTrack with worker, OfflineMediaContext and WebImage library.
Depends on: 1108956

Updated

4 years ago
Depends on: 1116674
Depends on: 1141979
Depends on: 917187
API draft for
Depends on: 1070216
API draft: MediaStream extension for VideoWorker.
http://chiahungtai.github.io/mediacapture-worker/
Feel free to discuss it.

Comment 6

4 years ago
[Tracking Requested - why for this release]:
Depends on: 1183481

Updated

4 years ago
Alias: foxeye

Updated

4 years ago
Depends on: 1187812
Component: Audio/Video → Audio/Video: MSG/cubeb/GMP

Updated

3 years ago
Depends on: 1235301
We don't have plans to pursue this experiment for now.
Priority: -- → P5
You need to log in before you can comment on or make changes to this bug.