1346446 - Add DataPipe primitive to IPC

Status: RESOLVED FIXED

(Core :: IPC, enhancement, P3)

Description

[Jeff Muizelaar [:jrmuizel]]

Mojo has a DataPipe primitive that uses shared memory for transferring large amount of data between processes. This would be useful functionality for us to have.

Comment 1

[Jeff Muizelaar [:jrmuizel]]

As a reference here's the code for this in Mojo:
https://cs.chromium.org/chromium/src/mojo/edk/system/data_pipe_consumer_dispatcher.cc?sq=package:chromium&dr=CSs
https://cs.chromium.org/chromium/src/mojo/edk/system/data_pipe_producer_dispatcher.cc?sq=package:chromium&dr=CSs
https://cs.chromium.org/chromium/src/mojo/edk/system/data_pipe_control_message.cc?sq=package:chromium&dr=CSs

As I understand it basically has a shared memory ring buffer that data is copied into and out of and control with control messages that go over the usual ipc mechanism.

Comment 2

[Nika Layzell [:nika] (ni? for response)]

We have some active plans to implement a type like this sometime this year. Self-assigning to track the ongoing work I'm doing with this.

My current implementation uses the UniqueFunction type being added in bug 1743020, so marking that as a blocker for now.

Comment 3

[Nika Layzell [:nika] (ni? for response)]

Attachment: Bug 1346446 - Add a DataPipe shared memory pipe type, r=#ipc-reviewers

This is a high-level async pipe which can be cheaply transferred between
processes and uses a shared memory ring buffer as its implementation. This can
be used to efficiently stream non-message oriented data between processes and
is not bound to any particular protocol or thread.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/632a30d87d6b
Add a DataPipe shared memory pipe type, r=ipc-reviewers,handyman

Comment 5

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/632a30d87d6b