1887068 - Add support for perfetto track events

Status: RESOLVED FIXED

(Core :: Performance: General, enhancement, P3)

Description

[Denis Palmeiro [:denispal]]

Adding support for track events in perfetto will let us better visualize how work is being scheduled on Android.

Comment 1

[Denis Palmeiro [:denispal]]

Attachment: Bug 1887068: Add perfetto SDK and build with it when gecko profiling is enabled on Android. r=glandium!,smaug!,dveditz!

Comment 2

[Denis Palmeiro [:denispal]]

Attachment: Bug 1887068: Add perfetto event traces for taskcontroller tasks and dom performance measurement markers. r=smaug!

Depends on D205662

Comment 3

[Denis Palmeiro [:denispal]]

Attachment: Bug 1887068: Add proper task names to JS HelperTasks. r=jonco!

Depends on D205663

Comment 4

[Denis Palmeiro [:denispal]]

Attachment: Bug 1887068: Add perfetto to about:license. r=sylvestre!

Depends on D205663

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/90a702920d77
Add perfetto SDK and build with it when gecko profiling is enabled on Android. r=glandium,smaug,dveditz
https://hg.mozilla.org/integration/autoland/rev/3a4d2b74219e
Add perfetto event traces for taskcontroller tasks and dom performance measurement markers. r=smaug
https://hg.mozilla.org/integration/autoland/rev/c6863f012b03
Add perfetto to about:license. r=sylvestre

Comment 6

[Cristian Tuns]

Backed out for causing build bustages

• Backout link
• Push with failures
• Failure Log
• Failure line: clang++: error: linker command failed with exit code 1 (use -v to see invocation)
  gmake[4]: *** [/builds/worker/checkouts/gecko/config/rules.mk:541: libxul.so] Error 1
  gmake[3]: *** [/builds/worker/checkouts/gecko/config/recurse.mk:72: toolkit/library/build/target] Error 2

Comment 7

[Denis Palmeiro [:denispal]]

Removed the asan declarations that perfetto has and replaced them with the declarations in mozilla/MemoryChecking.h which fixes the asan build error.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/efbf5c7065e3
Add perfetto SDK and build with it when gecko profiling is enabled on Android. r=glandium,smaug,dveditz
https://hg.mozilla.org/integration/autoland/rev/61a9d3a1e592
Add perfetto event traces for taskcontroller tasks and dom performance measurement markers. r=smaug
https://hg.mozilla.org/integration/autoland/rev/658f4b57b8ec
Add perfetto to about:license. r=sylvestre

Comment 9

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/efbf5c7065e3
https://hg.mozilla.org/mozilla-central/rev/61a9d3a1e592
https://hg.mozilla.org/mozilla-central/rev/658f4b57b8ec

Comment 10

[Zac McKenney [:zmckenney]]

This appears to be causing build bustages again. Building locally with this revision breaks mach build and reverting this commit fixes the issue.

Relevant build errors

 6:39.41 In file included from Unified_cpp_dom_performance0.cpp:20:
 6:39.41 In file included from /Users/mozilla/StudioProjects/mozilla-unified/dom/performance/Performance.cpp:36:
 6:39.42 /Users/mozilla/StudioProjects/mozilla-unified/obj-aarch64-unknown-linux-android/dist/include/mozilla/Perfetto.h:11:12: warning: non-portable path to file '"Perfetto.h"'; specified path differs in case from file name on disk [-Wnonportable-include-path]
 6:39.42    11 | #  include "perfetto.h"
 6:39.42       |            ^~~~~~~~~~~~
 6:39.42       |            "Perfetto.h"
 6:39.45 /Users/mozilla/StudioProjects/mozilla-unified/obj-aarch64-unknown-linux-android/dist/include/mozilla/Perfetto.h:90:8: error: explicit specialization of undeclared template struct 'TraceTimestampTraits'
 6:39.45    90 | struct TraceTimestampTraits<mozilla::TimeStamp> {
 6:39.46       |        ^                   ~~~~~~~~~~~~~~~~~~~~
 6:39.48 /Users/mozilla/StudioProjects/mozilla-unified/obj-aarch64-unknown-linux-android/dist/include/mozilla/Perfetto.h:91:17: error: unknown type name 'TraceTimestamp'
 6:39.48    91 |   static inline TraceTimestamp ConvertTimestampToTraceTimeNs(
 6:39.48       |                 ^
 6:39.50 /Users/mozilla/StudioProjects/mozilla-unified/obj-aarch64-unknown-linux-android/dist/include/mozilla/Perfetto.h:93:13: error: use of undeclared identifier 'protos'
 6:39.50    93 |     return {protos::gen::BuiltinClock::BUILTIN_CLOCK_MONOTONIC,
 6:39.51       |             ^
 6:39.54 /Users/mozilla/StudioProjects/mozilla-unified/obj-aarch64-unknown-linux-android/dist/include/mozilla/Perfetto.h:101:1: error: a type specifier is required for all declarations
 6:39.54   101 | PERFETTO_DEFINE_CATEGORIES(perfetto::Category("task"),
 6:39.54       | ^
 6:39.60 /Users/mozilla/StudioProjects/mozilla-unified/obj-aarch64-unknown-linux-android/dist/include/mozilla/Perfetto.h:101:38: error: no member named 'Category' in namespace 'perfetto'
 6:39.60   101 | PERFETTO_DEFINE_CATEGORIES(perfetto::Category("task"),
 6:39.60       |                            ~~~~~~~~~~^
 6:39.60 /Users/mozilla/StudioProjects/mozilla-unified/obj-aarch64-unknown-linux-android/dist/include/mozilla/Perfetto.h:102:38: error: no member named 'Category' in namespace 'perfetto'
 6:39.60   102 |                            perfetto::Category("usertiming"));
 6:39.60       |                            ~~~~~~~~~~^
 6:39.79 dom/quota
 6:39.96 dom/reporting
 6:40.48 In file included from Unified_cpp_dom_performance0.cpp:20:
 6:40.48 /Users/mozilla/StudioProjects/mozilla-unified/dom/performance/Performance.cpp:774:7: error: use of undeclared identifier 'TRACE_EVENT_CATEGORY_ENABLED'
 6:40.48   774 |   if (TRACE_EVENT_CATEGORY_ENABLED("usertiming")) {
 6:40.48       |       ^
 6:40.53 /Users/mozilla/StudioProjects/mozilla-unified/dom/performance/Performance.cpp:776:15: error: no type named 'DynamicCategory' in namespace 'perfetto'
 6:40.53   776 |     perfetto::DynamicCategory category{str.get()};
 6:40.53       |     ~~~~~~~~~~^
 6:40.57 /Users/mozilla/StudioProjects/mozilla-unified/dom/performance/Performance.cpp:781:52: error: no member named 'DynamicString' in namespace 'perfetto'
 6:40.57   781 |     PERFETTO_TRACE_EVENT_BEGIN(category, perfetto::DynamicString{str.get()},
 6:40.58       |                                          ~~~~~~~~~~^

Comment 11

[Cristina Horotan [:chorotan]]

Backed out on request for causing build bustages: https://hg.mozilla.org/integration/autoland/rev/90ef908ff18573cca9f4f0e5d676df56875c68b5

Comment 12

[Denis Palmeiro [:denispal]]

Zac, do you know how I can reproduce this locally? Or which job in CI to trigger to reproduce this? Thanks!

Comment 13

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Zac mentioned another coworker also experiences this, and they both build obj-aarch64-unknown-linux-android. We have not observed this in CI.

Comment 14

[Denis Palmeiro [:denispal]]

I guess the OS (mac?) just doesn't like that the header filenames are identical with a different case. I think I can just export perfetto.h somewhere else to address it.

Comment 15

[tszentpeteri]

Backout merged in central: https://hg.mozilla.org/mozilla-central/rev/90ef908ff18573cca9f4f0e5d676df56875c68b5

Comment 16

[Denis Palmeiro [:denispal]]

I can reproduce this on mac.

Comment 17

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2ba85887a077
Add perfetto SDK and build with it when gecko profiling is enabled on Android. r=glandium,smaug,dveditz
https://hg.mozilla.org/integration/autoland/rev/52f1b6130a29
Add perfetto event traces for taskcontroller tasks and dom performance measurement markers. r=smaug
https://hg.mozilla.org/integration/autoland/rev/8817b1939109
Add perfetto to about:license. r=sylvestre

Comment 18

[Zac McKenney [:zmckenney]]

Thanks Denis, Sorry I didn't see your comment sooner but sounds like you reproduced then fixed it. Let me know if I can help with anything else.

Comment 19

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/2ba85887a077
https://hg.mozilla.org/mozilla-central/rev/52f1b6130a29
https://hg.mozilla.org/mozilla-central/rev/8817b1939109