Closed Bug 1602479 Opened 5 years ago Closed 5 years ago

taskclusteretl - investigate 6x jump in peak CPU usage since Dec 2

Categories

(Data Platform and Tools :: General, task, P1)

Product:
Data Platform and Tools
Component:
General
Type:
task
Points:
2

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: trink, Assigned: trink)

References

Details

Before December 2 the CPU usage generally maxed out around 2. Currently the cluster is maxing out at close to the limit [12] for sustained periods of time (days)

Assignee: nobody → mtrinkala
Points: --- → 2
Priority: -- → P1

The CPU increase was caused by 'Build and test the Rust bindings for SpiderMonkey' task. It created individual log lines that are almost 500Kb long; the parser now ignores these lines. The large log lines slowed the parser down enough to exceed the ack timeout causing another reader to pick up and process the message and burn more cycles so it just kept bouncing around the system causing it fall behind.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
See Also: → 1602651
Component: Pipeline Ingestion → General
You need to log in before you can comment on or make changes to this bug.