Closed Bug 1642886 Opened 5 years ago Closed 5 years ago

Inconsistent test logs

Categories

(Tree Management :: Treeherder, defect, P1)

Product:
Tree Management
Component:
Treeherder
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: igoldan, Assigned: ekyle)

Details

When running pytest on all our backend tests, there are 2 test modules which dump extra logs, such as:

tests/extract/test_extract_alerts.py ..7d829bf44284 (pid 42) - 2020-06-03 06:45:41.590605 - Main Thread - "/usr/local/lib/python3.7/site-packages/jx_mysql/mysql_snowflake_extractor.py:890" - (construct_docs) - Timer start: Downloading from MySQL
7d829bf44284 (pid 42) - 2020-06-03 06:45:41.603554 - Main Thread - "/usr/local/lib/python3.7/site-packages/jx_mysql/mysql_snowflake_extractor.py:948" - (construct_docs) - Timer end  : Downloading from MySQL (took 0.013 seconds)
7d829bf44284 (pid 42) - 2020-06-03 06:45:41.603696 - Main Thread - "/usr/local/lib/python3.7/site-packages/jx_mysql/mysql_snowflake_extractor.py:953" - (construct_docs) - 1 documents (3 db records)
                                                                                                                                                                                                                                                                                                                                                                                                                                          [ 15%]
tests/extract/test_extract_job.py .....7d829bf44284 (pid 42) - 2020-06-03 06:45:54.012379 - Main Thread - "/usr/local/lib/python3.7/site-packages/jx_mysql/mysql_snowflake_extractor.py:890" - (construct_docs) - Timer start: Downloading from MySQL
7d829bf44284 (pid 42) - 2020-06-03 06:45:54.014967 - Main Thread - "/usr/local/lib/python3.7/site-packages/jx_mysql/mysql_snowflake_extractor.py:948" - (construct_docs) - Timer end  : Downloading from MySQL (took 0.003 seconds)
7d829bf44284 (pid 42) - 2020-06-03 06:45:54.015098 - Main Thread - "/usr/local/lib/python3.7/site-packages/jx_mysql/mysql_snowflake_extractor.py:953" - (construct_docs) - 1 documents (11 db records)

We need to hide info logs like these ones, such that pytest only shows dots, Xs, Ss, which require less cognitive overhead.

Severity: -- → S3

What are the steps you run?
What are the lines that emit these messages?

These log lines are visible on our Travis tests from Github PRs.

Kyle: Could you please have a look at these extra logged lines?

Flags: needinfo?(klahnakoski)

:igoldan

I think it is caused by "log_type": "console" in the *.json files used by the extract code.

Flags: needinfo?(klahnakoski)
Assignee: nobody → klahnakoski
Status: NEW → RESOLVED
Closed: 5 years ago
Priority: P3 → P1
Resolution: --- → FIXED

Verified (No "Main Thread"):
https://travis-ci.org/github/mozilla/treeherder/jobs/694541278

Thank you for reporting and the fix!

You need to log in before you can comment on or make changes to this bug.