1765735 - test-android-em-7.0-x86_64-lite-qr/opt-geckoview-web-platform-tests-wdspec-nofis-e10s-2 task frequently has a log size above the parsing threshold of Treeherder

Status: RESOLVED FIXED

(Testing :: geckodriver, defect, P5)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

See e.g. https://treeherder.mozilla.org/jobs?repo=autoland&group_state=expanded&selectedJob=375220485&tier=1%2C2%2C3&revision=322c13b909bf1788dd42d147a6df9594f9239898&searchStr=test-android-em-7.0-x86_64-lite-qr%2Fdebug-geckoview-web-platform-tests-wdspec-nofis-e10s&selectedTaskRun=KB-VVnqPTpCbwbjjy90aaw.0

The log is 78MB and doesn't get parsed by Treeherder because of its size.

There have been 13 affected tasks so far (first instance).

The log contains many of these statements:

[task 2022-04-20T23:14:54.770Z] 23:14:54     INFO - PID 4217 | 1650496494749	mozdevice	TRACE	execute_host_command: << "user.geckodriver_backup_100 user.geckodriver_backup_19 \nuser.geckodriver_backup_101 user.geckodriver_backup_20 \nuser.geckodriver_backup_102 user.geckodriver_backup_21 \nuser.geckodriver_backup_103 user.geckodriver_backup_22 \nuser.geckodriver_backup_104 user.geckodriver_backup_23 \nuser.geckodriver_backup_105 user.geckodriver_backup_24 \nuser.geckodriver_backup_106 user.geckodriver_backup_25 \nuser.geckodriver_backup_107 user.geckodriver_backup_26 \nuser.geckodriver_backup_108 user.geckodriver_backup_27 \nuser.geckodriver_backup_109 user.geckodriver_backup_28 \nuser.geckodriver_backup_110 user.geckodriver_backup_29 \nuser.geckodriver_backup_111 user.geckodriver_backup_30 \nuser.geckodriver_backup_112 user.geckodriver_backup_31 \nuser.geckodriver_backup_113 user.geckodriver_backup_32 \nuser.geckodriver_backup_114 user.geckodriver_backup_33 \nuser.geckodriver_backup_115 user.geckodriver_backup_34 \nuser.geckodriver_backup_116 user.geckodriver_backup_35 \nuser.geckodriver_backup_117 user.geckodriver_backup_36 \nuser.geckodriver_backup_118 user.geckodriver_backup_37 \nuser.geckodriver_backup_119 user.geckodriver_backup_38 \nuser.geckodriver_backup_120 user.geckodriver_backup_39 \nuser.geckodriver_backup_121 user.geckodriver_backup_40 \nuser.geckodriver_backup_122 user.geckodriver_backup_41 \nuser.geckodriver_backup_123 user.geckodriver_backup_42 \nuser.geckodriver_backup_124 user.geckodriver_backup_43 \nuser.geckodriver_backup_125 user.geckodriver_backup_44 \nuser.geckodriver_backup_126 user.geckodriver_backup_45 \nuser.geckodriver_backup_127 user.geckodriver_backup_46 \nuser.geckodriver_backup_128 user.geckodriver_backup_47 \nuser.geckodriver_backup_129 user.geckodriver_backup_48 \nuser.geckodriver_backup_130 user.geckodriver_backup_49 \nuser.geckodriver_backup_131 user.geckodriver_backup_50 \nuser.geckodriver_backup_132 user.geckodriver_backup_51 \nuser.geckodriver_backup_133 user.geckodriver_backup_52 \nuser.geckodriver_backup_134 user.geckodriver_backup_53 \nuser.geckodriver_backup_135 user.geckodriver_backup_54 \nuser.geckodriver_backup_136 user.geckodriver_backup_55 \nuser.geckodriver_backup_137 user.geckodriver_backup_56 \nuser.geckodriver_backup_138 user.geckodriver_backup_57 \nuser.geckodriver_backup_139 user.geckodriver_backup_58 \nuser.geckodriver_backup_140 user.geckodriver_backup_59 \nuser.geckodriver_backup_141 user.geckodriver_backup_60 \nuser.geckodriver_backup_142 user.geckodriver_backup_61 \nuser.geckodriver_backup_143 user.geckodriver_backup_62 \nuser.geckodriver_backup_144 user.geckodriver_backup_63 \nuser.geckodriver_backup_145 user.geckodriver_backup_64 \nuser.geckodriver_backup_146 user.geckodriver_backup_65 \nuser.geckodriver_backup_147 user.geckodriver_backup_66 \nuser.geckodriver_backup_148 user.geckodriver_backup_67 \nuser.geckodriver_backup_149 user.geckodriver_backup_68 \nuser.geckodriver_backup_150 user.geckodriver_backup_69 \nuser.geckodriver_backup_151 user.geckodriver_backup_70 \nuser.geckodriver_backup_152 user.geckodriver_backup_71 \nuser.geckodriver_backup_153 user.geckodriver_backup_72 \nuser.geckodriver_backup_154 user.geckodriver_backup_73 \nuser.geckodriver_backup_155 user.geckodriver_backup_74 \nuser.geckodriver_backup_156 user.geckodriver_backup_75 \nuser.geckodriver_backup_157 user.geckodriver_backup_76 \nuser.geckodriver_backup_158 user.geckodriver_backup_77 \nuser.geckodriver_backup_159 user.geckodriver_backup_78 \nuser.geckodriver_backup_16  user.geckodriver_backup_79 \nuser.geckodriver_backup_160 user.geckodriver_backup_80 \nuser.geckodriver_backup_161 user.geckodriver_backup_81 \nuser.geckodriver_backup_162 user.geckodriver_backup_82 \nuser.geckodriver_backup_163 user.geckodriver_backup_83 \nuser.geckodriver_backup_164 user.geckodriver_backup_84 \nuser.geckodriver_backup_165 user.geckodriver_backup_85 \nuser.geckodriver_backup_166 user.geckodriver_backup_86 \nuser.geckodriver_backup_167 user.geckodriver_backup_87 \nuser.geckodriver_backup_168 user.geckodriver_backup_88 \nuser.geckodriver_backup_169 user.geckodriver_backup_89 \nuser.geckodriver_backup_17  user.geckodriver_backup_90 \nuser.geckodriver_backup_170 user.geckodriver_backup_91 \nuser.geckodriver_backup_171 user.geckodriver_backup_92 \nuser.geckodriver_backup_172 user.geckodriver_backup_93 \nuser.geckodriver_backup_173 user.geckodriver_backup_94 \nuser.geckodriver_backup_174 user.geckodriver_backup_95 \nuser.geckodriver_backup_175 user.geckodriver_backup_96 \nuser.geckodriver_backup_176 user.geckodriver_backup_97 \nuser.geckodriver_backup_177 user.geckodriver_backup_98 \nuser.geckodriver_backup_178 user.geckodriver_backup_99 \nuser.geckodriver_backup_18  \n"

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

We should take a look at bug 1757721 to get this fixed. I hope that it will be enough to get the log size below the required threshold.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

With bug 1757721 fixed I can see a huge difference for the generated log file size:

-rw-r--r--@ 1 henrik  staff  15442063 Sep 21 07:37 live_backing_new.log
-rw-r--r--@ 1 henrik  staff  56896038 Sep 21 07:37 live_backing_old.log

I wasn't able to check that yet for a lite build given that those are still running, but I assume it should work there as well.

Aryx, can you please verify? Thanks!

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Android wdspec logs are below the parsing threshold for some time now. Thanks for reducing the log size. It will less likely we observe the issue soon again.