The mozilla-releases indexer for today is currently at 9.5 hours runtime. A cursory investigation of the indexer log shows it took about 54min for the output.sh stage to complete for mozilla-esr60, 2 hours for mozilla-release, 2h9min for mozilla-esr68, and mozilla-beta is currently about to hit the 2 hour mark. The parallel batching job says that for our mozilla-central job, each parallel job took about 6 seconds to run on average, whereas we're looking at ~11.3s for mozilla-esr60, ~21.9s for mozilla-release, ~23.2s for mozilla-esr68, and ~26.8 for mozilla-beta. We recently changed the configuration for this indexer because the indexer was filling up. ### General data dump #### CPU /cpu/procinfo shows 8 cores like so: ```shell processor : 7 vendor_id : GenuineIntel cpu family : 6 model : 62 model name : Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz stepping : 4 microcode : 0x42e cpu MHz : 2800.106 cache size : 25600 KB physical id : 0 siblings : 8 core id : 3 cpu cores : 4 apicid : 7 initial apicid : 7 fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm fsgsbase smep erms xsaveopt bugs : bogomips : 5600.21 clflush size : 64 cache_alignment : 64 address sizes : 46 bits physical, 48 bits virtual power management: ``` top matches up fairly well too. ```shell 7099 ubuntu 20 0 3030696 624604 329724 R 90.7 4.1 0:08.99 output-file 7122 ubuntu 20 0 3030704 624764 329804 R 90.7 4.1 0:09.01 output-file 7008 ubuntu 20 0 3030684 623288 328384 R 90.4 4.0 0:09.04 output-file 7021 ubuntu 20 0 3030696 623668 328636 R 90.4 4.1 0:09.06 output-file 7066 ubuntu 20 0 3030736 624716 329748 R 90.4 4.1 0:09.02 output-file 7176 ubuntu 20 0 3030792 624568 329720 R 90.4 4.1 0:08.85 output-file 7181 ubuntu 20 0 3030804 624672 329708 R 90.4 4.1 0:08.85 output-file 7163 ubuntu 20 0 3030764 624632 329736 R 90.0 4.1 0:08.87 output-file ``` #### Disk ```shell ubuntu@ip-elided:~$ df -h Filesystem Size Used Avail Use% Mounted on udev 7.4G 0 7.4G 0% /dev tmpfs 1.5G 8.7M 1.5G 1% /run /dev/xvda1 7.8G 5.4G 2.0G 74% / tmpfs 7.4G 0 7.4G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 7.4G 0 7.4G 0% /sys/fs/cgroup /dev/xvdb 79G 56M 75G 1% /mnt /dev/xvdf 296G 234G 47G 84% /index tmpfs 1.5G 0 1.5G 0% /run/user/1000 ```
Bug 1567724 Comment 0 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
The mozilla-releases indexer for today is currently at 9.5 hours runtime. A cursory investigation of the indexer log shows it took about 54min for the output.sh stage to complete for mozilla-esr60, 2 hours for mozilla-release, 2h9min for mozilla-esr68, and mozilla-beta is currently about to hit the 2 hour mark. The parallel batching job says that for our mozilla-central job (extracting an AVG value from near the end of the run; which may be the wrong average to grab), each parallel job took about 6 seconds to run on average, whereas we're looking at ~11.3s for mozilla-esr60, ~21.9s for mozilla-release, ~23.2s for mozilla-esr68, and ~26.8 for mozilla-beta. We recently changed the configuration for this indexer because the indexer was filling up. ### General data dump #### CPU /cpu/procinfo shows 8 cores like so: ```shell processor : 7 vendor_id : GenuineIntel cpu family : 6 model : 62 model name : Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz stepping : 4 microcode : 0x42e cpu MHz : 2800.106 cache size : 25600 KB physical id : 0 siblings : 8 core id : 3 cpu cores : 4 apicid : 7 initial apicid : 7 fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm fsgsbase smep erms xsaveopt bugs : bogomips : 5600.21 clflush size : 64 cache_alignment : 64 address sizes : 46 bits physical, 48 bits virtual power management: ``` top matches up fairly well too. ```shell 7099 ubuntu 20 0 3030696 624604 329724 R 90.7 4.1 0:08.99 output-file 7122 ubuntu 20 0 3030704 624764 329804 R 90.7 4.1 0:09.01 output-file 7008 ubuntu 20 0 3030684 623288 328384 R 90.4 4.0 0:09.04 output-file 7021 ubuntu 20 0 3030696 623668 328636 R 90.4 4.1 0:09.06 output-file 7066 ubuntu 20 0 3030736 624716 329748 R 90.4 4.1 0:09.02 output-file 7176 ubuntu 20 0 3030792 624568 329720 R 90.4 4.1 0:08.85 output-file 7181 ubuntu 20 0 3030804 624672 329708 R 90.4 4.1 0:08.85 output-file 7163 ubuntu 20 0 3030764 624632 329736 R 90.0 4.1 0:08.87 output-file ``` #### Disk ```shell ubuntu@ip-elided:~$ df -h Filesystem Size Used Avail Use% Mounted on udev 7.4G 0 7.4G 0% /dev tmpfs 1.5G 8.7M 1.5G 1% /run /dev/xvda1 7.8G 5.4G 2.0G 74% / tmpfs 7.4G 0 7.4G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 7.4G 0 7.4G 0% /sys/fs/cgroup /dev/xvdb 79G 56M 75G 1% /mnt /dev/xvdf 296G 234G 47G 84% /index tmpfs 1.5G 0 1.5G 0% /run/user/1000 ```