Bug 1535031 Comment 3 Edit History

Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.

(In reply to Will Hawkins from comment #2)

> I am sorry to have to ask this question, but these results seem inconsistent:
> 
> https://treeherder.mozilla.org/perf.html#/compare?originalProject=autoland&originalRevision=583048926c121b876326a536f44e14034035372c&newProject=autoland&newRevision=95274fd66e5bea637cc26d7047aef7f96d5e19a7&framework=10
> 
> shows a performance decrease, but when I click through to 
> https://treeherder.mozilla.org/perf.html#/comparesubtest?originalProject=autoland&originalRevision=583048926c121b876326a536f44e14034035372c&newProject=autoland&newRevision=95274fd66e5bea637cc26d7047aef7f96d5e19a7&originalSignature=1801528&newSignature=1801528&framework=10
> 
> I only see positive improvements. I'm not sure where to look to debug, in this case. 


:gw could there be a problem with the integration of Motionmark Animometer? From the logs, I see all subsets have **lowerIsBetter == true**, while the overall average has "lowerIsBetter == false".

> I apologize if I am reading these results incorrectly.

No need to worry about that. Feedback like these is always welcomed.
(In reply to Will Hawkins from comment #2)

> I am sorry to have to ask this question, but these results seem inconsistent:
> 
> https://treeherder.mozilla.org/perf.html#/compare?originalProject=autoland&originalRevision=583048926c121b876326a536f44e14034035372c&newProject=autoland&newRevision=95274fd66e5bea637cc26d7047aef7f96d5e19a7&framework=10
> 
> shows a performance decrease, but when I click through to 
> https://treeherder.mozilla.org/perf.html#/comparesubtest?originalProject=autoland&originalRevision=583048926c121b876326a536f44e14034035372c&newProject=autoland&newRevision=95274fd66e5bea637cc26d7047aef7f96d5e19a7&originalSignature=1801528&newSignature=1801528&framework=10
> 
> I only see positive improvements. I'm not sure where to look to debug, in this case. 


:gw could there be a problem with the integration of Motionmark Animometer? From the logs, I see all subsets have **lowerIsBetter == true**, while the overall average has **lowerIsBetter == false**.

> I apologize if I am reading these results incorrectly.

No need to worry about that. Feedback like these is always welcomed.
(In reply to Will Hawkins from comment #2)

> I am sorry to have to ask this question, but these results seem inconsistent:
> 
> https://treeherder.mozilla.org/perf.html#/compare?originalProject=autoland&originalRevision=583048926c121b876326a536f44e14034035372c&newProject=autoland&newRevision=95274fd66e5bea637cc26d7047aef7f96d5e19a7&framework=10
> 
> shows a performance decrease, but when I click through to 
> https://treeherder.mozilla.org/perf.html#/comparesubtest?originalProject=autoland&originalRevision=583048926c121b876326a536f44e14034035372c&newProject=autoland&newRevision=95274fd66e5bea637cc26d7047aef7f96d5e19a7&originalSignature=1801528&newSignature=1801528&framework=10
> 
> I only see positive improvements. I'm not sure where to look to debug, in this case. 


:gw could there be a problem with the integration of Motionmark Animometer? From the logs, I see all subsets have **lowerIsBetter: true**, while the overall average has **lowerIsBetter: false**.

> I apologize if I am reading these results incorrectly.

No need to worry about that. Feedback like these is always welcomed.
(In reply to Will Hawkins from comment #2)

> I am sorry to have to ask this question, but these results seem inconsistent:
> 
> https://treeherder.mozilla.org/perf.html#/compare?originalProject=autoland&originalRevision=583048926c121b876326a536f44e14034035372c&newProject=autoland&newRevision=95274fd66e5bea637cc26d7047aef7f96d5e19a7&framework=10
> 
> shows a performance decrease, but when I click through to 
> https://treeherder.mozilla.org/perf.html#/comparesubtest?originalProject=autoland&originalRevision=583048926c121b876326a536f44e14034035372c&newProject=autoland&newRevision=95274fd66e5bea637cc26d7047aef7f96d5e19a7&originalSignature=1801528&newSignature=1801528&framework=10
> 
> I only see positive improvements. I'm not sure where to look to debug, in this case. 


:gw could there be a problem with the integration of Motionmark Animometer? From the logs, I see all subsets have **lowerIsBetter: true**, while the overall average has **lowerIsBetter: false**.

> I apologize if I am reading these results incorrectly.

No need to worry about that. Feedback like this is always welcomed.

Back to Bug 1535031 Comment 3