1938559 - Add a verification step for the results to ensure that the test name matches with the script metadata

Status: NEW

(Testing :: mozperftest, defect, P2)

Description

[Greg Mierzwinski [:sparky]]

Currently, the test name used for any given test in mozperftest is set in a non-standard way across all of our tests. In some cases, such as mochitest, we use the file name, and in others we hard-code a name or modify it during the test (e.g. the android startup test). In both of these situations, the test name that was specified in the script's metadata was not used when it should be.

This is a problem because it makes it impossible for us to query for specific tests in mach-try-perf, and makes it difficult to provide documentation for specific tests in perfdocs since the true test name is not documented anywhere.

To fix this, we'll need to (1) find any areas of code that are causing this mismatch, and then (2) add a verification step to the Metadata class (in the add_results method) to ensure that the test name from the results matches with the test name found in the script's metadata (from the ScriptInfo object).