summaryrefslogtreecommitdiffstats
path: root/MEMORIAM
diff options
context:
space:
mode:
authorAlexis Lothoré <alexis.lothore@bootlin.com>2023-02-24 17:45:52 +0100
committerRichard Purdie <richard.purdie@linuxfoundation.org>2023-02-26 11:59:52 +0000
commit383cd86595c84a6b6e78bc9d15f10052d60d8193 (patch)
treee45d30571f21a78297a0daf8a48b4435657107a4 /MEMORIAM
parent88345ecf477f095ff7f8c4d22f4a919fa87ab116 (diff)
downloadpoky-383cd86595c84a6b6e78bc9d15f10052d60d8193.tar.gz
scripts/resulttool/regression: add metadata filtering for oeselftest
When generating regression reports, many false positive can be observed since some tests results are compared while the corresponding tests sets are not the same, as it can be seen for example for oeselftest tests (oeselftest is run multiple time but with different parameters, resulting in different tests sets) Add a filtering mechanism in resulttool regression module to enable a better matching between tests. The METADATA_MATCH_TABLE defines that when the TEST_TYPE is "oeselftest", then resulttool should filter pairs based on OESELFTEST_METADATA appended to test configuration. If metadata is absent from test results, in order to keep compatibility with older results, add a "guessing" mechanism to generate the missing OESELFTEST_METADATA. The guessed data is tightly coupled to the autobuilder configuration, where all oe-selftest executions are described (From OE-Core rev: 94ab7c2b892bf292dd86619ca9c63ddd7bf53f3c) Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Diffstat (limited to 'MEMORIAM')
0 files changed, 0 insertions, 0 deletions