diff options
author | Alexis Lothoré <alexis.lothore@bootlin.com> | 2023-02-24 17:45:52 +0100 |
---|---|---|
committer | Richard Purdie <richard.purdie@linuxfoundation.org> | 2023-02-26 11:59:52 +0000 |
commit | 383cd86595c84a6b6e78bc9d15f10052d60d8193 (patch) | |
tree | e45d30571f21a78297a0daf8a48b4435657107a4 /MEMORIAM | |
parent | 88345ecf477f095ff7f8c4d22f4a919fa87ab116 (diff) | |
download | poky-383cd86595c84a6b6e78bc9d15f10052d60d8193.tar.gz |
scripts/resulttool/regression: add metadata filtering for oeselftest
When generating regression reports, many false positive can be observed since
some tests results are compared while the corresponding tests sets are not the
same, as it can be seen for example for oeselftest tests (oeselftest is run
multiple time but with different parameters, resulting in different tests sets)
Add a filtering mechanism in resulttool regression module to enable a better
matching between tests. The METADATA_MATCH_TABLE defines that when the TEST_TYPE
is "oeselftest", then resulttool should filter pairs based on
OESELFTEST_METADATA appended to test configuration. If metadata is absent from
test results, in order to keep compatibility with older results, add a
"guessing" mechanism to generate the missing OESELFTEST_METADATA. The guessed
data is tightly coupled to the autobuilder configuration, where all oe-selftest
executions are described
(From OE-Core rev: 94ab7c2b892bf292dd86619ca9c63ddd7bf53f3c)
Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Diffstat (limited to 'MEMORIAM')
0 files changed, 0 insertions, 0 deletions