linux/poky.git/scripts/lib/resulttool, branch 2.8_M3

oeqa/core/case.py: Add OEPTestResultTestCase for ptestresult helpers

2019-09-16T22:02:43+00:00

Add the OEPTestResultTestCase class as a mix-in class to provide helper functions for interacting with ptestresults within the extraresults object generated by the test case. This class also provides default compression of log text and log files. Also add support to resulttool for decoding/decompressing log files embedded in the test results. (From OE-Core rev: 06cba9883a5964320969301fd05eeb6bec3e786d) Signed-off-by: Nathan Rossi Signed-off-by: Richard Purdie

resulttool: Handle multiple series containing ptestresults

2019-09-16T22:02:43+00:00

Handle multiple results series having ptestresults content. The contents are merged on a per-result basis where duplicates are ignored (with a warning message printed). The 'ptestresults.sections' collection is also merged on a per-suite basis. (From OE-Core rev: 47edd51970ed0c33edbe04fd72abd1cfc6ecd3d1) Signed-off-by: Nathan Rossi Signed-off-by: Richard Purdie

resulttool: Add reproducible log extraction

2019-09-06T13:58:10+00:00

Adds an argument to the log subcommand to extract the raw logs from the reproducible selftest. To prevent ambiguity, the "--raw" argument has been renamed "--raw-ptest", although the old "--raw" argument is kept around for compatibility. [YOCTO #13324] (From OE-Core rev: 7a4ebb361ff1efc22e7dafadfa60c98bc8a79ed4) Signed-off-by: Joshua Watt Signed-off-by: Ross Burton Signed-off-by: Richard Purdie

scripts/lib/resulttool/report.py: Add more result types

2019-08-28T15:44:09+00:00

Add additional result types into the dictionary to handle dejagnu style test results. These include PASS, FAIL, XPASS, XFAIL, UNSUPPORTED, UNTESTED, UNRESOLVED and ERROR. (From OE-Core rev: 684fc36402a23760b203f4761f284043031c799c) Signed-off-by: Nathan Rossi Signed-off-by: Richard Purdie

resulttool: Prevent multiple results for the same test

2019-08-21T20:52:59+00:00

Currently, if a test occurs multiple times over different series, the code will sum these. This can lead to confusion over the desired results. Change the code to report the redundant tests and skip adding an additional values. (From OE-Core rev: caeaa0648dff64c56a33f52e45e82bfab6719e3e) Signed-off-by: Jon Mason Signed-off-by: Ross Burton Signed-off-by: Richard Purdie

resulttool/merge: Enable control TESTSERIES and extra configurations

2019-06-12T09:54:40+00:00

Current QA team need to merge test result files from multiple sources. Adding TESTSERIES configuration too early will have negative implication to report and regression. Enable control to add TESTSERIES when needed. Also enable adding EXECUTED_BY configuration when needed. (From OE-Core rev: 651d8d371e78e77599d56681228d5782664f7743) Signed-off-by: Yeoh Ee Peng Signed-off-by: Richard Purdie

resulttool/store: Enable add EXECUTED_BY config to results

2019-06-12T09:54:40+00:00

Current results stored does not have information needed to trace who executed the tests. Enable store to add EXECUTED_BY configuration to results file in order to track who executed the tests. (From OE-Core rev: dca2a57d54163a2e63b06e2f140fea3bd49cef0d) Signed-off-by: Yeoh Ee Peng Signed-off-by: Richard Purdie

resulttool/resultutils: Enable add extra configurations to results

2019-06-12T09:54:40+00:00

Current resultutils library always add "TESTSERIES" configuration to results. Enhance this to allow control of adding "TESTSERIES" configuration as well as allow adding extra configurations when needed. (From OE-Core rev: 443c0acc14ef2451b10878fc83dd11b46805daf0) Signed-off-by: Yeoh Ee Peng Signed-off-by: Richard Purdie

resulttool: Remove prints if no tests occur

2019-06-04T22:09:24+00:00

Printing the lack of a test is not necessary (per feedback). Remove this from the template to quieten it. (From OE-Core rev: b1fe6ae66360e160eeaeafe456536f335a0eab60) Signed-off-by: Jon Mason Signed-off-by: Richard Purdie

resulttool/manualexecution: Enable creation of test case configuration

2019-06-04T08:09:42+00:00

Allow the creation of test case configuration file based on user inputs. Where this testcase configuration file will be used by the the manual execution to run selected test cases for a module rather than compulsory run all test cases in manual json file. (From OE-Core rev: 73d2a747c17779da0ca972da776b3cf02c2e1cbc) Signed-off-by: sangeeta jain Signed-off-by: Richard Purdie