linux/poky.git/scripts/lib/resulttool, branch yocto-2.6.2Mirror of git.yoctoproject.org/pokyhttps://git.enea.com/cgit/linux/poky.git/atom?h=yocto-2.6.22019-03-26T15:38:23+00:00resulttool/manualexecution: To output right test case id2019-03-26T15:38:23+00:00Mazlianamazliana.mohamad@intel.com2019-03-11T08:30:33+00:00urn:sha1:df4d56b25aeeb2730e544b819f683ed0062168cd
We found that manualexecution does not capture test suite values
correctly if there are more than one test suite in test cases.
After verification has made we found out we should retrieved
full test cases value <test_module.test_suite.test_case> from
oeqa/manual/ json file rather than split it them into new
variables test_suite and test_cases.
(From OE-Core rev: c4c63cdc1eca2acebc4ec9486b0d0592e47a8ae2)
Signed-off-by: Mazliana <mazliana.mohamad@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
resulttool/report: Enable roll-up report for a commit2019-03-26T15:38:23+00:00Yeoh Ee Pengee.peng.yeoh@intel.com2019-03-12T05:05:28+00:00urn:sha1:d41c0a34e740d88be6a95873add7fa63eff02ac1
Enable roll-up all test results belong to a commit
and to provide a roll-up report.
(From OE-Core rev: f2d6019f39a4037cf0914b1cfb3ccb3a03dacfc6)
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
scripts/resulttool: Enable manual result store and regression2019-03-26T15:38:23+00:00Yeoh Ee Pengee.peng.yeoh@intel.com2019-03-07T04:49:08+00:00urn:sha1:10502961503e56d8c703bd442ee3071199e683ce
To enable store for testresults.json file from manualexecution,
add layers metadata to configuration and add "manual" map to
resultutils.store_map.
To enable regression for manual, add "manual" map to
resultutils.regression_map. Also added compulsory configurations
('MACHINE', 'IMAGE_BASENAME') to manualexecution.
(From OE-Core rev: 3e711cd0482e9df644b011a7d6dadffdfe139f8e)
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
resulttool/regression: Ensure regressoin results are sorted2019-03-26T15:38:23+00:00Yeoh Ee Pengee.peng.yeoh@intel.com2019-02-28T01:58:57+00:00urn:sha1:b6fa6f7e6c7305a9a664d39724ffb4076929a0a5
Sorted regression results to provide friendly viewing of report.
(From OE-Core rev: cbe96a6dcb95032c61393bac348141e15a6b6590)
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
resulttool/store: Fix missing variable causing testresult corruption2019-03-26T15:38:23+00:00Richard Purdierichard.purdie@linuxfoundation.org2019-02-28T13:16:47+00:00urn:sha1:dcb9804dff2e104fbb723f96cfbb879bfc8be163
(From OE-Core rev: 0d98b9957c611af354efb33f4e915c5166c87ad3)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
resulttool/report: Ensure ptest results are sorted2019-03-26T15:38:23+00:00Richard Purdierichard.purdie@linuxfoundation.org2019-02-27T17:10:19+00:00urn:sha1:38bbbb4ee19e2be5461b267da71c528d3fa1d0d0
(From OE-Core rev: 2e3ffad9e97c5f757e1457721308eb8da63bcabf)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
resulttool/report: Ensure test suites with no results show up on the report2019-03-26T15:38:23+00:00Richard Purdierichard.purdie@linuxfoundation.org2019-02-27T17:05:29+00:00urn:sha1:19a3f1ba470c38c4bb18f01efd01673f063b002f
ptest suites with no results don't show up on the reports even though we have
a duration for them. Fix this so the fact they report no tests is visible.
(From OE-Core rev: eb67a3cc4f8f57e85f1f95ced8f2c32ab5090866)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
resulttool/report: Handle missing metadata sections more cleanly2019-03-26T15:38:23+00:00Richard Purdierichard.purdie@linuxfoundation.org2019-02-27T16:51:56+00:00urn:sha1:4b5686a0fd220fd97bb7a205d746f27cb8d21ce2
Currently some older results files cause the code to give tracebacks.
Handle these missing sections more cleanly.
(From OE-Core rev: 93b87a9a7056fb507a585c454cef8db7194d7393)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
resulttool/store: Handle results files for multiple revisions2019-03-26T15:38:23+00:00Richard Purdierichard.purdie@linuxfoundation.org2019-02-27T11:59:54+00:00urn:sha1:3cbd483c42e57862a38967803d718a525fad639d
Currently we cant store results if the results files span multiple
different build revisons. Remove this limitation by iterating.
(From OE-Core rev: 63d2c53c01d2aec90b3f0ab298a61a551b23d8fc)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
resulttool/resultutils: Avoids tracebacks for missing logs2019-03-26T15:38:23+00:00Richard Purdierichard.purdie@linuxfoundation.org2019-02-23T22:49:11+00:00urn:sha1:094b6ea1fc2e15af6829049101fc6e8328e4bba8
(From OE-Core rev: faacf35d748067fd17d169c09bc2759606e6e819)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>