linux/poky.git/scripts/oe-build-perf-test, branch 2.4_M2

oe-build-perf-test: pack all buildstat in one file

2017-03-27T07:15:06+00:00

Write out all buildstats into one big json file, instead of using multiple per-measurement files. Individual buildstats will be indexed using "." as the key. Also, changes the per-testcase working directories into temporary directories that will be removed after test execution as there are no more per-testcase data files to store permanently. [YOCTO #10582] (From OE-Core rev: a7f2e8915db379021f3409ca640de5d3b054a830) Signed-off-by: Markus Lehtonen Signed-off-by: Richard Purdie

oe-build-perf-test: drop --commit-results

2017-02-16T04:06:41+00:00

Drop support for committing results into Git repository. The functionality was not directly related to testing and feels unnecessary complication of the script. The functionality has been moved into a separate oe-git-archive script. [YOCTO #10582] (From OE-Core rev: 4de387c0cfcb6b58760c6b6e150474abe82bfe4c) Signed-off-by: Markus Lehtonen Signed-off-by: Ross Burton Signed-off-by: Richard Purdie

oe-build-perf-test: remove unused imports and fix indent

2017-01-23T12:05:22+00:00

[YOCTO #10590] (From OE-Core rev: 0b1892fa9165407a156609ff7cb3708e21bacd8c) Signed-off-by: Markus Lehtonen Signed-off-by: Ross Burton Signed-off-by: Richard Purdie

oe-build-perf-test: save test metadata in a separate file

2017-01-23T12:05:22+00:00

The patch introduces a new metadata (.json or .xml) file in the output directory. All test meta data, e.g. git revision information and tester host information is now stored there. The JSON report format is slightly changed as the metadata is not present in results.json anymore. [YOCTO #10590] (From OE-Core rev: 2036c646019660e32f1bc277fdec0cdbff0afdd4) Signed-off-by: Markus Lehtonen Signed-off-by: Ross Burton Signed-off-by: Richard Purdie

oe-build-perf-test: enable xml reporting

2017-01-23T12:05:21+00:00

Add --xml command line option to oe-build-perf-test script for producing a test report in JUnit XML format instead of JSON. [YOCTO #10590] (From OE-Core rev: 21ae1c491b93675254b7733640662b566ed76f98) Signed-off-by: Markus Lehtonen Signed-off-by: Ross Burton Signed-off-by: Richard Purdie

oe-build-perf-test: return 2 if some tests failed

2016-10-01T20:45:56+00:00

Add a new return value '2' that indicates that some tests failed but there were no fatal errors (i.e. configuration mistakes or bugs in the tests themselves). (From OE-Core rev: 194e95f3f068456f30c0e971eb8e6e775279427c) Signed-off-by: Markus Lehtonen Signed-off-by: Ross Burton Signed-off-by: Richard Purdie

oe-build-perf-test: fix log file path

2016-09-06T09:24:04+00:00

The --log-file command line argument was slightly broken as {out_dir} string replacement was not working as expected. (From OE-Core rev: fc62f54e3d788cc79fd27664f05db7efccef23ab) Signed-off-by: Markus Lehtonen Signed-off-by: Richard Purdie

oe-build-perf-test: rename log file and implement --log-file

2016-09-03T08:58:41+00:00

Rename the (main) log file of the oe-build-perf-test script from 'output.log' to 'oe-build-perf-test.log'. Also, add a new command line option --log-file which makes it possible to use an alternative log file name/path, if needed. Note that the file name/path is relative to the output directory. (From OE-Core rev: 4909fae1a6d1d068b33252088b41b8d82d1a836c) Signed-off-by: Markus Lehtonen Signed-off-by: Richard Purdie

oe-build-perf-test: update globalres and git even if tests failed

2016-09-03T08:58:41+00:00

Write globalres log file and commit results to Git even if some tests failed. Now that tests do not depend on each other there should be no risk of bogus results caused by test failures. (From OE-Core rev: 8036975b268fe209476e230555006facd3cbda71) Signed-off-by: Markus Lehtonen Signed-off-by: Richard Purdie

oe-build-perf-test: add {git_commit_count} keyword for --commit-results-tag

2016-08-25T22:03:47+00:00

Makes it possible to create easily sortable tags. Also, the default tag format is updated to use the new keyword. (From OE-Core rev: e3161654d75dfc3b059c519205b38b26e3ffb215) Signed-off-by: Markus Lehtonen Signed-off-by: Ross Burton Signed-off-by: Richard Purdie