summaryrefslogtreecommitdiffstats
path: root/meta/lib/oeqa/buildperf
Commit message (Collapse)AuthorAgeFilesLines
* oeqa.buildperf: measure apparent size instead of real disk usageMarkus Lehtonen2016-10-062-4/+11
| | | | | | | | | | | This change aligns disk usage measurements of the eSDK test with the old build-perf-test.sh script. And thus, also makes the results between the old and the new script comparable. (From OE-Core rev: dadb84936b3672dcf07e5ab8226158136762801f) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: another fix for splitting 'nevr' stringMarkus Lehtonen2016-09-141-0/+5
| | | | | | | | | | | | | | | | When processing buildstats we determine recipe name, epoch, version and revision from the per-recipe buildstat directory name. One previous patch made an assumption that package version starts with a number. That might not be true because of a packaging mistake or whatever reason. Thus, if a version starting with a number is not found, fall back to the "old" method of just taking the second-last dash-delimited part (the one before revision). (From OE-Core rev: 936eb9aac055f1d4f41bb351477a0f5bebf76a0e) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: be sure to use the latest buildstatsMarkus Lehtonen2016-09-081-1/+1
| | | | | | | | | | Be sure to take the latest buildstats if multiple buildstats are found. (From OE-Core rev: bad495f0d0144728a0132c3d3c4d98c24ead4afd) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: try harder when splitting 'nevr' stringMarkus Lehtonen2016-09-081-2/+4
| | | | | | | | | | | | | | Try to be more intelligent when splitting out recipe name, epoch, version and revision from the buildstat directory name. Previous assumption was that package versions never contain a dash but obviously that is not necessarily true. The new assumption is that the package version starts with a number. (From OE-Core rev: 91d3fce1eb3e27d646afba8cf3c03ae560412d1d) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: correct globalres time formatMarkus Lehtonen2016-09-061-1/+1
| | | | | | | | | | Always use two digits for (integer part of) seconds, i.e. show '1:02.34' instead of '1:2.34'. (From OE-Core rev: 55bb6816aca39bfa25d4f7e2158a57a5f0ac1cca) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: include commands log file name in results.jsonMarkus Lehtonen2016-09-031-5/+9
| | | | | | | (From OE-Core rev: b22a71cf3a53a33763ff02608119d2c73cbde006) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: include buildstats file name in results.jsonMarkus Lehtonen2016-09-032-8/+17
| | | | | | | | | No need to do lsdir magic for finding buildstats when reading results. (From OE-Core rev: 4502f0979bf2e8698bb196345b89b170641fd43f) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: show skipped tests in results, tooMarkus Lehtonen2016-09-031-1/+2
| | | | | | | (From OE-Core rev: 4112779f9f314148b475fc4b8e33146de8be6b27) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: convert buildstats into json formatMarkus Lehtonen2016-09-031-3/+66
| | | | | | | | | | | | Instead of archiving buildstats in raw text file format convert all buildstats into one json-formatted file. Some redundant information, i.e. 'Event:', 'utime:', 'stime:', 'cutime:' and 'cstime:' fields, are dropped. (From OE-Core rev: efcf74b194f2a40eb3e6359dd41386db3eb25287) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: measure io statMarkus Lehtonen2016-09-031-2/+9
| | | | | | | | | Add data from /proc/<pid>/io to system resource measurements. (From OE-Core rev: e69a46a77854fac1169a09e0c5b70fa4b972255a) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: don't use Gnu timeMarkus Lehtonen2016-09-031-33/+39
| | | | | | | | | | | | | Use Python standard library functionality instead of the time utility for measuring elapsed (wall clock) time of commands. The time.* log files are also ditched. However, the same detailed resource usage data, previously found in time.* logs is now provided in results.json file. This data is collected through the resource module of Python. (From OE-Core rev: d5ad818dd501b18379aa3540bffa9b920d7c3bab) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: rename buildstats directoriesMarkus Lehtonen2016-09-031-2/+3
| | | | | | | | | | | | Change directory name from 'buildstats-<test_name>' to just 'buildstats'. However, this patch adds the possibility to label buildstats directory name with a postfix which makes it possible to save multiple buildstats per test, for example. (From OE-Core rev: 8997556040b2e7bfcfa6a75d4d97eb2e32207217) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: separate output dir for each testMarkus Lehtonen2016-09-031-1/+2
| | | | | | | | | | Store the output data of each test in an individual subdirectory instead of storing everything in the root output directory. (From OE-Core rev: 64ff34df96aa9a74dd4303f76ec711aa5e9d5030) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: strip date from buildstats directory pathMarkus Lehtonen2016-09-031-1/+5
| | | | | | | | | | Archive buildstats in a directory like 'buildstats' instead of something like 'buildstats/20160513120000'. (From OE-Core rev: 95138cdc70bb7f9b7ab74e1d83305f009790dccc) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: enable json-formatted resultsMarkus Lehtonen2016-09-031-0/+40
| | | | | | | | | | Automatically create a json.formatted file (results.json) in the results directory that contains results from all tests. (From OE-Core rev: 6df3263531a41805b2280bb999cb4a73f9f91eae) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add 'product' to test result dataMarkus Lehtonen2016-09-031-0/+1
| | | | | | | | | | This defaults to 'oe-core' but can be defined using the OE_BUILDPERF_PRODUCT environment variable. (From OE-Core rev: a22cc3e04001be5d11bd85dbdceb7088cae7c735) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: treat failed measurements as errorsMarkus Lehtonen2016-09-031-23/+13
| | | | | | | | | | | Now failed measurements correctly cause a test failure (recorded as an error). There should be no need to continue the test if one step fails, especially now that the tests don't depend on each other. (From OE-Core rev: 446e32aadc775ca146d12173b1463f524d7fe6ef) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: make tests independentMarkus Lehtonen2016-09-032-3/+14
| | | | | | | | | | | | | | | | | Add test set-up functionality so that the individual tests do not depend on each other. This should make sure that a failure in one test does not affect the results of another test. The patch also makes it reasonable to run only a subset of the tests by using the --run-tests option. The increase in total execution time of the full suite - caused by the additional set-up steps - is insignificant because normally no additional tasks need to be run. The previous test has already done all set-up work. (From OE-Core rev: 69b3c63e32d09ea4a41b21daacdff6bf1fc447c1) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: fix checking of invalid resultsMarkus Lehtonen2016-09-031-1/+1
| | | | | | | | | The test status check done when writing globalres log was incorrect. (From OE-Core rev: 3efbd49fd80d2b349a8fd44dbcd509168dbc1061) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-build-perf-test: add {git_commit_count} keyword for --commit-results-tagMarkus Lehtonen2016-08-251-0/+1
| | | | | | | | | | | Makes it possible to create easily sortable tags. Also, the default tag format is updated to use the new keyword. (From OE-Core rev: e3161654d75dfc3b059c519205b38b26e3ffb215) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add git commit count to result dataMarkus Lehtonen2016-08-251-7/+11
| | | | | | | | | | | This number represents the number of commits since the beginning of git history until the tested revision. This helps e.g. in ordering results. (From OE-Core rev: b52070dd057ff5b410cd193f9be2f25bc4c506cc) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-build-perf-test: new {tag_num} keyword for --commit-results-tagMarkus Lehtonen2016-08-251-4/+15
| | | | | | | | | | | | | | | | | | | | | | This makes it possible to create numbered tags, where the "basename" of the tag is the same and the only difference is an (automatically) increasing index number. This is useful if you do multiple test runs on the same commit. For example, using: --commit-results-tag {tester_host}/{git_commit}/{tag_num} would give you tags something like: myhost/decb3119dffd3fd38b800bebc1e510f9217a152e/0 myhost/decb3119dffd3fd38b800bebc1e510f9217a152e/1 ... The default tag format is updated to use this new keyword in order to prevent unintentional tag name clashes. (From OE-Core rev: cf2aba16338a147f81802f48d2e24a96c7133548) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-build-perf-test: tag results committed to GitMarkus Lehtonen2016-08-251-1/+10
| | | | | | | | | | | | | | | | | | | | Create a Git tag when committing results to a Git repository. This patch also implements --commit-results-tag command line option for controlling the tag name. The value is a format string where the following fields may be used: - {git_branch} - target branch being tested - {git_commit} - target commit being tested - {tester_host} - hostname of the tester machine Tagging can be disabled by giving an empty string to --commit-results-tag. The option has no effect if --commit-results is not defined. (From OE-Core rev: 60059ff5b81d6ba9ba344161d51d1290559ac2df) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-build-perf-test: implement --commit-results-branchMarkus Lehtonen2016-08-251-0/+5
| | | | | | | | | | | | | | | | A new command line option for defining the branch where results are commited. The value is actually a format string accepting two field names: - {git_branch} expands to the name of the target branch being tested - {tester_host} expands to the hostname of the tester machine The option has no effect if --commit-results is not used. (From OE-Core rev: b54b63395ec632748a57a702812c8a9a07af35ab) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-build-perf-test: support committing results data to GitMarkus Lehtonen2016-08-251-0/+35
| | | | | | | | | | | | Implement a new command line option '--commit-results' which commits the test results data into a Git repository. The given path must be an existing initialized local Git repository. (From OE-Core rev: b6f635513ca971402e7a970acc2168fb5d4a9476) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: use term commit instead of revisionMarkus Lehtonen2016-08-251-15/+15
| | | | | | | | | | | | This is basically a internal change, at this point. Term 'commit' better represents the data we actually have. Term 'revision' is more vague and could be understood to point to a tag object, for example. (From OE-Core rev: f49cf7959b8aaa52b79b22a5884c6aa580a50302) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.utils.git: implement GitRepo.get_current_branch()Markus Lehtonen2016-08-251-5/+2
| | | | | | | | (From OE-Core rev: dcba2302adab47b398f1ce7d09c38828ea9ae426) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.utils.git: introduce GitRepo.rev_parse()Markus Lehtonen2016-08-251-1/+1
| | | | | | | | (From OE-Core rev: 55726e931536ed0cbd7b80588060b05a3145c934) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: fix crash when creating globalres.logMarkus Lehtonen2016-08-201-1/+1
| | | | | | | | | Fix a bug that was introduced when converting to unittest framework. (From OE-Core rev: 3bdb7b2e512b2f160360e95ed5b2be3871ec0b4b) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: use oe.path.remove()Markus Lehtonen2016-08-172-13/+7
| | | | | | | | | | Drop the self-baked force_rm() method. (From OE-Core rev: c86bf80abd87acb0da5860806822c64ec9dee089) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: be more verbose about failed commandsMarkus Lehtonen2016-08-171-3/+9
| | | | | | | | | | Log failures of commands whose output is stored. (From OE-Core rev: 240f6e7366c8a9ea830e531d307dd2e27a61a6bd) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: introduce runCmd2()Markus Lehtonen2016-08-172-6/+12
| | | | | | | | | | | | | | Special runCmd() for build perf tests which doesn't raise an AssertionError when the command fails. This causes command failures to be detected as test errors instead of test failures. This way "failed" state of tests is reserved for future making it possible to set e.g. thresholds for certain measurement results. (From OE-Core rev: 09590ac76a19ee1b1b4a9188f7fce5029f0de52a) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: convert test cases to unittestMarkus Lehtonen2016-08-171-31/+19
| | | | | | | | | | | This commit converts the actual tests to be compatible with the new Python unittest based framework. (From OE-Core rev: 4e81967131863df7ee6c8356cb41be51f1b8c260) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add BuildPerfTestResult classMarkus Lehtonen2016-08-172-74/+80
| | | | | | | | | | | | | The new class is derived from unittest.TextTestResult class. It is actually implemented by modifying the old BuildPerfTestRunner class which, in turn, is replaced by a totally new simple implementation derived from unittest.TestRunner. (From OE-Core rev: 89eb37ef1ef8d5deb87fd55c9ea7b2cfa2681b07) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add BuildPerfTestLoader classMarkus Lehtonen2016-08-172-0/+6
| | | | | | | | (From OE-Core rev: b281c4a49b0df1de9b3137efb8ff50744e06c48d) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: derive BuildPerfTestCase class from unitest.TestCaseMarkus Lehtonen2016-08-172-38/+33
| | | | | | | | | | | | | Rename BuildPerfTest to BuildPerfTestCase and convert it to be derived from TestCase class from the unittest framework of the Python standard library. This doesn't work with our existing testcases or test runner class and these need to be modified, too. (From OE-Core rev: b0b434210a3dbd576f68344e29b8c20d18561099) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: rename module containing basic testsMarkus Lehtonen2016-08-172-1/+1
| | | | | | | | (From OE-Core rev: 56e455cf4b42ff4db36debd342bcb03c5199ba52) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* buildperf: Add support for times without decimal partJose Perez Carranza2016-08-171-1/+5
| | | | | | | | | | | Add logic for the cases when the time retrieved does not have decimal part. (From OE-Core rev: a6c9e515f8bc590612e3082ab1c4c254711c8e3b) Signed-off-by: Jose Perez Carranza <jose.perez.carranza@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-build-perf-test: implement --globalres-file optionMarkus Lehtonen2016-07-011-0/+32
| | | | | | | | | | | | Using this option the script appends test results into a 'global results file'. A CSV-formatted output of the results. This option is to provide compatibility with the old build-perf-test.sh. (From OE-Core rev: e9f18e63220e452f2b0c878998e57d944ae83980) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add git revision and branch to result dataMarkus Lehtonen2016-07-011-0/+32
| | | | | | | | | | | | | | | BuildPerfTestRunner determines these from the Git repository under which it is being run (i.e. where the build directory exists). The branch and revision may be defined/overridden with OE_BUILDPERFTEST_GIT_BRANCH and OE_BUILDPERFTEST_GIT_BRANCH environment variables, if needed. This makes it possible to run the build performance test script even if the top directory is not a git repository clone, for example. (From OE-Core rev: e6004582454d8c6a18f617c12e6e408ded5be8df) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: archive build/conf into test resultsMarkus Lehtonen2016-07-011-0/+8
| | | | | | | | | | Have the build/conf directory as part of test results. (From OE-Core rev: ea32a8a65f668450e0ec0e80483bd5e8c91b8a18) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test4Markus Lehtonen2016-07-011-0/+28
| | | | | | | | | | Re-implement "test4" from build-perf-test.sh which measures eSDK metrics. (From OE-Core rev: c449ca1b062426380a0572aed2da4ee4a83281f5) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test3Markus Lehtonen2016-07-011-0/+20
| | | | | | | | | | | Re-implement "test3" from build-perf-test.sh which measures bitbake parsing time. (From OE-Core rev: 388c7160b90247df9c78d8803083821402c13af5) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test2Markus Lehtonen2016-07-011-0/+14
| | | | | | | | | | | Re-implement "test2" from build-perf-test.sh which measures 'bitbake core-image-sato -c rootfs'. (From OE-Core rev: 8cb322d6a5be08f0bb2c9e5d3b73161b20d737a3) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test1P3Markus Lehtonen2016-07-011-0/+26
| | | | | | | | | | | Re-implement "test1_p3" from build-perf-test.sh which measures 'bitbake core-image-sato' with rm_work enabled. (From OE-Core rev: bfe48d343e8a281760da0b6744c08d47039f93e0) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test1P2Markus Lehtonen2016-07-011-0/+14
| | | | | | | | | | | Re-implement "test1_p2" from build-perf-test.sh which measures 'bitbake virtual/kernel'. (From OE-Core rev: 5ff82c6e2b0ff41a9bfdd49c99e84a982cf6e467) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test1P1Markus Lehtonen2016-07-012-1/+33
| | | | | | | | | | | Re-implement "test1_p1" from build-perf-test.sh which measures 'bitbake core-image-sato'. (From OE-Core rev: 1ddd4a8ce4e2053def0e946d4e4b4b97bdc28e61) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: implement BuildPerfTestRunner classMarkus Lehtonen2016-07-012-1/+49
| | | | | | | | | | | | The new class is responsible for actually running the tests and processing their results. This commit also adds a decorator function for adding new tests. No automatic test discovery, at least yet. (From OE-Core rev: bf90aecb7e150d6bfac7240286c797b79d26528b) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add method for saving buildstatsMarkus Lehtonen2016-07-011-0/+5
| | | | | | | | (From OE-Core rev: 15b44a484ce408b0a1acfb907e2b12ebc6cce296) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add method for measuring file disk usageMarkus Lehtonen2016-07-011-0/+19
| | | | | | | | | | | Add a new method to BuildPerfTest class for measuring the disk usage of a file of directory. (From OE-Core rev: 85cdc240e75d481e93238fbf75f8b8431da05f19) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
generated by cgit v1.2.3-54-g00ecf (git 2.39.0) at 2024-11-13 19:52:00 +0000