summaryrefslogtreecommitdiffstats
path: root/meta/lib/oeqa/buildperf
Commit message (Collapse)AuthorAgeFilesLines
* oe-build-perf-test: implement --globalres-file optionMarkus Lehtonen2016-07-011-0/+32
| | | | | | | | | | | | Using this option the script appends test results into a 'global results file'. A CSV-formatted output of the results. This option is to provide compatibility with the old build-perf-test.sh. (From OE-Core rev: e9f18e63220e452f2b0c878998e57d944ae83980) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add git revision and branch to result dataMarkus Lehtonen2016-07-011-0/+32
| | | | | | | | | | | | | | | BuildPerfTestRunner determines these from the Git repository under which it is being run (i.e. where the build directory exists). The branch and revision may be defined/overridden with OE_BUILDPERFTEST_GIT_BRANCH and OE_BUILDPERFTEST_GIT_BRANCH environment variables, if needed. This makes it possible to run the build performance test script even if the top directory is not a git repository clone, for example. (From OE-Core rev: e6004582454d8c6a18f617c12e6e408ded5be8df) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: archive build/conf into test resultsMarkus Lehtonen2016-07-011-0/+8
| | | | | | | | | | Have the build/conf directory as part of test results. (From OE-Core rev: ea32a8a65f668450e0ec0e80483bd5e8c91b8a18) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test4Markus Lehtonen2016-07-011-0/+28
| | | | | | | | | | Re-implement "test4" from build-perf-test.sh which measures eSDK metrics. (From OE-Core rev: c449ca1b062426380a0572aed2da4ee4a83281f5) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test3Markus Lehtonen2016-07-011-0/+20
| | | | | | | | | | | Re-implement "test3" from build-perf-test.sh which measures bitbake parsing time. (From OE-Core rev: 388c7160b90247df9c78d8803083821402c13af5) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test2Markus Lehtonen2016-07-011-0/+14
| | | | | | | | | | | Re-implement "test2" from build-perf-test.sh which measures 'bitbake core-image-sato -c rootfs'. (From OE-Core rev: 8cb322d6a5be08f0bb2c9e5d3b73161b20d737a3) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test1P3Markus Lehtonen2016-07-011-0/+26
| | | | | | | | | | | Re-implement "test1_p3" from build-perf-test.sh which measures 'bitbake core-image-sato' with rm_work enabled. (From OE-Core rev: bfe48d343e8a281760da0b6744c08d47039f93e0) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test1P2Markus Lehtonen2016-07-011-0/+14
| | | | | | | | | | | Re-implement "test1_p2" from build-perf-test.sh which measures 'bitbake virtual/kernel'. (From OE-Core rev: 5ff82c6e2b0ff41a9bfdd49c99e84a982cf6e467) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test1P1Markus Lehtonen2016-07-012-1/+33
| | | | | | | | | | | Re-implement "test1_p1" from build-perf-test.sh which measures 'bitbake core-image-sato'. (From OE-Core rev: 1ddd4a8ce4e2053def0e946d4e4b4b97bdc28e61) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: implement BuildPerfTestRunner classMarkus Lehtonen2016-07-012-1/+49
| | | | | | | | | | | | The new class is responsible for actually running the tests and processing their results. This commit also adds a decorator function for adding new tests. No automatic test discovery, at least yet. (From OE-Core rev: bf90aecb7e150d6bfac7240286c797b79d26528b) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add method for saving buildstatsMarkus Lehtonen2016-07-011-0/+5
| | | | | | | | (From OE-Core rev: 15b44a484ce408b0a1acfb907e2b12ebc6cce296) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add method for measuring file disk usageMarkus Lehtonen2016-07-011-0/+19
| | | | | | | | | | | Add a new method to BuildPerfTest class for measuring the disk usage of a file of directory. (From OE-Core rev: 85cdc240e75d481e93238fbf75f8b8431da05f19) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add method to log shell commandsMarkus Lehtonen2016-07-011-0/+5
| | | | | | | | | | | Add new methods to BuildPerfTest class for running a shell command and logging its output. (From OE-Core rev: 8f0b11ba1266f9c650cf34d9b394d72009ee7207) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: method for measuring system resource usageMarkus Lehtonen2016-07-011-2/+62
| | | | | | | | | | | | | | | | | | | | | | Extend BuildPerfTest class with a new method for measuring the system resource usage of a shell command to BuildPerfTest class. For now, easurement of the elapsed time is done with the Gnu time utility, similarly to the build-perf-test.sh shell script. And, it currently only records the elapsed (wall clock). The measured values (currently, only the elapsed time) is actually a dictionary, making it possible to extend it with additional resource values, e.g. cpu time or i/o usage, in the future. In addition to the actual values of the measurement each record contains a 'name' and 'legend' where name is supposed to function as a common key or id over test runs, making comparison and trending easier, for example. Legend is supposed to be a short human readable description. (From OE-Core rev: ced156bfea4a6649d201f41275641a633f218322) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add BuildPerfTest classMarkus Lehtonen2016-07-012-2/+78
| | | | | | | | | | | | | The new class will be used as an abstract base class for build performance tests. This implementation contains some common functionality used in multiple tests, "copied" from the build-perf-test.sh shell script. (From OE-Core rev: 35cd7363759a286e80ddca0d028db3d2bf524b17) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: functionality to drop kernel cachesMarkus Lehtonen2016-07-012-0/+47
| | | | | | | | | | | | | | | | | | Add a new utility class for dropping Linux kernel caches. It uses sudo and tee to write to the drop_caches file. Checking if the user has the permissions to drop caches (without a password) is done by trying to writing an invalid value to the drop_caches file. This way, we will find if writing (with tee) is possible but not really dropping caches, yet. User can avoid giving the password by adding something like: <user> ALL = NOPASSWD: /usr/bin/tee /proc/sys/vm/drop_caches to the system sudoers file. (From OE-Core rev: c9cb248429ced50c96d11ba5361c272d4c9b9323) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-build-perf-test: introduce oeqa.buildperf moduleMarkus Lehtonen2016-07-011-0/+12
Wireframe of a new Python module for containing build performance tests and utility functions. (From OE-Core rev: b44af9051a9da8d2cddc7b071a896331967f15cc) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>