summaryrefslogtreecommitdiffstats
path: root/meta/lib/oeqa
Commit message (Collapse)AuthorAgeFilesLines
* Allow for simultaneous do_rootfs tasks with rpmuninative-1.3Stephano Cetola2016-08-121-1/+40
| | | | | | | | | | | | | | | | | | | | | | Give each rootfs its own RPM channel to use. This puts the RPM metadata in a private subdirectory of $WORKDIR, rather than living in DEPLOY_DIR where other tasks may race with it. This allows us to reduce the time that the rpm.lock is held to only the time needed to hardlink the RPMs, allowing the majority of the rootfs operation to run in parallel. Also, this fixes the smart tests by generating an index for all packages at the time of the test, rather than using the one provided by the rootfs process. Original credit for the enhancement should go to Steven Walter stevenrwalter@gmail.com. (From OE-Core rev: a92c196449c516fe51786d429078bbb1213bb029) Signed-off-by: Stephano Cetola <stephano.cetola@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa: start() add remaining args SimpleRemoteTarget and QemuTinyRunnerAníbal Limón2016-08-102-4/+4
| | | | | | | | | | | Now Runner's support extra_bootargs for the kernel so add extra_bootparams to the start() methods to avoid exception. (From OE-Core rev: 4c28c03a2322fbcb9a5c268b08eaeb71d940ee04) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/utils/httpserver.py: HTTPServer enable thread connection handlingAníbal Limón2016-08-101-1/+2
| | | | | | | | | | HTTPServer now supports multiple connections using Python threads. (From OE-Core rev: 1d45b7bd611b900bc00530144ec0634307b1314f) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/selftest: disable report-error class when builds are expected to failRoss Burton2016-08-102-2/+7
| | | | | | | | | | | | | Some invocations of bitbake are expected to fail, so we don't want to report the errors to errors.yoctoproject.org. Also rewrite the messages in test_invalid_patch so they reflect reality. [ YOCTO #10052 ] (From OE-Core rev: 51f74a0d1ce4de9d311becee8e7d7cc7cd703d45) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/utils/sshcontrol.py: Allows to copy symlinks to targetMariano Lopez2016-08-041-2/+7
| | | | | | | | | | | | | | Currently when copying a symlink to the target it will fail throwing an exception. This will recreate symlinks from the system performing the tests to the device under tests. [YOCTO #9932] (From OE-Core rev: 5705b7a55bc300e14c34b0530f4d49df101edd3c) Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/oetest.py: Allow to export packages using symlinksMariano Lopez2016-08-041-4/+13
| | | | | | | | | | | | | | | Currently packages that contains symlinks can't be extracted and exported. This allows to export extracted such packages. A nice side effect is improved readability. [YOCTO #9932] (From OE-Core rev: 0338f66c0d246c3b8d94ac68d60fbc4c314e500b) Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oetest.py: Remove check for __init__.pyMariano Lopez2016-08-041-2/+0
| | | | | | | | | | | | | | | | | | | | | | When using "auto" in TEST_SUITES there is a check for __init__.py in the <layer>/lib/oeqa/runtime/ directory in all the layers in BBLAYERS. This check was needed because the way that python 2 import the modules, now that bitbake uses python 3 there is no need these __init__.py files, moreover these files won't allow to import tests from other layers. This patch removes the check. [YOCTO #9996] (From OE-Core rev: f1cc272e4851fd994e9d052628a747ac19f90488) Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oetest.py: Add command line parameter support for tag in testexportMariano Lopez2016-08-042-4/+18
| | | | | | | | | | | | | This allows to use a command line argument to change the tag used to filter test instead of rebuilding the tests. [YOCTO #8532] (From OE-Core rev: 928e0eecdb126f7d0bacd05b7057fc825e0d8f05) Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/runtime-test.py: Add test for testexport SDK featureMariano Lopez2016-08-041-0/+41
| | | | | | | | | | | | | This adds test_testexport_sdk() to test the SDK feature of testexport in the CI in order to avoid breaking it. [YOCTO #9765] (From OE-Core rev: badec3d10fcdd2d000450ab533caadcff1df5e13) Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/utils/commands.py: Command class improve validations/decoding in outputAníbal Limón2016-08-011-1/+4
| | | | | | | | | | | | | | | When run a command sometimes the output isn't provided so validate before trying to encode to utf-8, also some output like BIOS/EFI contains characters that can't be codified into utf-8 for this reason set errors='replace'. [YOCTO #10019] (From OE-Core rev: f2a04faf3c5d0a3cc562061b22e1c4873e1ca769) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/syslog: test_syslog_logger Don't try to use logread when ↵Aníbal Limón2016-08-011-1/+1
| | | | | | | | | | | | | | | | systemd is enabled Busybox logread uses shmmem circular buffer to retrive [1] syslog messages when systemd is enabled this shmem circular buffer isn't enabled because systemd journald doesn't provide it. [1] https://git.busybox.net/busybox/tree/sysklogd/logread.c?id=accd9eeb719916da974584b33b1aeced5f3bb346#n121 (From OE-Core rev: f49e4847ba00cdd072e5f072cb9ca69ef98af758) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/syslog.py: Improve test_syslog_loggerAníbal Limón2016-08-011-2/+7
| | | | | | | | | | | | | | | | Instead of make all the testing in a shell one liner, divide the test into 3 operations to be able to know in what part is failing. Parts, - Log message to syslog - Review if message exist in /var/log/messages - Review if message exist using logread (From OE-Core rev: f3fe3590e887ee311f23723103eca41dcf58aa8b) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/runtime-test.py: Add test for import test from other layersMariano Lopez2016-08-011-0/+20
| | | | | | | | | | | | | | | | | | There are some features in testimage/testexport that are not tested; this might lead to break some of these features without notice. This adds a new test in order to test two features of testimage: - Import test from other layers. - Install/Unistall in the DUT without a package manager. [YOCTO #9764] [YOCTO #9766] (From OE-Core rev: cffab2257dacfa741c64611dfdf361f77aff9460) Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-selftest: recipetool: add tests for git URL manglingPaul Eggleton2016-08-011-0/+43
| | | | | | | | | | | | Add three tests to verify that the git URL mangling is working the way it's supposed to. This should prevent us regressing on this again in future. (From OE-Core rev: d8d01f462ddbb79cff23b544fcd0ce251f05f8ce) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/selftest/signing: check that we have GPG in setupRoss Burton2016-07-261-0/+4
| | | | | | | (From OE-Core rev: 6eb6fde2567a2692afccb7ee0546b2c992c168aa) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/selftest/signing: use a temporary directory for GPG homeRoss Burton2016-07-261-22/+10
| | | | | | | | | | | | | | Instead of using a directory in the layer as the GPG home and carefully deleting the right files from it, use tempfile to create a temporary directory which will be cleaned up for us. Also change the public/secret key variables to be absolute paths as they're always used as absolute paths. (From OE-Core rev: d4a5b5d11c6d7d5aba5f2eb88db091c1b98ef87c) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* lib/oeqa/decorators: handle broken links when creating new symlinkRoss Burton2016-07-261-1/+1
| | | | | | | | | | When checking if a link exists before creating it, use os.path.lexists() as otherwise os.path.exists() on a broken link will return False. (From OE-Core rev: ec24b6de2b8686e1f779fef3a963e66f70eeba74) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/controllers: Add test target for Systemd-bootJose Perez Carranza2016-07-211-0/+40
| | | | | | | | | | | | | | A new test target is neede to test Systemd-boot similar to gummiboot. Created a copy of GummibootTarget class and named as SystemdbootTarget, at this point the gummibootTarget will remain until documentation is updated with new systed information. (From OE-Core rev: d1fd3a7dbc363bdc02d810f796b3b810cb13f029) Signed-off-by: Jose Perez Carranza <jose.perez.carranza@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oetest.py: Fix problem when there is more than one json file for package ↵Mariano Lopez2016-07-211-4/+10
| | | | | | | | | | | | | | | extraction This allow to have more than one test to have json file in order to install packages in the DUT without using a package manager. [YOCTO #9926] (From OE-Core rev: 129c2b4589710aa24e23108f2728f1625b72cb06) Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* lib/oeqa/utils/commands.py: Move updateEnv() from runexported.pyMariano Lopez2016-07-212-14/+14
| | | | | | | | | | | updateEnv() can be used in other places so move the function to utils/commands.py (From OE-Core rev: 380e5d80898cac4ffc9715b3f597d0b62a0643ff) Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/recipetool: update recipe test to pass SHARoss Burton2016-07-201-1/+1
| | | | | | | (From OE-Core rev: 71dd4c05c41e8b363dc1ecac1f5105d316ee82dc) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/devtool: update recipe test as libmatchbox changedRoss Burton2016-07-201-1/+1
| | | | | | | (From OE-Core rev: b36712eef14c20007e0adb01cc7d4bce9e7926bb) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libxsettings-client: Remove as unneededJussi Kukkonen2016-07-201-2/+2
| | | | | | | | | | | xsettings-client is not meant to be a shared library and the only user in oe-core (libmatchbox) now has an in-tree copy. (From OE-Core rev: ed5cbf977dca8f3d85c8d933071c6e49fb4bd95f) Signed-off-by: Jussi Kukkonen <jussi.kukkonen@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* wic: oe-selftest: build bmap-tools-nativeEd Bartosh2016-07-201-1/+1
| | | | | | | | | | | | | | | | bmap-tools-native is required to generate .bmap file. Without it wic fails with this error when run with --bmap option: Error: A native program bmaptool required to build the image was not found Added bmap-tools-native to the list of requirements to build in Wic.setUpLocal method. (From OE-Core rev: dd11ab551f9bf1d8761d0430f19510a9caa53a12) Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* devtool: add finish subcommandPaul Eggleton2016-07-201-1/+156
| | | | | | | | | | | | | | | | | | | | | | | | | | Add a subcommand which will "finish" the work on a recipe. This is effectively the same as update-recipe followed by reset, except that the destination layer is required and it will do the right thing depending on the situation - if the recipe file itself is in the workspace (e.g. as a result of devtool add), the recipe file and any associated files will be moved to the destination layer; or if the destination layer is the one containing the original recipe, the recipe will be overwritten; otherwise a bbappend will be created to apply the changes. In all cases the layer path can be loosely specified - it could be a layer name, or a partial path into a recipe. In the case of upgrades, devtool finish will also take care of deleting the old recipe. This avoids the user having to figure out the correct actions when they're done - they just do "devtool finish recipename layername" and it saves their work and then removes the recipe from the workspace. Addresses [YOCTO #8594]. (From OE-Core rev: fa550fcb9333d59b28fc0e4aebde888831410f5c) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* utils/qemurunner.py: QemuRunner.start() add support for specify extra kernel ↵Aníbal Limón2016-07-202-4/+8
| | | | | | | | | | | | | | | cmdline Add ability to specify extra_bootargs (kernel cmdline) in order to enable systemd debug log in images that enables systemd init. [YOCTO #9299] (From OE-Core rev: 09d62551c289b5607341a4f9c46eecd6390ad774) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* remove sukokuRoss Burton2016-07-201-28/+0
| | | | Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/sdk: remove buildsudoku testRoss Burton2016-07-201-26/+0
| | | | | | | | | | This application needs GTK+ 2 which we're trying to move away from for Sato images. (From OE-Core rev: 5e52f208a17e7122209675fa96de6e7807c62feb) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* buildoptions.py: remove directfb image build testMaxin B. John2016-07-101-13/+0
| | | | | | | | | | removing this test since we move directfb out of oe-core (From OE-Core rev: 2d8fda36ecfa1945f22b7139a2febd12ec59272b) Signed-off-by: Maxin B. John <maxin.john@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-selftest: drop test_prepare_unexpectedPaul Eggleton2016-07-081-75/+0
| | | | | | | | | | | | | | This test refers to a function that no longer exists after the eSDK install double execution of bitbake has been removed, and since test_prepare_unexpected is the only test in this module, drop the entire module. We can easily resurrect it if we have unit tests to add in the future. (From OE-Core rev: 7e792a22e62904ed2dafb1ea214911235e3f3efc) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/selftest/bbtests: Fix failing test after progress changesRichard Purdie2016-07-081-1/+1
| | | | | | | | | The progress patches change the output slightly, update the test to deal with this. (From OE-Core rev: 90dbd838fa97c89ace5cb147aa5cff39b94178b1) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/systemd: fix typo in skipUnlessPassed decoratorRoss Burton2016-07-081-1/+1
| | | | | | (From OE-Core rev: f0420d8c934154a94957cabcfdc993f0eae92cd7) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* lib/oeqa: add Galculator to SDK and runtime testsRoss Burton2016-07-012-0/+47
| | | | | | | | | | | | This is a GTK+3 application, so we don't need to ship GTK+ 2 in Sato just for the SDK test suite. [ YOCTO #9780 ] (From OE-Core rev: 53fcfe4348a2ca727844f2b0bd3fca2902cbdda0) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/syslog: remove redundant skipUnlessPassedRoss Burton2016-07-011-1/+0
| | | | | | | | | | The test test_syslog_help doesn't exist, so skipping unless it passed just produced a warning. (From OE-Core rev: 9856fe02bf30cd9e834a7d324e357070f4d7735f) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/utils/commands: fix single-character variable matching in get_bb_vars()Ross Burton2016-07-011-2/+2
| | | | | | | (From OE-Core rev: 2f7e4d0636ce1647edf2d82c65b82be0eb2c1db1) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-build-perf-test: implement --globalres-file optionMarkus Lehtonen2016-07-011-0/+32
| | | | | | | | | | | | Using this option the script appends test results into a 'global results file'. A CSV-formatted output of the results. This option is to provide compatibility with the old build-perf-test.sh. (From OE-Core rev: e9f18e63220e452f2b0c878998e57d944ae83980) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add git revision and branch to result dataMarkus Lehtonen2016-07-011-0/+32
| | | | | | | | | | | | | | | BuildPerfTestRunner determines these from the Git repository under which it is being run (i.e. where the build directory exists). The branch and revision may be defined/overridden with OE_BUILDPERFTEST_GIT_BRANCH and OE_BUILDPERFTEST_GIT_BRANCH environment variables, if needed. This makes it possible to run the build performance test script even if the top directory is not a git repository clone, for example. (From OE-Core rev: e6004582454d8c6a18f617c12e6e408ded5be8df) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.utils: add git moduleMarkus Lehtonen2016-07-011-0/+38
| | | | | | | | | | | | | | A new helper module for easier interaction with Git repositories. Provides GitRepo class that represents one local Git repository clone. The GitRepo class currently only has one method, run_cmd(), for running arbitrary git commands in the repository. More specialized methods for commonly used git operations can be added later. (From OE-Core rev: 4eaf434f885afbda03fe67ab6e9ff291c7a9c77e) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: archive build/conf into test resultsMarkus Lehtonen2016-07-011-0/+8
| | | | | | | | | | Have the build/conf directory as part of test results. (From OE-Core rev: ea32a8a65f668450e0ec0e80483bd5e8c91b8a18) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test4Markus Lehtonen2016-07-011-0/+28
| | | | | | | | | | Re-implement "test4" from build-perf-test.sh which measures eSDK metrics. (From OE-Core rev: c449ca1b062426380a0572aed2da4ee4a83281f5) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test3Markus Lehtonen2016-07-011-0/+20
| | | | | | | | | | | Re-implement "test3" from build-perf-test.sh which measures bitbake parsing time. (From OE-Core rev: 388c7160b90247df9c78d8803083821402c13af5) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test2Markus Lehtonen2016-07-011-0/+14
| | | | | | | | | | | Re-implement "test2" from build-perf-test.sh which measures 'bitbake core-image-sato -c rootfs'. (From OE-Core rev: 8cb322d6a5be08f0bb2c9e5d3b73161b20d737a3) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test1P3Markus Lehtonen2016-07-011-0/+26
| | | | | | | | | | | Re-implement "test1_p3" from build-perf-test.sh which measures 'bitbake core-image-sato' with rm_work enabled. (From OE-Core rev: bfe48d343e8a281760da0b6744c08d47039f93e0) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test1P2Markus Lehtonen2016-07-011-0/+14
| | | | | | | | | | | Re-implement "test1_p2" from build-perf-test.sh which measures 'bitbake virtual/kernel'. (From OE-Core rev: 5ff82c6e2b0ff41a9bfdd49c99e84a982cf6e467) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add test Test1P1Markus Lehtonen2016-07-012-1/+33
| | | | | | | | | | | Re-implement "test1_p1" from build-perf-test.sh which measures 'bitbake core-image-sato'. (From OE-Core rev: 1ddd4a8ce4e2053def0e946d4e4b4b97bdc28e61) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: implement BuildPerfTestRunner classMarkus Lehtonen2016-07-012-1/+49
| | | | | | | | | | | | The new class is responsible for actually running the tests and processing their results. This commit also adds a decorator function for adding new tests. No automatic test discovery, at least yet. (From OE-Core rev: bf90aecb7e150d6bfac7240286c797b79d26528b) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add method for saving buildstatsMarkus Lehtonen2016-07-011-0/+5
| | | | | | | | (From OE-Core rev: 15b44a484ce408b0a1acfb907e2b12ebc6cce296) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add method for measuring file disk usageMarkus Lehtonen2016-07-011-0/+19
| | | | | | | | | | | Add a new method to BuildPerfTest class for measuring the disk usage of a file of directory. (From OE-Core rev: 85cdc240e75d481e93238fbf75f8b8431da05f19) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: add method to log shell commandsMarkus Lehtonen2016-07-011-0/+5
| | | | | | | | | | | Add new methods to BuildPerfTest class for running a shell command and logging its output. (From OE-Core rev: 8f0b11ba1266f9c650cf34d9b394d72009ee7207) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa.buildperf: method for measuring system resource usageMarkus Lehtonen2016-07-011-2/+62
| | | | | | | | | | | | | | | | | | | | | | Extend BuildPerfTest class with a new method for measuring the system resource usage of a shell command to BuildPerfTest class. For now, easurement of the elapsed time is done with the Gnu time utility, similarly to the build-perf-test.sh shell script. And, it currently only records the elapsed (wall clock). The measured values (currently, only the elapsed time) is actually a dictionary, making it possible to extend it with additional resource values, e.g. cpu time or i/o usage, in the future. In addition to the actual values of the measurement each record contains a 'name' and 'legend' where name is supposed to function as a common key or id over test runs, making comparison and trending easier, for example. Legend is supposed to be a short human readable description. (From OE-Core rev: ced156bfea4a6649d201f41275641a633f218322) Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
generated by cgit v1.2.3-54-g00ecf (git 2.39.0) at 2024-06-26 18:46:27 +0000