summaryrefslogtreecommitdiffstats
path: root/meta/lib/oeqa/runtime
Commit message (Collapse)AuthorAgeFilesLines
* oeqa/runtime: Fix setUp and tearDown methodsMariano Lopez2015-10-194-6/+6
| | | | | | | | | | | | | | | | | | | | Currently some of the runtime test overwrites the setUp and tearDown methods provided by oeRuntimeTest, this will avoid some checks required when running the test suit. This patch changes the setUp and tearDown methods for their local counterparts, so when these tests are called, it will run the parent setUp and tearDown and also the local ones. [YOCTO #8465] (From OE-Core rev: 13282223b07787a92c251f89251e8a49a0e4e3eb) Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* Revert "oeqa/runtime: Added one runtime testcase in connman."Cristian Iorga2015-10-011-23/+0
| | | | | | | | | | | | connman daemon forks during normal usage, so this test is no longer valid and generates sometimes false positives. This reverts commit 7d01c595c96eb3d67b90caf71050c4e9345257de. (From OE-Core rev: bc974be50d5eff4eed00078ad1d1976ee81c5ecc) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/sdk/gcc: Fix makefile testRichard Purdie2015-09-281-0/+5
| | | | | | | | | The makefile test was hardcoding a test for gcc. In the SDK context, we need to use $(CC) to use the cross compiler. (From OE-Core rev: d28ddc23bbf232901ae07f7a01f821ecc4b79e32) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Updated log parser whitelist.Lucian Musat2015-09-281-6/+4
| | | | | | | | | | | Added some fixes for meta-intel boards and moved some errors from specific images to common. (From OE-Core rev: ccbb12f9ec7c0a5714a8b1a24efb46755408c256) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/parselogs.py: Fix dmesg log retrieve in satoAníbal Limón2015-09-241-2/+1
| | | | | | | | | | | | Sato uses busybox that fails to write log using echo "" because dmesg output can contain special characters. [YOCTO #8377] (From OE-Core rev: 89107d0e01235b8cff70c0325723d2a99d2c336c) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/date: stop systemd-timesyncd during testRoss Burton2015-09-121-0/+8
| | | | | | | | | | | | | There's a race between systemd-timesyncd manipulating the system time (with NTP lookups) and the test case's time manipulation. Prevent this by stopping systemd-timesyncd for the duration of the test case. Thanks to Khem Raj for root-causing this. (From OE-Core rev: 5334f1b1e9363fa9c128289b51ade55c7ae1a0a3) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Updated log error whitelist.Cristina Agurida2015-09-091-0/+6
| | | | | | | | | | | [YOCTO #7898] [YOCTO #7761] [YOCTO #7804] (From OE-Core rev: fb3a5c732997eddee6dacb52558d4e6c8942f1e1) Signed-off-by: Cristina Agurida <cristina-danielax.agurida@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/multilib: add test for libcRoss Burton2015-08-301-1/+18
| | | | | | | | | | Add a basic test to verify that /lib/libc.so.6 and /lib32/libc.so.6 have the right ELF class. (From OE-Core rev: 51e9f90b3b61e34603bc02bf4cfcbd0243686798) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/multilib: fix and improve multilib testRoss Burton2015-08-291-3/+16
| | | | | | | | | | | | Replace the previous shell magic with a Python function to parse the readelf output, and fix the package names to include the lib32- prefix. [ YOCTO #8219 ] (From OE-Core rev: c51d24710b48eb3930edb8c661100705c6203e78) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* runtime/syslog.py: fix syslog test crashCostin Constantin2015-08-291-1/+1
| | | | | | | | | | | | This patch fixes the ability to correctly identify syslog's package name for the built image. It is derived from modifying oeqa/oetest.py for [YOCTO #8170] (From OE-Core rev: 74d02c942414a193a01367c0a32bf91a3329a8d4) Signed-off-by: Costin Constantin <costin.c.constantin@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/parselogs: don't use uname to get MACHINERoss Burton2015-07-251-2/+1
| | | | | | | | | | | Instead of running "uname -n" on the target (which actually returns the hostname) to get something approximating the hostname (or not, if that has been overriden), simply fetch MACHINE from the datastore. (From OE-Core rev: 17efc6b3284f165a9df14090dec57d877e0c36fa) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/parselogs: add more x86 log exceptionsRoss Burton2015-07-251-3/+4
| | | | | | | | | | | | | | Move "fail to add MMCONFIG..." to qemux86_common as we started to also see it on x86-64 with Linux 4.1. Add "can't claim BAR..." to qemux86_common. Generalise "Failed to access perfctr MSR" as the MSR number can change. (From OE-Core rev: 312417c182267584141d4ba62458bdd1d9d9ccb9) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/syslog: Removed a pointless testcase and added skip for another.Lucian Musat2015-07-231-7/+1
| | | | | | | | | | | | | The testcase syslog --help was rather useless and also causing problems on images where syslog was non-busybox, like LSB images so I removed it. Added a skip condition for TC 202 for the same reason. If syslog is non-busybox then the test skips. (From OE-Core rev: 3947ec61cdc2977db5ce6042863b31f99d47a12a) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: Added decorators for the remaining auto tests.Lucian Musat2015-07-237-3/+11
| | | | | | | | | | This helps for the automatic completion of the results in testopia. (From OE-Core rev: 9148e5873a79ea3ef64f00cf9807fae99bf3040a) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: Added a new automated rpm test.Daniel Istrate2015-07-231-0/+37
| | | | | | | | | | testcase 195: Check rpm install/removal log file size (From OE-Core rev: abf07439e59180a79518e8a2443930104e9e71d0) Signed-off-by: Daniel Istrate <daniel.alexandrux.istrate@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: Added one runtime testcase in connman.Daniel Istrate2015-07-231-0/+23
| | | | | | | | | | (testcase 223) Check that only one connmand runs in background. (From OE-Core rev: 904a3f2c772980b5dc65ef61a0aad23768fcb8dc) Signed-off-by: Daniel Istrate <daniel.alexandrux.istrate@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Whitelist qemumips64 runtime errorRichard Purdie2015-06-271-0/+3
| | | | | | | | | Similarly to qemumips, ignore these errors upon bootup so that we have a good QA baseline for new errors. (From OE-Core rev: 592a1d94a7b0e80059016adb59c4c61e256206f0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Whitelist qemuarm64 runtime errorsRichard Purdie2015-06-271-0/+4
| | | | | | | | | The qemuarm64 machine doesn't have graphics so whitelist the X server failures to start. (From OE-Core rev: 4e1b7773e480a05ac791fcceca23889ef9919aa7) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Fixed a problem in parselogsLucian Musat2015-06-271-2/+3
| | | | | | | | | | | | When the test passed it returned an error because grep did not return any error and the variable that held the results was being referenced but not assigned any value. (From OE-Core rev: 0f5c2fb975010cf6e8154384b764a2c9da1b371e) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* meta: Add explict getVar param for (non) expansionRichard Purdie2015-06-232-4/+4
| | | | | | | | | | | | | | Rather than just use d.getVar(X), use the more explict d.getVar(X, False) since at some point in the future, having the default of expansion would be nice. This is the first step towards that. This patch was mostly made using the command: sed -e 's:\(getVar([^,()]*\)\s*):\1, False):g' -i `grep -ril getVar *` (From OE-Core rev: ab7c1d239b122c8e549e8112c88fd46c9e2b061b) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Added some more errors to the whitelist.Lucian Musat2015-06-111-4/+25
| | | | | | | | (From OE-Core rev: 70f514719b1bac2a478bc05afd5382b3a26a419a) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: The logs are now copied and parsed locally.Lucian Musat2015-06-111-7/+23
| | | | | | | | | | This is to fix a problem with reaching the limit of the whitelist size. (From OE-Core rev: 7f49f098cff1848ab7bd25a6a232b09b4f0b4b03) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: Boot test for poky-tiny.Lucian Musat2015-04-101-0/+9
| | | | | | | | | Bug 6705. (From OE-Core rev: 4d3574e7fe5353b4dbbf5266a8b950b57542a743) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/smart: Added new decorators for existing automated tests.Lucian Musat2015-04-101-0/+4
| | | | | | | (From OE-Core rev: d307950f4938ea2f9d480d4f4cd184b76e33df0b) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/rpm: Added new decorators for existing automated tests.Lucian Musat2015-04-101-0/+1
| | | | | | | (From OE-Core rev: 7381c10f2260181eccd3abddf5d0289c969863cb) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/ping: Added new decorators for existing automated tests.Lucian Musat2015-04-101-0/+2
| | | | | | | (From OE-Core rev: 9ca0f5c7837ef42cf3b95ff4091ea6951b4e8021) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/parselogs: Added new decorators for existing automated tests.Lucian Musat2015-04-101-0/+1
| | | | | | | (From OE-Core rev: 8fb4bc7296d8da62ac2db3bf65d202a9c27d743f) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/ldd: Added new decorators for existing automated tests.Lucian Musat2015-04-101-0/+1
| | | | | | | (From OE-Core rev: 6385874553b8bd9302c1b77d0586edd821e999be) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime/systemd.py: skip instead of failing without avahiPatrick Ohly2015-04-101-0/+7
| | | | | | | | | | | | | | | | The SystemdServiceTests assume that avahi-daemon is installed, which is not necessarily the case depending on the image being tested. Better check this dependency before starting the tests and skip them if the service is not installed. This has to be done for each test instead of for the entire module, because other tests in the module can run without avavi. (From OE-Core rev: ca23337d517cfdb7119e5fd8bd9a9a663ae135de) Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: Added a new auto rpm testLucian Musat2015-03-221-0/+10
| | | | | | | | | The test tries to query the rpm list with a non-root user (From OE-Core rev: 9d5deedfdae28d0257e84e1980c2cb7fd4e38c45) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: Fixed a problem in logparser where it failed to whitelist some ↵Lucian Musat2015-03-201-4/+5
| | | | | | | | | | | | common errors. And some minor tweaks like moving some errors from qemu to common. (From OE-Core rev: c25474be02a562585ded66a6d538aee21056f628) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* lib/oeqa/runtime/systemd: Add a basic runtime test for the journalRandy Witt2015-03-161-0/+6
| | | | | | | | | | | | | | The test_systemd_journal() test will fail if journalctl exits with a non-zero exit status. The exit status is non-zero even if there are no journal files, which is what drove the creation of this test. [Yocto #7388] (From OE-Core rev: 27baa182d44872f84bee3da36b95997ce0597d89) Signed-off-by: Randy Witt <randy.e.witt@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Skip hda opcode errorsRichard Purdie2015-03-121-1/+2
| | | | | | | | | | | | | | | These occur when running images under virtualisation on machines with high load which sometimes trigger timeouts in the kernel DMA code. They're harmless to ignore in these cases. Adding this since "failing" the build due to this is more annoying thank useful. [YOCTO #7387] (From OE-Core rev: fb29441216435b9bae47ca9cd42db5a6b1fe77d8) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Add exception for new mips error messageRichard Purdie2015-02-211-0/+1
| | | | | | | | The 3.19 kernel introduces this error, ignore it for now. (From OE-Core rev: 2a0a14275ca00b2d3ca867c82548a41e3bb10986) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/ptest: Fixed complementary package install detection and added ↵Lucian Musat2015-02-191-3/+6
| | | | | | | | | ptest-runner exit code check (From OE-Core rev: b214c7b901fe0fad081d7a97f9e91cc218c66bd6) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/ptest: Removed buildhistory as requirement for ptestLucian Musat2015-02-151-5/+3
| | | | | | | | (From OE-Core rev: 990c0048fc7fe363b679943fe0ed0434645711d9) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/smart: Added some new test casesLucian Musat2015-02-151-0/+48
| | | | | | | | (From OE-Core rev: 945cdab87ed247524059183e1376923a8655069c) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-pkgdata-util: improve command-line usagePaul Eggleton2015-02-141-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | * Use argparse instead of optparse for standardised help output, options and a much cleaner code structure * Look up pkgdata directory automatically so the user doesn't have to specify it * Use standard logging NOTE: this does mean a slight change in syntax - if you do want to specify the pkgdata directory (usually only necessary if you're calling it from within the build process) you need to use the parameter -p (or --pkgdata-dir) and specify this before the command, not after it. Examples: oe-pkgdata-util find-path /sbin/mke2fs oe-pkgdata-util lookup-recipe libelf1 oe-pkgdata-util read-value PKGSIZE libc6 oe-pkgdata-util -p /home/user/oe/build/tmp/sysroots/qemux86-64/pkgdata read-value PKGSIZE libc6 (From OE-Core rev: 04dc571ac7c26f0dcf1a1fcd466482e22519998d) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Added a check in case the folder location does not contain ↵Lucian Musat2015-01-081-3/+4
| | | | | | | | | any log files (From OE-Core rev: affa3a126ba214f4d9b9a770e51323a6a5863bf2) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Add harmless failure warning introduced by new qemu version ↵Richard Purdie2014-12-311-0/+1
| | | | | | | | on qemuppc (From OE-Core rev: d9f49e0e6b377c402e01de631edca73bb6537ab9) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: Added some new filters for the log parser Including custom ↵Lucian Musat2014-11-251-7/+29
| | | | | | | | | | filters for edgerouter, minnow and jasperforest. (From OE-Core rev: 20310e68a2930dd1ddc6d0d9fc577fffa5a2777f) Signed-off-by: Lucian Musat <george.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/dmesg: Whitelist usbhid failuresRichard Purdie2014-10-021-1/+1
| | | | | | | | | We fixed these in parselog but not here. This test really can just be deleted now really. (From OE-Core rev: c598dbdbaebf95cc26e95138b4c3fcb15af67a88) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/parselogs: Ignore qemu usbhid errorsRichard Purdie2014-10-021-1/+3
| | | | | | | | These are harmless from the USB pointer device we install, ignore them. (From OE-Core rev: f5bdf41e78ff378fe23d8ba1543917bc64def62f) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: Automatic test for ptestLucian Musat2014-09-101-0/+124
| | | | | | | | | | | For images without ptest the packages are automatically installed alongside ptest-runner. Log results are saved in ./results folder. No cleanup is done for packages after the test is finished. (From OE-Core rev: f8e99fa8baa020c6414da19428b73c1fd30c9523) Signed-off-by: Lucian Musat <georgex.l.musat@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa: xorg log test is being replaced by parselogs so removeRichard Purdie2014-08-291-5/+0
| | | | | | | | Now we have the parselogs test, this one can be removed. (From OE-Core rev: 7977a3c28677d9a248059b0be230f345227e798a) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/pasrselogs: Improve the machine/string whitelistRichard Purdie2014-08-291-8/+56
| | | | | | | | | | | | | | Currently the whitelist is imcomplete, inaccurate and suffers duplication. These changes: * Add common groups of errors * Change to make the default whitelist clear * Correctly (or at least better) escape the regexp expressions * Add in missing machines to allow builds on the autobuilder to suceed (From OE-Core rev: 620aa5f9022335a9166b4d47bdcdce611ff5466a) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: Automatic test for parsing the logs on a machine and search ↵Lucian Musat2014-08-291-0/+128
| | | | | | | | | | | | | | | for certain error keywords. This adds a common new qa test for general processing of log files. One significant improvement is machine dependent ignore filters. This can be used to replace several weaker individual QA tests that are currently used. (From OE-Core rev: a14d076a401397b6773d5d1b99e49126261f1eb4) Signed-off-by: Lucian Musat <georgex.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runtime: add new cpp test and fileCorneliu Stoicescu2014-08-112-0/+10
| | | | | | | | | | This tests out the limits header which we've noticed does have problems in some SDK builds. (From OE-Core rev: 63cbed337241191f33fe951662a39ce59dce6774) Signed-off-by: Corneliu Stoicescu <corneliux.stoicescu@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* lib/oeqa: Fix accidental revert of codeRichard Purdie2014-07-251-3/+3
| | | | | | (From OE-Core rev: 188545ba82119d75f80dde322a73712ce1f0f762) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/rutime: Added testcase decorators for automated runtime tests. Also ↵Lucian Musat2014-07-2526-2/+46
| | | | | | | | | added LogResults decorator for oeTest class in oetest.py (From OE-Core rev: 95b83084487d0712362ade8ac487999c3274bb96) Signed-off-by: Lucian Musat <georgex.l.musat@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
generated by cgit v1.2.3-54-g00ecf (git 2.39.0) at 2024-06-25 05:01:45 +0000