summaryrefslogtreecommitdiffstats
path: root/meta/lib/oeqa
Commit message (Collapse)AuthorAgeFilesLines
* python3-cython: Remove build paths from debug sourcesRichard Purdie2021-03-021-1/+0
| | | | | | | | | | | | There are build paths which are in generated sources injected into ${PN}-src. These are in generated files and don't influence the binary output. As such we can correct them at do_package time by tweaking in an appropriately injected function. This fixes the reproducbility of the recipe. (From OE-Core rev: cc1de818247c9ae329fdc0536658b3968a4caea2) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* ltp: Fixing determinism issuesRichard Purdie2021-03-021-1/+0
| | | | | | | | | | | | | | Add a patch adding sorting to a couple of points in the Makefiles which removes most of the determinism issues in ltp. Build swapon before the main build to ensure libswapon.o is built deterministically as it races with swapoff. All issues reported on the upstream mailing list. (From OE-Core rev: 0f51f9a37e5d058bce28cfe7b9a32a895f83c091) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* Add core-image-weston to reproducible build testsJan-Simon Moeller2021-03-021-1/+1
| | | | | | | | | | | | | This change adds core-image-weston to the reproducible build test. For this we also need to update the static-group and static-passwd. Besides the world package build which includes the wayland package, this adds a wayland/weston-based image to the reproducible build test. (From OE-Core rev: ffc4de47988ccf7568eecc8a27e8964beeaaacfb) Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* lttng: Fix reproducibility issuesRichard Purdie2021-03-021-2/+0
| | | | | | | | | | | Add a hack to hardcode in specific rpaths which we then remove, allowing the build to be reproducible. Strip build patches out of one of the test scripts too. (From OE-Core rev: 18299a114c66280ba2d00becc3fae235d3a6cbd7) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* qemu: Determinism fixesRichard Purdie2021-03-021-1/+0
| | | | | | | | | | | | Add a patch to address two determinism issues and allow reproducible builds. Also strip full paths we don't need out of some ptest files, we can use the installed binaries. (From OE-Core rev: 14e7cc6c6040b983024bec56fbd32d9101507ff0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* pinentry: update 1.1.0 -> 1.1.1Alexander Kanavin2021-03-021-1/+1
| | | | | | | | | Refresh xxx-config->pkg-config patches. (From OE-Core rev: 0995cd6083a42469aa2913c4d696b0b46e336854) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/reproducible: Add ability to pull some objects from sstateRichard Purdie2021-03-021-2/+14
| | | | | | | | | | | | | | | | | | | | When debugging why a single recipe doesn't reproduce, its a pain to wait for the world to rebuild from scratch. Update the selftest to allow this to be configured, for example you could set targets as ['perf'] and sstate_targets as ['virtual/kernel'] and then it should only be rebuilding perf in the test rather than things like the toolchain (parts of the kernel may be unavoiable as they're not in sstate). Can be run as: OEQA_DEBUGGING_SAVED_OUTPUT=/tmp/perf-diffoscope oe-selftest -r reproducible.ReproducibleTests.test_reproducible_builds to save diffoscope output. (From OE-Core rev: 132a17d02f29711572e14a2f38a841323fbb6df6) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* systemd-bootchart: Disable LTO to fix reproducibilityRichard Purdie2021-03-011-2/+1
| | | | | | | | | LTO likely doesn't buy us much here, disable it to allow the binaries to be reproducible. (From OE-Core rev: b4b5e52b5bd98deb0855700e4aae6228d52e5a83) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* efivar: Fix reproducibility issueRichard Purdie2021-03-011-1/+0
| | | | | | | | | Add sorting to the globbing within the Makefile to make the output reproducible. (From OE-Core rev: c43ae151f572786818fe048233b4bbfd6b0ba2cf) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* swig: Fix reproducibility issueRichard Purdie2021-03-011-1/+0
| | | | | | | | | Remove hardcoding the build configuration into the help/version output from swig to make the binaries reproducible. (From OE-Core rev: 7ed28ae9717ea9dad4e131012186d5f08e8f0bec) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* syslinux: Fix reproducibility issuesRichard Purdie2021-03-011-1/+0
| | | | | | | | | Add sorting to wildcard expansion in the makefile to make builds reproducible. (From OE-Core rev: 5541ba76ccc0c416f315bc0dc14a20a33059bd5f) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* gstreamer1.0-python: Set internal python library path correctyRichard Purdie2021-03-011-1/+0
| | | | | | | | | | The library hardcodes paths to the python library internally and currently these are build paths. Fix this to use the correct target path and fix reproducibility in the process. (From OE-Core rev: 4c190e8c9a2b53de3def1065fb6e479b72d040dc) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* apr-util: Fix CFLAGS used in buildRichard Purdie2021-03-011-1/+0
| | | | | | | | | We need to use CFLAGS with the correct WORKDIR in them, replace those in the sysroot file with the ones appropriate to the current recipe. (From OE-Core rev: 45edf189961aff1858be9bb7b63116073c0a0c10) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libid3tag: Fix reproducibility issueRichard Purdie2021-02-271-1/+0
| | | | | | | | | Configure was swallowing our cflags meaning the resulting binaries were not reproducible. Tweak configure not to do that and fix reproducibility. (From OE-Core rev: 1395269a6fae5cec01d721e2ad52bd7cb8fc38ce) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* igt-gpu-tools: Fix reproducibility issueRichard Purdie2021-02-271-1/+0
| | | | | | | | | Add a configuration option to pass in srcdir, removing hard coded build paths from the binaries. (From OE-Core rev: d7e92e3a22f0c87aff4f452b51f50ec417d2949b) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* bootchart2: Fix manpage reproducibility issueRichard Purdie2021-02-271-1/+0
| | | | | | | | | | | The compressed docs contained a timestamp of the original file which meant the SDE clamping during package creation didn't work. The benefits of compression are minor, decompress the files to avoid the reproducibility issues. (From OE-Core rev: a3b59a67bea16899b57a0d187120c988495da4d5) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/pam: Need shadow installed for the testsKhem Raj2021-02-271-0/+3
| | | | | | | | | | | | | Distros may not use shadow for login manager secondly login --help returns 1 only with shadow provided login utility, with busybox it returns normal 0, the testcase clearly assumes shadow being part of image, therefore add needed checks to ensure the pre-requisites are met (From OE-Core rev: 0820aeba74869bf6e85b200f39bc610a43ab9a7a) Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/reproducible: Don't call sync between each file compareRichard Purdie2021-02-261-1/+1
| | | | | | | | | | Calling sync between each file compare is horrible performance wise as we compare thousands of files. We don't care about IO latency here so disable. (From OE-Core rev: 25f78abd8bbeb201fd9452e7983e015027954948) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libhandy: Fix reproducibility issueRichard Purdie2021-02-261-1/+0
| | | | | | (From OE-Core rev: ba559d5e07cbe92ee22308a1b5b8afc558c662dd) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libsecret: Improve determimismRichard Purdie2021-02-261-2/+0
| | | | | | (From OE-Core rev: 28175c44e7402397a24a00a4b056eef39b0a03fa) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* parted: Fix reproducibility issueRichard Purdie2021-02-261-1/+0
| | | | | | | | | We don't use tbe BUILDINFO line of host information in the Makefile so remove it for reproducibility. (From OE-Core rev: a9742595fa90d4977fdd8129a4fe4932ddb96a18) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* gst-devtools: Fix reproducibility issueRichard Purdie2021-02-261-1/+0
| | | | | | (From OE-Core rev: d221abc411b49b219b89cb38a56b2901d0bd5529) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* epiphany: Fix reproducibility issueRichard Purdie2021-02-261-1/+0
| | | | | | | | | | We don't want to encide BUILD_ROOT into target packages. This is used for build time tests but in our case those would be on target anyway do use the target paths. (From OE-Core rev: 2818dc90bd62487879e7da2c68357b39282415b0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* gtk-doc: Fix reproducibility issueRichard Purdie2021-02-261-1/+0
| | | | | | | | | config_data was including a build system path to pkg-config, fix this. (From OE-Core rev: 7b8f56224c12a40f4f0aca3f612198deb933af4d) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* gcr: Fix reproducibility issueRichard Purdie2021-02-261-1/+0
| | | | | | (From OE-Core rev: b53133572de9e5bdf77dd44831a86ec34bf41b2c) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* cups: Fix reproducibility issuesRichard Purdie2021-02-261-1/+0
| | | | | | | | | configure inspects the host's /etc/group for these configuration options, fix this to the correct values by using configure options. (From OE-Core rev: f16f9c727569414cd52862dcba18d8e423f4e961) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-selftests: add rpm to reproducible build selftestJan-Simon Möller2021-02-261-1/+1
| | | | | | | | | | | | | | | | rpm packaging has shown good numbers wrt reproducible builds as well when testing core-image-minimal locally: Reproducibility summary for rpm: same=4671 different=0 missing=0 total=4671 Thus enable it in the autobuilder to be more widely tested. (From OE-Core rev: 84d3a90557444d8cd83d780b1c3f2b278ab07af2) (From OE-Core rev: 85b9dd01f2e1d5429f8da0c48a25ec034acebf67) Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* reproduce: Fix exclusion list for rpmRichard Purdie2021-02-261-0/+1
| | | | | | | | | | rpm uses "XXX-VERSION" compared to deb/ipk which use "XXX_VERSION" which breaks the go package exclusion. Work around with both go_ and go- for now. (From OE-Core rev: 2af535282833dddb58f24ec5b360230c47e6f6b1) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest: Replace building dep tool with direnvKhem Raj2021-02-261-8/+7
| | | | | | | | | | | | | dep tool is now deprecated and its replaced with go modules so using this as sample for testing is also getting arcane. Replace it with another project direnv[1] which is quite active and uptodate [1] https://github.com/direnv/direnv (From OE-Core rev: bb510037beaaaa723b9158d1f4e11a3547f6fb73) Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/reproducible: Remove exclusions for recipes which now reproduceRichard Purdie2021-02-241-8/+2
| | | | | | | | | | git, libproxy, libcap-ng(-python), babeltrace2, rsync and groff have their reproducibility issues fixed, remove from the exclusion list. Also fix whitespace. (From OE-Core rev: 044eda9c70ddda195b1c0ce1d228904392431582) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* kernel-fitimage: Don't use unit addresses on FITKlaus Heinrich Kiwi2021-02-231-18/+18
| | | | | | | | | | | | | | | | | | | | | | | Das U-Boot 2021.4-rc1 has the following commit: commit 3f04db891a353f4b127ed57279279f851c6b4917 Author: Simon Glass <sjg@chromium.org> Date: Mon Feb 15 17:08:12 2021 -0700 image: Check for unit addresses in FITs Using unit addresses in a FIT is a security risk. Add a check for this and disallow it. CVE-2021-27138 Adjust the kernel-fitimage.bbclass accordingly to not use unit addresses. This changte is required before we can bump U-Boot to 2021.4. (From OE-Core rev: 6047be9f8f0f5d616fda11d83b682c1b8aeaa0ae) Signed-off-by: Klaus Heinrich Kiwi <klaus@linux.vnet.ibm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/incompatible_lic: Update the tests after the 'or-later' license ↵Richard Purdie2021-02-211-13/+13
| | | | | | | | | | | | | | handling changes With the separate of the "-only" and "-or-later" licenses, we need to update the tests to match the messages now given in the output. Also use a mix of canonicalised and non-canonlised names in the reference recipes to help test those cases and ensure coverage. (From OE-Core rev: b7f38af7ac9449178c603c5349808b8c0dd84d35) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* df.py: Add feature check for read-only-rootfsWes Lindauer2021-02-191-0/+2
| | | | | | | | | | | If the target is using a read-only rootfs, the available space on '/' will be zero. This will cause the test to incorrectly fail and skipping seems appropriate in this case. (From OE-Core rev: af1dbea3c9b9b42a3e6803b231e425423d70e210) Signed-off-by: Wes Lindauer <wesley.lindauer@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/runlevel : add test for runlevelsTeoh Jay Shen2021-02-191-0/+22
| | | | | | | | | | This test mimic the boot_from_runlevel_3 and boot_from_runlevel_5 test cases from oeqa/manual/bsp-hw.json. The boot_from_runlevel_3 and boot_from_runlevel_5 manual test cases should be remove from oeqa/manual/bsp-hw.json if this patch get merged. (From OE-Core rev: 6effd30f0e3726bc1f2eb7768c57c6b95eddb079) Signed-off-by: Teoh Jay Shen <jay.shen.teoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* Revert "oe-selftests: add rpm to reproducible build selftest"Richard Purdie2021-02-171-1/+1
| | | | | | | | This reverts commit 84d3a90557444d8cd83d780b1c3f2b278ab07af2. This shouldn't have been merged, its not ready yet. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oe-selftests: add rpm to reproducible build selftestJan-Simon Möller2021-02-171-1/+1
| | | | | | | | | | | | | | rpm packaging has shown good numbers wrt reproducible builds as well when testing core-image-minimal locally: Reproducibility summary for rpm: same=4671 different=0 missing=0 total=4671 Thus enable it in the autobuilder to be more widely tested. (From OE-Core rev: 84d3a90557444d8cd83d780b1c3f2b278ab07af2) Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* acpica: Fix reproducibility issuesJoshua Watt2021-02-171-1/+0
| | | | | | | | | | Fixes reproducibility when build acpica yacc sources by instructing bison on how to do the file prefix mapping (From OE-Core rev: d13a1df7bd173fca3fc2cdf889d5eb487e35d6fd) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/reproducible: Update exclusionsRichard Purdie2021-02-161-4/+6
| | | | | | | | | Add ruby-ri-docs and meson back as not reproducible, remove watchdog, xorg-minimal-fonts and xmlto as issues fixed. (From OE-Core rev: 5e209a7455a231342cded99985b4a6caff424e4f) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa: reproducible: Add more loggingJoshua Watt2021-02-161-0/+3
| | | | | | | | | | | The reproducible build tests can take a long time, so having more logging messages at various points in the build can help debug where the build is taking a long time. (From OE-Core rev: 6b792afe8759d62af8e713b86dad8f6721961a05) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa: reproducible: Fix SSTATE_MIRRORS variableJoshua Watt2021-02-161-1/+1
| | | | | | | | | | The SSTATE_MIRRORS variable was misspelled, which allowed the "clean" test build to pull from the mirror. (From OE-Core rev: e42497bd84d0bb370a9f7b0448bff29f01fd1b0c) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/reproducible: Remove no longer needed exclusionsRichard Purdie2021-02-131-8/+0
| | | | | | | | | It appears these exclusions are no longer needed with master, drop them and improve our reproducibilty metrics. (From OE-Core rev: c71c984a9cd6d130ece08153d7d92bb33c7ec444) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/reproducible: Sort the unused exclusion listRichard Purdie2021-02-131-1/+1
| | | | | | | | This makes comparisions between lists easier. (From OE-Core rev: d2c52125d1cdc06c7e08d507ca68f3e4612a4314) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/reproducible: track unusued entries in the exclusion listAlexander Kanavin2021-02-131-4/+10
| | | | | | | | | This helps with trimming down the list, and towards 100% reproducibility :) (From OE-Core rev: da7a173d7a01524229c8515326465968a845e96f) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* Fix up bitbake logging compatibilityRichard Purdie2021-02-102-20/+4
| | | | | | | | | | | | Bitbake changed the debug() logging call to make it compatible with standard python logging by no longer including a debug level as the first argument. Fix up the few places this was being used. Tweaked version of a patch from Joshua Watt. (From OE-Core rev: 5aecb6df67b876aa12eec54998f209d084579599) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* wic: debug mode to keep tmp directoryLee Chee Yang2021-02-091-0/+2
| | | | | | | | | | | | | | | files in wic tmp directory can be usefull for debugging, so do not remove tmp directory when wic create run with debugging mode (-D or --debug). also update wic.Wic.test_debug_short and wic.Wic.test_debug_long to check for tmp directory. [YOCTO#14216] (From OE-Core rev: a122e2418b67d38f691edcf8dd846c167d6b4fa9) Signed-off-by: Lee Chee Yang <Chee.Yang.Lee@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* selftest/reproducible: remove spirv-tools-dev from exclusion listJose Quaresma2021-02-081-1/+0
| | | | | | | (From OE-Core rev: ecb156fa391b29c6b317abb7bb126a36d709be6a) Signed-off-by: Jose Quaresma <quaresma.jose@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* wic/selftest: test_permissions also test bitbake imageLee Chee Yang2021-02-051-0/+16
| | | | | | | | | | | | | existing test case test_permissions use Wic command as standalone tools to create wic image and check that wic image for permissions. add extra steps to the test case to also check against image build using bitbake do_image_wic. (From OE-Core rev: 551ce73a90757ba43501fe5cf9ac84a7b77de549) Signed-off-by: Lee Chee Yang <chee.yang.lee@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/usb_hid.py : add test to check the usb/human interface device status ↵Teoh Jay Shen2021-02-031-0/+22
| | | | | | | | | | | after suspend state This test mimic the Test_if_usb_hid_device_works_well_after_resume_from_suspend_state manual test case from oeqa/manual/bsp-hw.json. (From OE-Core rev: 23a3dc370a52907ee3261746405fb9b2af9e9a11) Signed-off-by: Teoh Jay Shen <jay.shen.teoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* cve_check: add CVE_VERSION_SUFFIX to indicate suffix in versioningLee Chee Yang2021-01-301-1/+10
| | | | | | | | | | | | | | | | | | add CVE_VERSION_SUFFIX to indicate the version suffix type, currently works in two value, "alphabetical" if the version string uses single alphabetical character suffix as incremental release, blank to not consider the unidentified suffixes. This can be expand when more suffix pattern identified. refactor cve_check.Version class to use functools and add parameter to handle suffix condition. Also update testcases to cover new changes. (From OE-Core rev: 5dfd5ad5144708b474ef31eaa89a846c57be8ac0) Signed-off-by: Lee Chee Yang <chee.yang.lee@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* oeqa/ethernet_ip_connman : add test for network connectionsTeoh Jay Shen2021-01-281-0/+36
| | | | | | | | | | This test mimic the ethernet_static_ip_set_in_connman and ethernet_get_IP_in_connman_via_DHCP test case from oeqa/manual/bsp-hw.json. The ethernet_static_ip_set_in_connman and ethernet_get_IP_in_connman_via_DHCP manual test case should be remove from oeqa/manual/bsp-hw.json if this patch get merged. (From OE-Core rev: aaabc94dbe353b12297ba4a237f6817b2c6d4a31) Signed-off-by: Teoh Jay Shen <jay.shen.teoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
generated by cgit v1.2.3-54-g00ecf (git 2.39.0) at 2024-05-27 08:28:38 +0000