linux/poky.git/meta/lib/oe, branch 3.5_M2

classes/native: Propagate dependencies to outhash

2022-01-17T11:49:11+00:00

Native task outputs are directly run on the build system during the build after being built. Even if the output of a native recipe doesn't change, a change in one of its dependencies may cause a change in the output it generates (e.g. rpm output depends on the output of its dependent zstd library). This can cause poor interactions with hash equivalence, since this recipe's output-changing dependency is "hidden" and downstream tasks only see that this recipe has the same outhash and therefore is equivalent. This can result in different output in different cases and issues with reproducible builds in parcular (e.g. rpm compression changes for the same content). To resolve this, unhide the output-changing dependency by adding it's unihash to this tasks outhash calculation. Unfortunately, we don't know specifically know which dependencies are output-changing, so we have to add all of them. [YOCTO #14685] (From OE-Core rev: d6c7b9f4f0e61fa6546d3644e27abe3e96f597e2) Signed-off-by: Joshua Watt Signed-off-by: Richard Purdie

package: Add support for kernel stripping

2022-01-13T13:57:26+00:00

Extend runstrip() to accept additional argument to enable sharing it with the kernel do_strip() so that KERNEL_IMAGE_STRIP_EXTRA_SECTIONS can be passed. Since is_elf() understands kernel modules there is no need to keep a seperate list for kernmodules or hardcode the values to runstrip. (From OE-Core rev: e09a8fa931fe617afc05bd5e00dca5dd3fe386e8) Signed-off-by: Saul Wold Signed-off-by: Richard Purdie

lib/oe/reproducible: correctly set .git location when recursively looking for git repos

2022-01-05T17:18:15+00:00

(From OE-Core rev: ffdaa1a0527691d66dd28e86bd015bfad7a020f6) Signed-off-by: Alexander Kanavin Signed-off-by: Richard Purdie

package_manager: ipk: Fix host manifest generation

2022-01-04T23:14:05+00:00

Since honister host manifest stopped to generate, i.e. manifest file is empty but all ipks/files into sdk is ok. (From OE-Core rev: 79a2392f5d2a4cb6509a83afb40bca01bac59914) Signed-off-by: Oleksiy Obitotskyy Signed-off-by: Richard Purdie

patch.py: Initialize git repo before patching

2021-12-03T23:37:16+00:00

If PATCHTOOL="git" has been specified but workdir is not git repo bitbake fails to apply the patches with error message: Command Error: 'git rev-parse --show-toplevel' exited with 0 Output: fatal: not a git repository (or any of the parent directories): .git Fix this by initializing the repo before patching. This allows binary git patches to be applied. (From OE-Core rev: 6184b56a7a0fc6f5d19fdfb81e7453667f7da940) Signed-off-by: Pavel Zhukov Signed-off-by: Richard Purdie

sanity/lib: Replace usage of LooseVersion() with bb.utils.vercmp_string_op()

2021-11-29T23:07:13+00:00

distutils is going away and we have functionality in bitbake which can handle these comparisions so switch to the bb.utils function. (From OE-Core rev: fe624b520e6c75e16a8f394785ab0216341402f9) Signed-off-by: Richard Purdie

oe/utils: by default cap cpu_count() to 64 cores

2021-11-25T21:55:10+00:00

Larger systems may have large numbers of cores, but beyond a certain point they can't all be used for compiling: whilst purely compute-intensive jobs can be parallelised to hundreds of cores, operations such as compressing (needs lots of RAM) or compiling (lots of I/O) don't scale linearly. For example, the Marvel ThunderX2 has 32 cores, each capable of executing four threads, and can be configured with two sockets, making 256 CPUs according to Linux. Zstd using 256 threads has been seen to fail to allocate memory during even small recipes such as iso-codes. Add a default cap of 64 CPUs to the cpu_count() method so that extreme parallisation is limited. 64 is high enough that meaningful gains beyond it are unlikely, but high enough that most systems won't be effected. (From OE-Core rev: 765d0f25ce48636b1838a5968e2dc15de2127428) Signed-off-by: Ross Burton Signed-off-by: Richard Purdie

oe/utils: allow naming threads in ThreadedPool

2021-11-25T21:55:10+00:00

When looking at logs involving thread pools it is useful if the threads can be named. (From OE-Core rev: 18342945b021608794d83ecf567afd43f4379b24) Signed-off-by: Ross Burton Signed-off-by: Richard Purdie

overlayfs: all overlays unit

2021-10-30T21:31:52+00:00

Application can depend on several overlayfs mount points. Provide a systemd unit application can depend on to make sure all overlays are mounted before it is started to avoid any race conditions (From OE-Core rev: b38e194db0c6825f28c56123cf88af94d3f52beb) Signed-off-by: Bruno Knittel Signed-off-by: Vyacheslav Yurkov Signed-off-by: Richard Purdie

spdx.py: Add annotation to relationship

2021-10-28T13:16:31+00:00

Having annotations on relationship can provide additional information about the relationship such as how it was derived. (From OE-Core rev: d98585aa89e1d3819f8139a07fb7376ef89b37f8) Signed-off-by: Saul Wold Signed-off-by: Alexandre Belloni Signed-off-by: Richard Purdie