linux/poky.git/bitbake/lib/bb/fetch2/git.py, branch nanbield-4.3

bitbake: fetch2: Add API for upstream source tracing

2023-10-15T08:12:43+00:00

This patch adds an API to bb.fetch2 to enable users to plug in an unpack tracer that can trace each source file back to its corresponding upstream source url, even when multiple upstream sources are combined together in the same unpack directory. This may be required for software composition analysis, license compliance, and detailed SBoM generation. This patch provides only the needed hooks in bb.fetch2 code and a dummy abstract class defining the API; users may load their own unpack tracer class by setting the BB_UNPACK_TRACER_CLASS config parameter. (Bitbake rev: 05051152cc42acc52bcf9af9a696f632fac4307f) Signed-off-by: Alberto Pianon Signed-off-by: Richard Purdie

bitbake: fetch2: git: Use path_is_descendant() instead of path for repo check

2023-09-14T14:08:21+00:00

Using path prefixes to check if the git directory is a descendant of the clone directory can be easily confused with symlinkes and bind mounts, causing directories to be deleted unnecessarily. Instead, use bb.utils.path_is_descendant() which is immune to the these sorts of problems. (Bitbake rev: b4d7a0546630620480b7fee159b84c3506e941a2) Signed-off-by: Joshua Watt Signed-off-by: Alexandre Belloni Signed-off-by: Richard Purdie

bitbake: fetch2: git: Remove useless try..else clause

2023-09-02T10:48:05+00:00

There is no reason to have the else clause in this try block, as it can be moved into the try block, which is clearer. (Bitbake rev: 5625849e9327fc71a38eea00d4506f80abc11bc6) Signed-off-by: Joshua Watt Signed-off-by: Richard Purdie

bitbake: fetch2: git: Check if clone directory is a git repo

2023-08-30T09:41:54+00:00

If the clone target directory exists and is a valid git repo, but the git directory is not a child, it needs to be erased and re-cloned. One example of how this can happen is if a clone creates the directory, but then fails to actual clone and make it a git repository. This left-over directory can be particularly problematic if the download directory is a descent of some top layer git repo (e.g. the default with poky), as the commands that operate on the remote later will then mangle the layers git repository instead of the download git repo. (Bitbake rev: 2117db3146ce38bb4a6e2df40b6cd2ab11b514d5) Signed-off-by: Joshua Watt Signed-off-by: Luca Ceresoli Signed-off-by: Richard Purdie

bitbake: fetch/git: Fix local clone url to make it work with repo

2023-03-30T09:51:54+00:00

The "git clone /path/to/git/objects_symlink" couldn't work after the following change: https://github.com/git/git/commit/6f054f9fb3a501c35b55c65e547a244f14c38d56 But repo command manages the git repo as symlinks, so check whether the objects is an symlink to fix the problem: * Nothing is changed if git/objects is not a symlink * Use "git clone file://" when git/objects is a symlink (Bitbake rev: a0d8108eba8d542707740d00c66c1c5f5b963f18) Signed-off-by: Robert Yang Signed-off-by: Richard Purdie

bitbake: fetch2: Add autorev warning when it is set too late

2023-03-22T13:57:04+00:00

Bitbake expects a consistent metadata environment when it parses. There are plenty of ways you can set a recipe to autorev at a point where parts of the fetcher have already been triggered leading to obsure bugs which I struggled to debug, let alone anyone not familar with the code. If anyone is running into the message from the commit, the issue is likely one of timing. Keep in mind that the anonymous python code in base.bbclass will expand variables like FILESPATH, WORKDIR and others which contain PV. The recipe needs to be set to AUTOREV before that anonymous python runs. In particular, that means you can't set SRCREV = "${AUTOREV}" in other anonymous python, it needs to happen earlier. (Bitbake rev: 4d9ec332d5bfc8b60b54f8ec2a17d34e35aa903a) Signed-off-by: Richard Purdie

bitbake: fetch2: Rename BBSEENSRCREV -> BBSRCREV_SEEN

2023-03-22T13:57:04+00:00

For readability of following patches, rename this internal variable to allow for others in a similar format. (Bitbake rev: 450b4a00895ed1f9396a8ff859dc1cc0eccc838f) Signed-off-by: Richard Purdie

bitbake: fetch/git: Replace mkdtemp with TemporaryDirectory and avoid exception masking

2023-02-22T12:03:39+00:00

Due to using mkdtemp instead of TemporaryDirectory we needed to manually cleanup the directory in a try finally block. With tempfile.TemporaryDirectory we can handle the cleanup with a "with" statement and not need to manually clean up oursevels. (Bitbake rev: 36a231d2a45e7c87172196538d18ded81a234774) Signed-off-by: Paulo Neves Signed-off-by: Richard Purdie

bitbake: fetch/git: Removed unused variables in _contains_lfs

2023-02-22T12:03:39+00:00

branchname was set but never used in the context of _contains_lfs method. (Bitbake rev: a64ec64c2faf1ac6ce995cdd4e311d8be6046155) Signed-off-by: Paulo Neves Signed-off-by: Richard Purdie

bitbake: fetch2/git: Clarify the meaning of namespace

2022-12-21T14:15:26+00:00

Namespace in this context means a branch, a tag, etc., clarify it in the description. Also, fix a typo "a any", replace with plain "any". This patch is based of feedback on new applied patch d32e5b0e ("fetch2/git: Prevent git fetcher from fetching gitlab repository metadata") (Bitbake rev: b4999425c812b25cb359d5163d11e3c1b030dc28) Signed-off-by: Marek Vasut Signed-off-by: Richard Purdie

linux/poky.git/bitbake/lib/bb/fetch2/git.py, branch nanbield-4.3

bitbake: fetch2: Add API for upstream source tracing

bitbake: fetch2: git: Use path_is_descendant() instead of path for repo check

bitbake: fetch2: git: Remove useless try..else clause

bitbake: fetch2: git: Check if clone directory is a git repo

bitbake: fetch/git: Fix local clone url to make it work with repo

bitbake: fetch2: Add autorev warning when it is set too late

bitbake: fetch2: Rename __BBSEENSRCREV -> __BBSRCREV_SEEN

bitbake: fetch/git: Replace mkdtemp with TemporaryDirectory and avoid exception masking

bitbake: fetch/git: Removed unused variables in _contains_lfs

bitbake: fetch2/git: Clarify the meaning of namespace

bitbake: fetch2: Rename BBSEENSRCREV -> BBSRCREV_SEEN