linux/poky.git/bitbake/lib/bb/fetch2/__init__.py, branch 5.2_M3Mirror of git.yoctoproject.org/pokyhttps://git.enea.com/cgit/linux/poky.git/atom?h=5.2_M32025-03-07T15:38:15+00:00bitbake: fetch2: Partial revert decodeurl() to not use the URI class2025-03-07T15:38:15+00:00Stefan Herbrechtsmeierstefan.herbrechtsmeier@weidmueller.com2025-03-07T09:43:20+00:00urn:sha1:bae86fe618075f28b708d2c89d247937a75226fc
This partial reverts commit a5d569c94700f04b8193c6bccae5af619931b00f
which changes decodeurl() to use the URI class to parse the URL instead
of doing it itself. While reusing code is generally a good idea, using
urllib.parse.urlparse() (which the URI class does) to parse the regular
expression "URLs" that are used in PREMIRRORS and MIRRORS does not work.
A regular expression URL containing https?://... would be silently
ignored, while a URL using a negative lookahead such as
git://(?!internal\.git\.server).*/.* would result in a cryptic error:
Exception: re.error: missing ), unterminated subpattern at position 0
The problem is that urllib.parse.urlparse() treats the ? as the start of
URL parameters and thus stops parsing whatever part of the URL it was
parsing. Restore the old function and use it in the PREMIRRORS and
MIRRORS code.
(Bitbake rev: f8a7712754e6d0199a0d227fca288307b935368d)
Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
bitbake: fetch2: Fix BB_FETCH_PREMIRRORONLY network disabling2025-02-25T12:49:52+00:00Richard Purdierichard.purdie@linuxfoundation.org2025-02-20T16:57:28+00:00urn:sha1:ba91179519f2673ef803872baf2064281af37028
When using BB_FETCH_PREMIRRORONLY we write to the datastore to disable the network.
This change needs to be undo when handling later urls, so operate on a copy of the
datastore to allow this.
Reported by Julian Haller <julian.haller@philips.com>
(Bitbake rev: 67a5ede8ae92ed7dcad29fd0dcfd62c6640b10b2)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
bitbake: fetch2: local: use path variable2025-02-11T21:18:39+00:00Stefan Herbrechtsmeierstefan.herbrechtsmeier@weidmueller.com2025-02-07T12:46:55+00:00urn:sha1:f17c51c6959f740b279814624b40c65d69827637
Use the path variable from the fetch data instead of decoding the path
manually from the plain unexpanded url.
(Bitbake rev: ad3a29fa6ea53741d4e1786de35f8e7fc4292e7a)
Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
bitbake: fetch2: remove unnecessary expand function calls2025-02-11T21:18:39+00:00Stefan Herbrechtsmeierstefan.herbrechtsmeier@weidmueller.com2025-02-07T12:46:54+00:00urn:sha1:3e543e8eaa18cecd9e360eecd3925b18e7a9058e
The fetch data class already expands the type, host, path, user, pswd
and parm variables. The fetcher classes already expand the localfile
variable. The getVar function expands the returned string per default.
Remove unnecessary expand function calls to simplify the code.
(Bitbake rev: 1b1eb037b861fbf20491ac17e519e9eaf232b858)
Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
bitbake: fetch2: remove duplicated code in url decode and encode2025-02-11T21:18:39+00:00Stefan Herbrechtsmeierstefan.herbrechtsmeier@weidmueller.com2025-02-07T12:46:53+00:00urn:sha1:2935d76bb468e576ab6219fa352968f2835f4ab8
Use the URI class to decode and encode an URL. Remove duplicate code and
unify the behavior.
(Bitbake rev: a5d569c94700f04b8193c6bccae5af619931b00f)
Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
bitbake: fetch2: do not decode user from file URI2025-02-11T21:18:39+00:00Stefan Herbrechtsmeierstefan.herbrechtsmeier@weidmueller.com2025-02-07T12:46:49+00:00urn:sha1:2b71696f35eca128857e09b0a40d9e39992b1c2d
A file URI can't contain a user. Do not treat the @ as reserved
character for a file URI.
(Bitbake rev: 11cf4062f48536547a352e24d6e963d91fdd1190)
Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
bitbake: bb/fetch2/__init__.py: remove a DeprecationWarning in uri_replace()2025-01-14T09:51:45+00:00Bin Lanbin.lan.cn@windriver.com2025-01-09T02:00:02+00:00urn:sha1:33271912bf25a51d86cf07f5d3e2042c04d17245
There is the following warning when executing to bitbake linux-yocto:
bitbake/lib/bb/fetch2/__init__.py:464: DeprecationWarning: 'count' is passed as positional argument
This is because the 4th parameter of re.sub(pattern, repl, string, count=0, flags=0)
is a keyword parameter. We use keyword arguments for parameters that are not positional.
(Bitbake rev: 4bd62639f7023eec9f55ad7909fa9250538de936)
Signed-off-by: Bin Lan <bin.lan.cn@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
bitbake: utils: add Go mod h1 checksum support2025-01-11T18:35:01+00:00Stefan Herbrechtsmeierstefan.herbrechtsmeier@weidmueller.com2025-01-07T15:15:13+00:00urn:sha1:f00e8e1233e773d495413ea31000b88f67eb61ba
Add support for the Go mod h1 hash. The hash is based on the Go dirhash
package. The package defines hashes over directory trees and is uses for
Go mod files and zip archives.
(Bitbake rev: deefb01592f717efba68e3997fefd04dc7611d88)
Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
bitbake: fetch2: read checksum from SRC_URI flag for npm2025-01-08T11:34:04+00:00Stefan Herbrechtsmeierstefan.herbrechtsmeier@weidmueller.com2025-01-07T09:17:57+00:00urn:sha1:b242f0a0079bb1b9c19d663e144187af2fcc0605
(Bitbake rev: 8d3232152e545be958f8f3b069e7477c6f310583)
Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
bitbake: fetch2: do not prefix embedded checksums2025-01-08T11:34:04+00:00Stefan Herbrechtsmeierstefan.herbrechtsmeier@weidmueller.com2025-01-07T09:17:56+00:00urn:sha1:d7c6afc9a97407238af814777f9148dedd507192
The fetcher support entries with an embedded checksum like 'sha256sum'
in the SRC_URI. It adds the parameter 'name' as prefix to the checksums
if the parameter is set. This behavior is unexpected and leads to hacks
in fetchers. Fallback to the checksum without the useless prefix and
set the parameter 'name' in the gomod fetcher unconditional.
(Bitbake rev: 7a86c5a20ea2586f1ae240613644e065e7b21683)
Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>