diff options
Diffstat (limited to 'documentation/dev-manual/packages.rst')
| -rw-r--r-- | documentation/dev-manual/packages.rst | 1149 |
1 files changed, 0 insertions, 1149 deletions
diff --git a/documentation/dev-manual/packages.rst b/documentation/dev-manual/packages.rst deleted file mode 100644 index 8bd48c8e8f..0000000000 --- a/documentation/dev-manual/packages.rst +++ /dev/null | |||
| @@ -1,1149 +0,0 @@ | |||
| 1 | .. SPDX-License-Identifier: CC-BY-SA-2.0-UK | ||
| 2 | |||
| 3 | Working with Packages | ||
| 4 | ********************* | ||
| 5 | |||
| 6 | This section describes a few tasks that involve packages: | ||
| 7 | |||
| 8 | - :ref:`dev-manual/packages:excluding packages from an image` | ||
| 9 | |||
| 10 | - :ref:`dev-manual/packages:incrementing a package version` | ||
| 11 | |||
| 12 | - :ref:`dev-manual/packages:handling optional module packaging` | ||
| 13 | |||
| 14 | - :ref:`dev-manual/packages:using runtime package management` | ||
| 15 | |||
| 16 | - :ref:`dev-manual/packages:generating and using signed packages` | ||
| 17 | |||
| 18 | - :ref:`Setting up and running package test | ||
| 19 | (ptest) <test-manual/ptest:testing packages with ptest>` | ||
| 20 | |||
| 21 | - :ref:`dev-manual/packages:creating node package manager (npm) packages` | ||
| 22 | |||
| 23 | - :ref:`dev-manual/packages:adding custom metadata to packages` | ||
| 24 | |||
| 25 | Excluding Packages from an Image | ||
| 26 | ================================ | ||
| 27 | |||
| 28 | You might find it necessary to prevent specific packages from being | ||
| 29 | installed into an image. If so, you can use several variables to direct | ||
| 30 | the build system to essentially ignore installing recommended packages | ||
| 31 | or to not install a package at all. | ||
| 32 | |||
| 33 | The following list introduces variables you can use to prevent packages | ||
| 34 | from being installed into your image. Each of these variables only works | ||
| 35 | with IPK and RPM package types, not for Debian packages. | ||
| 36 | Also, you can use these variables from your ``local.conf`` file | ||
| 37 | or attach them to a specific image recipe by using a recipe name | ||
| 38 | override. For more detail on the variables, see the descriptions in the | ||
| 39 | Yocto Project Reference Manual's glossary chapter. | ||
| 40 | |||
| 41 | - :term:`BAD_RECOMMENDATIONS`: | ||
| 42 | Use this variable to specify "recommended-only" packages that you do | ||
| 43 | not want installed. | ||
| 44 | |||
| 45 | - :term:`NO_RECOMMENDATIONS`: | ||
| 46 | Use this variable to prevent all "recommended-only" packages from | ||
| 47 | being installed. | ||
| 48 | |||
| 49 | - :term:`PACKAGE_EXCLUDE`: | ||
| 50 | Use this variable to prevent specific packages from being installed | ||
| 51 | regardless of whether they are "recommended-only" or not. You need to | ||
| 52 | realize that the build process could fail with an error when you | ||
| 53 | prevent the installation of a package whose presence is required by | ||
| 54 | an installed package. | ||
| 55 | |||
| 56 | Incrementing a Package Version | ||
| 57 | ============================== | ||
| 58 | |||
| 59 | This section provides some background on how binary package versioning | ||
| 60 | is accomplished and presents some of the services, variables, and | ||
| 61 | terminology involved. | ||
| 62 | |||
| 63 | In order to understand binary package versioning, you need to consider | ||
| 64 | the following: | ||
| 65 | |||
| 66 | - Binary Package: The binary package that is eventually built and | ||
| 67 | installed into an image. | ||
| 68 | |||
| 69 | - Binary Package Version: The binary package version is composed of two | ||
| 70 | components --- a version and a revision. | ||
| 71 | |||
| 72 | .. note:: | ||
| 73 | |||
| 74 | Technically, a third component, the "epoch" (i.e. :term:`PE`) is involved | ||
| 75 | but this discussion for the most part ignores :term:`PE`. | ||
| 76 | |||
| 77 | The version and revision are taken from the | ||
| 78 | :term:`PV` and | ||
| 79 | :term:`PR` variables, respectively. | ||
| 80 | |||
| 81 | - :term:`PV`: The recipe version. :term:`PV` represents the version of the | ||
| 82 | software being packaged. Do not confuse :term:`PV` with the binary | ||
| 83 | package version. | ||
| 84 | |||
| 85 | - :term:`PR`: The recipe revision. | ||
| 86 | |||
| 87 | - :yocto_wiki:`PR Service </PR_Service>`: A | ||
| 88 | network-based service that helps automate keeping package feeds | ||
| 89 | compatible with existing package manager applications such as RPM, | ||
| 90 | APT, and OPKG. | ||
| 91 | |||
| 92 | Whenever the binary package content changes, the binary package version | ||
| 93 | must change. Changing the binary package version is accomplished by | ||
| 94 | changing or "bumping" the :term:`PR` and/or :term:`PV` values. Increasing these | ||
| 95 | values occurs one of two ways: | ||
| 96 | |||
| 97 | - Automatically using a Package Revision Service (PR Service). | ||
| 98 | |||
| 99 | - Manually incrementing the :term:`PR` and/or :term:`PV` variables. | ||
| 100 | |||
| 101 | Given a primary challenge of any build system and its users is how to | ||
| 102 | maintain a package feed that is compatible with existing package manager | ||
| 103 | applications such as RPM, APT, and OPKG, using an automated system is | ||
| 104 | much preferred over a manual system. In either system, the main | ||
| 105 | requirement is that binary package version numbering increases in a | ||
| 106 | linear fashion and that there is a number of version components that | ||
| 107 | support that linear progression. For information on how to ensure | ||
| 108 | package revisioning remains linear, see the | ||
| 109 | ":ref:`dev-manual/packages:automatically incrementing a package version number`" | ||
| 110 | section. | ||
| 111 | |||
| 112 | The following three sections provide related information on the PR | ||
| 113 | Service, the manual method for "bumping" :term:`PR` and/or :term:`PV`, and on | ||
| 114 | how to ensure binary package revisioning remains linear. | ||
| 115 | |||
| 116 | Working With a PR Service | ||
| 117 | ------------------------- | ||
| 118 | |||
| 119 | As mentioned, attempting to maintain revision numbers in the | ||
| 120 | :term:`Metadata` is error prone, inaccurate, | ||
| 121 | and causes problems for people submitting recipes. Conversely, the PR | ||
| 122 | Service automatically generates increasing numbers, particularly the | ||
| 123 | revision field, which removes the human element. | ||
| 124 | |||
| 125 | .. note:: | ||
| 126 | |||
| 127 | For additional information on using a PR Service, you can see the | ||
| 128 | :yocto_wiki:`PR Service </PR_Service>` wiki page. | ||
| 129 | |||
| 130 | The Yocto Project uses variables in order of decreasing priority to | ||
| 131 | facilitate revision numbering (i.e. | ||
| 132 | :term:`PE`, | ||
| 133 | :term:`PV`, and | ||
| 134 | :term:`PR` for epoch, version, and | ||
| 135 | revision, respectively). The values are highly dependent on the policies | ||
| 136 | and procedures of a given distribution and package feed. | ||
| 137 | |||
| 138 | Because the OpenEmbedded build system uses | ||
| 139 | ":ref:`signatures <overview-manual/concepts:checksums (signatures)>`", which are | ||
| 140 | unique to a given build, the build system knows when to rebuild | ||
| 141 | packages. All the inputs into a given task are represented by a | ||
| 142 | signature, which can trigger a rebuild when different. Thus, the build | ||
| 143 | system itself does not rely on the :term:`PR`, :term:`PV`, and :term:`PE` numbers to | ||
| 144 | trigger a rebuild. The signatures, however, can be used to generate | ||
| 145 | these values. | ||
| 146 | |||
| 147 | The PR Service works with both ``OEBasic`` and ``OEBasicHash`` | ||
| 148 | generators. The value of :term:`PR` bumps when the checksum changes and the | ||
| 149 | different generator mechanisms change signatures under different | ||
| 150 | circumstances. | ||
| 151 | |||
| 152 | As implemented, the build system includes values from the PR Service | ||
| 153 | into the :term:`PR` field as an addition using the form "``.x``" so ``r0`` | ||
| 154 | becomes ``r0.1``, ``r0.2`` and so forth. This scheme allows existing | ||
| 155 | :term:`PR` values to be used for whatever reasons, which include manual | ||
| 156 | :term:`PR` bumps, should it be necessary. | ||
| 157 | |||
| 158 | By default, the PR Service is not enabled or running. Thus, the packages | ||
| 159 | generated are just "self consistent". The build system adds and removes | ||
| 160 | packages and there are no guarantees about upgrade paths but images will | ||
| 161 | be consistent and correct with the latest changes. | ||
| 162 | |||
| 163 | The simplest form for a PR Service is for a single host development system | ||
| 164 | that builds the package feed (building system). For this scenario, you can | ||
| 165 | enable a local PR Service by setting :term:`PRSERV_HOST` in your | ||
| 166 | ``local.conf`` file in the :term:`Build Directory`:: | ||
| 167 | |||
| 168 | PRSERV_HOST = "localhost:0" | ||
| 169 | |||
| 170 | Once the service is started, packages will automatically | ||
| 171 | get increasing :term:`PR` values and BitBake takes care of starting and | ||
| 172 | stopping the server. | ||
| 173 | |||
| 174 | If you have a more complex setup where multiple host development systems | ||
| 175 | work against a common, shared package feed, you have a single PR Service | ||
| 176 | running and it is connected to each building system. For this scenario, | ||
| 177 | you need to start the PR Service using the ``bitbake-prserv`` command:: | ||
| 178 | |||
| 179 | bitbake-prserv --host ip --port port --start | ||
| 180 | |||
| 181 | In addition to | ||
| 182 | hand-starting the service, you need to update the ``local.conf`` file of | ||
| 183 | each building system as described earlier so each system points to the | ||
| 184 | server and port. | ||
| 185 | |||
| 186 | It is also recommended you use build history, which adds some sanity | ||
| 187 | checks to binary package versions, in conjunction with the server that | ||
| 188 | is running the PR Service. To enable build history, add the following to | ||
| 189 | each building system's ``local.conf`` file:: | ||
| 190 | |||
| 191 | # It is recommended to activate "buildhistory" for testing the PR service | ||
| 192 | INHERIT += "buildhistory" | ||
| 193 | BUILDHISTORY_COMMIT = "1" | ||
| 194 | |||
| 195 | For information on build | ||
| 196 | history, see the | ||
| 197 | ":ref:`dev-manual/build-quality:maintaining build output quality`" section. | ||
| 198 | |||
| 199 | .. note:: | ||
| 200 | |||
| 201 | The OpenEmbedded build system does not maintain :term:`PR` information as | ||
| 202 | part of the shared state (sstate) packages. If you maintain an sstate | ||
| 203 | feed, it's expected that either all your building systems that | ||
| 204 | contribute to the sstate feed use a shared PR service, or you do not | ||
| 205 | run a PR service on any of your building systems. | ||
| 206 | |||
| 207 | That's because if you had multiple machines sharing a PR service but | ||
| 208 | not their sstate feed, you could end up with "diverging" hashes for | ||
| 209 | the same output artefacts. When presented to the share PR service, | ||
| 210 | each would be considered as new and would increase the revision | ||
| 211 | number, causing many unnecessary package upgrades. | ||
| 212 | |||
| 213 | For more information on shared state, see the | ||
| 214 | ":ref:`overview-manual/concepts:shared state cache`" | ||
| 215 | section in the Yocto Project Overview and Concepts Manual. | ||
| 216 | |||
| 217 | Manually Bumping PR | ||
| 218 | ------------------- | ||
| 219 | |||
| 220 | The alternative to setting up a PR Service is to manually "bump" the | ||
| 221 | :term:`PR` variable. | ||
| 222 | |||
| 223 | If a committed change results in changing the package output, then the | ||
| 224 | value of the :term:`PR` variable needs to be increased (or "bumped") as part of | ||
| 225 | that commit. For new recipes you should add the :term:`PR` variable and set | ||
| 226 | its initial value equal to "r0", which is the default. Even though the | ||
| 227 | default value is "r0", the practice of adding it to a new recipe makes | ||
| 228 | it harder to forget to bump the variable when you make changes to the | ||
| 229 | recipe in future. | ||
| 230 | |||
| 231 | Usually, version increases occur only to binary packages. However, if | ||
| 232 | for some reason :term:`PV` changes but does not increase, you can increase | ||
| 233 | the :term:`PE` variable (Package Epoch). The :term:`PE` variable defaults to | ||
| 234 | "0". | ||
| 235 | |||
| 236 | Binary package version numbering strives to follow the `Debian Version | ||
| 237 | Field Policy | ||
| 238 | Guidelines <https://www.debian.org/doc/debian-policy/ch-controlfields.html>`__. | ||
| 239 | These guidelines define how versions are compared and what "increasing" | ||
| 240 | a version means. | ||
| 241 | |||
| 242 | Automatically Incrementing a Package Version Number | ||
| 243 | --------------------------------------------------- | ||
| 244 | |||
| 245 | When fetching a repository, BitBake uses the | ||
| 246 | :term:`SRCREV` variable to determine | ||
| 247 | the specific source code revision from which to build. You set the | ||
| 248 | :term:`SRCREV` variable to | ||
| 249 | :term:`AUTOREV` to cause the | ||
| 250 | OpenEmbedded build system to automatically use the latest revision of | ||
| 251 | the software:: | ||
| 252 | |||
| 253 | SRCREV = "${AUTOREV}" | ||
| 254 | |||
| 255 | Furthermore, you need to include a ``+`` sign in :term:`PV` in order to | ||
| 256 | automatically update the version whenever the revision of the source | ||
| 257 | code changes. Here is an example:: | ||
| 258 | |||
| 259 | PV = "1.0+git" | ||
| 260 | |||
| 261 | The OpenEmbedded build system will automatically add the source control | ||
| 262 | information to the end of the variable :term:`PKGV`, in this format:: | ||
| 263 | |||
| 264 | AUTOINC+source_code_revision | ||
| 265 | |||
| 266 | The build system replaces the ``AUTOINC`` | ||
| 267 | with a number. The number used depends on the state of the PR Service: | ||
| 268 | |||
| 269 | - If PR Service is enabled, the build system increments the number, | ||
| 270 | which is similar to the behavior of | ||
| 271 | :term:`PR`. This behavior results in | ||
| 272 | linearly increasing package versions, which is desirable. Here is an | ||
| 273 | example: | ||
| 274 | |||
| 275 | .. code-block:: none | ||
| 276 | |||
| 277 | hello-world-git_0.0+git0+b6558dd387-r0.0_armv7a-neon.ipk | ||
| 278 | hello-world-git_0.0+git1+dd2f5c3565-r0.0_armv7a-neon.ipk | ||
| 279 | |||
| 280 | - If PR Service is not enabled, the build system replaces the | ||
| 281 | ``AUTOINC`` placeholder with zero (i.e. "0"). This results in | ||
| 282 | changing the package version since the source revision is included. | ||
| 283 | However, package versions are not increased linearly. Here is an | ||
| 284 | example: | ||
| 285 | |||
| 286 | .. code-block:: none | ||
| 287 | |||
| 288 | hello-world-git_0.0+git0+b6558dd387-r0.0_armv7a-neon.ipk | ||
| 289 | hello-world-git_0.0+git0+dd2f5c3565-r0.0_armv7a-neon.ipk | ||
| 290 | |||
| 291 | In summary, the OpenEmbedded build system does not track the history of | ||
| 292 | binary package versions for this purpose. ``AUTOINC``, in this case, is | ||
| 293 | comparable to :term:`PR`. If PR server is not enabled, ``AUTOINC`` in the | ||
| 294 | package version is simply replaced by "0". If PR server is enabled, the | ||
| 295 | build system keeps track of the package versions and bumps the number | ||
| 296 | when the package revision changes. | ||
| 297 | |||
| 298 | Handling Optional Module Packaging | ||
| 299 | ================================== | ||
| 300 | |||
| 301 | Many pieces of software split functionality into optional modules (or | ||
| 302 | plugins) and the plugins that are built might depend on configuration | ||
| 303 | options. To avoid having to duplicate the logic that determines what | ||
| 304 | modules are available in your recipe or to avoid having to package each | ||
| 305 | module by hand, the OpenEmbedded build system provides functionality to | ||
| 306 | handle module packaging dynamically. | ||
| 307 | |||
| 308 | To handle optional module packaging, you need to do two things: | ||
| 309 | |||
| 310 | - Ensure the module packaging is actually done. | ||
| 311 | |||
| 312 | - Ensure that any dependencies on optional modules from other recipes | ||
| 313 | are satisfied by your recipe. | ||
| 314 | |||
| 315 | Making Sure the Packaging is Done | ||
| 316 | --------------------------------- | ||
| 317 | |||
| 318 | To ensure the module packaging actually gets done, you use the | ||
| 319 | ``do_split_packages`` function within the ``populate_packages`` Python | ||
| 320 | function in your recipe. The ``do_split_packages`` function searches for | ||
| 321 | a pattern of files or directories under a specified path and creates a | ||
| 322 | package for each one it finds by appending to the | ||
| 323 | :term:`PACKAGES` variable and | ||
| 324 | setting the appropriate values for ``FILES:packagename``, | ||
| 325 | ``RDEPENDS:packagename``, ``DESCRIPTION:packagename``, and so forth. | ||
| 326 | Here is an example from the ``lighttpd`` recipe:: | ||
| 327 | |||
| 328 | python populate_packages:prepend () { | ||
| 329 | lighttpd_libdir = d.expand('${libdir}') | ||
| 330 | do_split_packages(d, lighttpd_libdir, '^mod_(.*).so$', | ||
| 331 | 'lighttpd-module-%s', 'Lighttpd module for %s', | ||
| 332 | extra_depends='') | ||
| 333 | } | ||
| 334 | |||
| 335 | The previous example specifies a number of things in the call to | ||
| 336 | ``do_split_packages``. | ||
| 337 | |||
| 338 | - A directory within the files installed by your recipe through | ||
| 339 | :ref:`ref-tasks-install` in which to search. | ||
| 340 | |||
| 341 | - A regular expression used to match module files in that directory. In | ||
| 342 | the example, note the parentheses () that mark the part of the | ||
| 343 | expression from which the module name should be derived. | ||
| 344 | |||
| 345 | - A pattern to use for the package names. | ||
| 346 | |||
| 347 | - A description for each package. | ||
| 348 | |||
| 349 | - An empty string for ``extra_depends``, which disables the default | ||
| 350 | dependency on the main ``lighttpd`` package. Thus, if a file in | ||
| 351 | ``${libdir}`` called ``mod_alias.so`` is found, a package called | ||
| 352 | ``lighttpd-module-alias`` is created for it and the | ||
| 353 | :term:`DESCRIPTION` is set to | ||
| 354 | "Lighttpd module for alias". | ||
| 355 | |||
| 356 | Often, packaging modules is as simple as the previous example. However, | ||
| 357 | there are more advanced options that you can use within | ||
| 358 | ``do_split_packages`` to modify its behavior. And, if you need to, you | ||
| 359 | can add more logic by specifying a hook function that is called for each | ||
| 360 | package. It is also perfectly acceptable to call ``do_split_packages`` | ||
| 361 | multiple times if you have more than one set of modules to package. | ||
| 362 | |||
| 363 | For more examples that show how to use ``do_split_packages``, see the | ||
| 364 | ``connman.inc`` file in the ``meta/recipes-connectivity/connman/`` | ||
| 365 | directory of the ``poky`` :ref:`source repository <overview-manual/development-environment:yocto project source repositories>`. You can | ||
| 366 | also find examples in ``meta/classes-recipe/kernel.bbclass``. | ||
| 367 | |||
| 368 | Here is a reference that shows ``do_split_packages`` mandatory and | ||
| 369 | optional arguments:: | ||
| 370 | |||
| 371 | Mandatory arguments | ||
| 372 | |||
| 373 | root | ||
| 374 | The path in which to search | ||
| 375 | file_regex | ||
| 376 | Regular expression to match searched files. | ||
| 377 | Use parentheses () to mark the part of this | ||
| 378 | expression that should be used to derive the | ||
| 379 | module name (to be substituted where %s is | ||
| 380 | used in other function arguments as noted below) | ||
| 381 | output_pattern | ||
| 382 | Pattern to use for the package names. Must | ||
| 383 | include %s. | ||
| 384 | description | ||
| 385 | Description to set for each package. Must | ||
| 386 | include %s. | ||
| 387 | |||
| 388 | Optional arguments | ||
| 389 | |||
| 390 | postinst | ||
| 391 | Postinstall script to use for all packages | ||
| 392 | (as a string) | ||
| 393 | recursive | ||
| 394 | True to perform a recursive search --- default | ||
| 395 | False | ||
| 396 | hook | ||
| 397 | A hook function to be called for every match. | ||
| 398 | The function will be called with the following | ||
| 399 | arguments (in the order listed): | ||
| 400 | |||
| 401 | f | ||
| 402 | Full path to the file/directory match | ||
| 403 | pkg | ||
| 404 | The package name | ||
| 405 | file_regex | ||
| 406 | As above | ||
| 407 | output_pattern | ||
| 408 | As above | ||
| 409 | modulename | ||
| 410 | The module name derived using file_regex | ||
| 411 | extra_depends | ||
| 412 | Extra runtime dependencies (RDEPENDS) to be | ||
| 413 | set for all packages. The default value of None | ||
| 414 | causes a dependency on the main package | ||
| 415 | (${PN}) --- if you do not want this, pass empty | ||
| 416 | string '' for this parameter. | ||
| 417 | aux_files_pattern | ||
| 418 | Extra item(s) to be added to FILES for each | ||
| 419 | package. Can be a single string item or a list | ||
| 420 | of strings for multiple items. Must include %s. | ||
| 421 | postrm | ||
| 422 | postrm script to use for all packages (as a | ||
| 423 | string) | ||
| 424 | allow_dirs | ||
| 425 | True to allow directories to be matched - | ||
| 426 | default False | ||
| 427 | prepend | ||
| 428 | If True, prepend created packages to PACKAGES | ||
| 429 | instead of the default False which appends them | ||
| 430 | match_path | ||
| 431 | match file_regex on the whole relative path to | ||
| 432 | the root rather than just the filename | ||
| 433 | aux_files_pattern_verbatim | ||
| 434 | Extra item(s) to be added to FILES for each | ||
| 435 | package, using the actual derived module name | ||
| 436 | rather than converting it to something legal | ||
| 437 | for a package name. Can be a single string item | ||
| 438 | or a list of strings for multiple items. Must | ||
| 439 | include %s. | ||
| 440 | allow_links | ||
| 441 | True to allow symlinks to be matched --- default | ||
| 442 | False | ||
| 443 | summary | ||
| 444 | Summary to set for each package. Must include %s; | ||
| 445 | defaults to description if not set. | ||
| 446 | |||
| 447 | |||
| 448 | |||
| 449 | Satisfying Dependencies | ||
| 450 | ----------------------- | ||
| 451 | |||
| 452 | The second part for handling optional module packaging is to ensure that | ||
| 453 | any dependencies on optional modules from other recipes are satisfied by | ||
| 454 | your recipe. You can be sure these dependencies are satisfied by using | ||
| 455 | the :term:`PACKAGES_DYNAMIC` | ||
| 456 | variable. Here is an example that continues with the ``lighttpd`` recipe | ||
| 457 | shown earlier:: | ||
| 458 | |||
| 459 | PACKAGES_DYNAMIC = "lighttpd-module-.*" | ||
| 460 | |||
| 461 | The name | ||
| 462 | specified in the regular expression can of course be anything. In this | ||
| 463 | example, it is ``lighttpd-module-`` and is specified as the prefix to | ||
| 464 | ensure that any :term:`RDEPENDS` and | ||
| 465 | :term:`RRECOMMENDS` on a package | ||
| 466 | name starting with the prefix are satisfied during build time. If you | ||
| 467 | are using ``do_split_packages`` as described in the previous section, | ||
| 468 | the value you put in :term:`PACKAGES_DYNAMIC` should correspond to the name | ||
| 469 | pattern specified in the call to ``do_split_packages``. | ||
| 470 | |||
| 471 | Using Runtime Package Management | ||
| 472 | ================================ | ||
| 473 | |||
| 474 | During a build, BitBake always transforms a recipe into one or more | ||
| 475 | packages. For example, BitBake takes the ``bash`` recipe and produces a | ||
| 476 | number of packages (e.g. ``bash``, ``bash-bashbug``, | ||
| 477 | ``bash-completion``, ``bash-completion-dbg``, ``bash-completion-dev``, | ||
| 478 | ``bash-completion-extra``, ``bash-dbg``, and so forth). Not all | ||
| 479 | generated packages are included in an image. | ||
| 480 | |||
| 481 | In several situations, you might need to update, add, remove, or query | ||
| 482 | the packages on a target device at runtime (i.e. without having to | ||
| 483 | generate a new image). Examples of such situations include: | ||
| 484 | |||
| 485 | - You want to provide in-the-field updates to deployed devices (e.g. | ||
| 486 | security updates). | ||
| 487 | |||
| 488 | - You want to have a fast turn-around development cycle for one or more | ||
| 489 | applications that run on your device. | ||
| 490 | |||
| 491 | - You want to temporarily install the "debug" packages of various | ||
| 492 | applications on your device so that debugging can be greatly improved | ||
| 493 | by allowing access to symbols and source debugging. | ||
| 494 | |||
| 495 | - You want to deploy a more minimal package selection of your device | ||
| 496 | but allow in-the-field updates to add a larger selection for | ||
| 497 | customization. | ||
| 498 | |||
| 499 | In all these situations, you have something similar to a more | ||
| 500 | traditional Linux distribution in that in-field devices are able to | ||
| 501 | receive pre-compiled packages from a server for installation or update. | ||
| 502 | Being able to install these packages on a running, in-field device is | ||
| 503 | what is termed "runtime package management". | ||
| 504 | |||
| 505 | In order to use runtime package management, you need a host or server | ||
| 506 | machine that serves up the pre-compiled packages plus the required | ||
| 507 | metadata. You also need package manipulation tools on the target. The | ||
| 508 | build machine is a likely candidate to act as the server. However, that | ||
| 509 | machine does not necessarily have to be the package server. The build | ||
| 510 | machine could push its artifacts to another machine that acts as the | ||
| 511 | server (e.g. Internet-facing). In fact, doing so is advantageous for a | ||
| 512 | production environment as getting the packages away from the development | ||
| 513 | system's :term:`Build Directory` prevents accidental overwrites. | ||
| 514 | |||
| 515 | A simple build that targets just one device produces more than one | ||
| 516 | package database. In other words, the packages produced by a build are | ||
| 517 | separated out into a couple of different package groupings based on | ||
| 518 | criteria such as the target's CPU architecture, the target board, or the | ||
| 519 | C library used on the target. For example, a build targeting the | ||
| 520 | ``qemux86`` device produces the following three package databases: | ||
| 521 | ``noarch``, ``i586``, and ``qemux86``. If you wanted your ``qemux86`` | ||
| 522 | device to be aware of all the packages that were available to it, you | ||
| 523 | would need to point it to each of these databases individually. In a | ||
| 524 | similar way, a traditional Linux distribution usually is configured to | ||
| 525 | be aware of a number of software repositories from which it retrieves | ||
| 526 | packages. | ||
| 527 | |||
| 528 | Using runtime package management is completely optional and not required | ||
| 529 | for a successful build or deployment in any way. But if you want to make | ||
| 530 | use of runtime package management, you need to do a couple things above | ||
| 531 | and beyond the basics. The remainder of this section describes what you | ||
| 532 | need to do. | ||
| 533 | |||
| 534 | Build Considerations | ||
| 535 | -------------------- | ||
| 536 | |||
| 537 | This section describes build considerations of which you need to be | ||
| 538 | aware in order to provide support for runtime package management. | ||
| 539 | |||
| 540 | When BitBake generates packages, it needs to know what format or formats | ||
| 541 | to use. In your configuration, you use the | ||
| 542 | :term:`PACKAGE_CLASSES` | ||
| 543 | variable to specify the format: | ||
| 544 | |||
| 545 | #. Open the ``local.conf`` file inside your :term:`Build Directory` (e.g. | ||
| 546 | ``poky/build/conf/local.conf``). | ||
| 547 | |||
| 548 | #. Select the desired package format as follows:: | ||
| 549 | |||
| 550 | PACKAGE_CLASSES ?= "package_packageformat" | ||
| 551 | |||
| 552 | where packageformat can be "ipk", "rpm", | ||
| 553 | "deb", or "tar" which are the supported package formats. | ||
| 554 | |||
| 555 | .. note:: | ||
| 556 | |||
| 557 | Because the Yocto Project supports four different package formats, | ||
| 558 | you can set the variable with more than one argument. However, the | ||
| 559 | OpenEmbedded build system only uses the first argument when | ||
| 560 | creating an image or Software Development Kit (SDK). | ||
| 561 | |||
| 562 | If you would like your image to start off with a basic package database | ||
| 563 | containing the packages in your current build as well as to have the | ||
| 564 | relevant tools available on the target for runtime package management, | ||
| 565 | you can include "package-management" in the | ||
| 566 | :term:`IMAGE_FEATURES` | ||
| 567 | variable. Including "package-management" in this configuration variable | ||
| 568 | ensures that when the image is assembled for your target, the image | ||
| 569 | includes the currently-known package databases as well as the | ||
| 570 | target-specific tools required for runtime package management to be | ||
| 571 | performed on the target. However, this is not strictly necessary. You | ||
| 572 | could start your image off without any databases but only include the | ||
| 573 | required on-target package tool(s). As an example, you could include | ||
| 574 | "opkg" in your | ||
| 575 | :term:`IMAGE_INSTALL` variable | ||
| 576 | if you are using the IPK package format. You can then initialize your | ||
| 577 | target's package database(s) later once your image is up and running. | ||
| 578 | |||
| 579 | Whenever you perform any sort of build step that can potentially | ||
| 580 | generate a package or modify existing package, it is always a good idea | ||
| 581 | to re-generate the package index after the build by using the following | ||
| 582 | command:: | ||
| 583 | |||
| 584 | $ bitbake package-index | ||
| 585 | |||
| 586 | It might be tempting to build the | ||
| 587 | package and the package index at the same time with a command such as | ||
| 588 | the following:: | ||
| 589 | |||
| 590 | $ bitbake some-package package-index | ||
| 591 | |||
| 592 | Do not do this as | ||
| 593 | BitBake does not schedule the package index for after the completion of | ||
| 594 | the package you are building. Consequently, you cannot be sure of the | ||
| 595 | package index including information for the package you just built. | ||
| 596 | Thus, be sure to run the package update step separately after building | ||
| 597 | any packages. | ||
| 598 | |||
| 599 | You can use the | ||
| 600 | :term:`PACKAGE_FEED_ARCHS`, | ||
| 601 | :term:`PACKAGE_FEED_BASE_PATHS`, | ||
| 602 | and | ||
| 603 | :term:`PACKAGE_FEED_URIS` | ||
| 604 | variables to pre-configure target images to use a package feed. If you | ||
| 605 | do not define these variables, then manual steps as described in the | ||
| 606 | subsequent sections are necessary to configure the target. You should | ||
| 607 | set these variables before building the image in order to produce a | ||
| 608 | correctly configured image. | ||
| 609 | |||
| 610 | .. note:: | ||
| 611 | |||
| 612 | Your image will need enough free storage space to run package upgrades, | ||
| 613 | especially if many of them need to be downloaded at the same time. | ||
| 614 | You should make sure images are created with enough free space | ||
| 615 | by setting the :term:`IMAGE_ROOTFS_EXTRA_SPACE` variable. | ||
| 616 | |||
| 617 | When your build is complete, your packages reside in the | ||
| 618 | ``${TMPDIR}/deploy/packageformat`` directory. For example, if | ||
| 619 | ``${``\ :term:`TMPDIR`\ ``}`` is | ||
| 620 | ``tmp`` and your selected package type is RPM, then your RPM packages | ||
| 621 | are available in ``tmp/deploy/rpm``. | ||
| 622 | |||
| 623 | Host or Server Machine Setup | ||
| 624 | ---------------------------- | ||
| 625 | |||
| 626 | Although other protocols are possible, a server using HTTP typically | ||
| 627 | serves packages. If you want to use HTTP, then set up and configure a | ||
| 628 | web server such as Apache 2, lighttpd, or Python web server on the | ||
| 629 | machine serving the packages. | ||
| 630 | |||
| 631 | To keep things simple, this section describes how to set up a | ||
| 632 | Python web server to share package feeds from the developer's | ||
| 633 | machine. Although this server might not be the best for a production | ||
| 634 | environment, the setup is simple and straight forward. Should you want | ||
| 635 | to use a different server more suited for production (e.g. Apache 2, | ||
| 636 | Lighttpd, or Nginx), take the appropriate steps to do so. | ||
| 637 | |||
| 638 | From within the :term:`Build Directory` where you have built an image based on | ||
| 639 | your packaging choice (i.e. the :term:`PACKAGE_CLASSES` setting), simply start | ||
| 640 | the server. The following example assumes a :term:`Build Directory` of ``poky/build`` | ||
| 641 | and a :term:`PACKAGE_CLASSES` setting of ":ref:`ref-classes-package_rpm`":: | ||
| 642 | |||
| 643 | $ cd poky/build/tmp/deploy/rpm | ||
| 644 | $ python3 -m http.server | ||
| 645 | |||
| 646 | Target Setup | ||
| 647 | ------------ | ||
| 648 | |||
| 649 | Setting up the target differs depending on the package management | ||
| 650 | system. This section provides information for RPM, IPK, and DEB. | ||
| 651 | |||
| 652 | Using RPM | ||
| 653 | ~~~~~~~~~ | ||
| 654 | |||
| 655 | The :wikipedia:`Dandified Packaging <DNF_(software)>` (DNF) performs | ||
| 656 | runtime package management of RPM packages. In order to use DNF for | ||
| 657 | runtime package management, you must perform an initial setup on the | ||
| 658 | target machine for cases where the ``PACKAGE_FEED_*`` variables were not | ||
| 659 | set as part of the image that is running on the target. This means if | ||
| 660 | you built your image and did not use these variables as part of the | ||
| 661 | build and your image is now running on the target, you need to perform | ||
| 662 | the steps in this section if you want to use runtime package management. | ||
| 663 | |||
| 664 | .. note:: | ||
| 665 | |||
| 666 | For information on the ``PACKAGE_FEED_*`` variables, see | ||
| 667 | :term:`PACKAGE_FEED_ARCHS`, :term:`PACKAGE_FEED_BASE_PATHS`, and | ||
| 668 | :term:`PACKAGE_FEED_URIS` in the Yocto Project Reference Manual variables | ||
| 669 | glossary. | ||
| 670 | |||
| 671 | On the target, you must inform DNF that package databases are available. | ||
| 672 | You do this by creating a file named | ||
| 673 | ``/etc/yum.repos.d/oe-packages.repo`` and defining the ``oe-packages``. | ||
| 674 | |||
| 675 | As an example, assume the target is able to use the following package | ||
| 676 | databases: ``all``, ``i586``, and ``qemux86`` from a server named | ||
| 677 | ``my.server``. The specifics for setting up the web server are up to | ||
| 678 | you. The critical requirement is that the URIs in the target repository | ||
| 679 | configuration point to the correct remote location for the feeds. | ||
| 680 | |||
| 681 | .. note:: | ||
| 682 | |||
| 683 | For development purposes, you can point the web server to the build | ||
| 684 | system's ``deploy`` directory. However, for production use, it is better to | ||
| 685 | copy the package directories to a location outside of the build area and use | ||
| 686 | that location. Doing so avoids situations where the build system | ||
| 687 | overwrites or changes the ``deploy`` directory. | ||
| 688 | |||
| 689 | When telling DNF where to look for the package databases, you must | ||
| 690 | declare individual locations per architecture or a single location used | ||
| 691 | for all architectures. You cannot do both: | ||
| 692 | |||
| 693 | - *Create an Explicit List of Architectures:* Define individual base | ||
| 694 | URLs to identify where each package database is located: | ||
| 695 | |||
| 696 | .. code-block:: none | ||
| 697 | |||
| 698 | [oe-packages] | ||
| 699 | baseurl=http://my.server/rpm/i586 http://my.server/rpm/qemux86 http://my.server/rpm/all | ||
| 700 | |||
| 701 | This example | ||
| 702 | informs DNF about individual package databases for all three | ||
| 703 | architectures. | ||
| 704 | |||
| 705 | - *Create a Single (Full) Package Index:* Define a single base URL that | ||
| 706 | identifies where a full package database is located:: | ||
| 707 | |||
| 708 | [oe-packages] | ||
| 709 | baseurl=http://my.server/rpm | ||
| 710 | |||
| 711 | This example informs DNF about a single | ||
| 712 | package database that contains all the package index information for | ||
| 713 | all supported architectures. | ||
| 714 | |||
| 715 | Once you have informed DNF where to find the package databases, you need | ||
| 716 | to fetch them: | ||
| 717 | |||
| 718 | .. code-block:: none | ||
| 719 | |||
| 720 | # dnf makecache | ||
| 721 | |||
| 722 | DNF is now able to find, install, and | ||
| 723 | upgrade packages from the specified repository or repositories. | ||
| 724 | |||
| 725 | .. note:: | ||
| 726 | |||
| 727 | See the `DNF documentation <https://dnf.readthedocs.io/en/latest/>`__ for | ||
| 728 | additional information. | ||
| 729 | |||
| 730 | Using IPK | ||
| 731 | ~~~~~~~~~ | ||
| 732 | |||
| 733 | The ``opkg`` application performs runtime package management of IPK | ||
| 734 | packages. You must perform an initial setup for ``opkg`` on the target | ||
| 735 | machine if the | ||
| 736 | :term:`PACKAGE_FEED_ARCHS`, | ||
| 737 | :term:`PACKAGE_FEED_BASE_PATHS`, | ||
| 738 | and | ||
| 739 | :term:`PACKAGE_FEED_URIS` | ||
| 740 | variables have not been set or the target image was built before the | ||
| 741 | variables were set. | ||
| 742 | |||
| 743 | The ``opkg`` application uses configuration files to find available | ||
| 744 | package databases. Thus, you need to create a configuration file inside | ||
| 745 | the ``/etc/opkg/`` directory, which informs ``opkg`` of any repository | ||
| 746 | you want to use. | ||
| 747 | |||
| 748 | As an example, suppose you are serving packages from a ``ipk/`` | ||
| 749 | directory containing the ``i586``, ``all``, and ``qemux86`` databases | ||
| 750 | through an HTTP server named ``my.server``. On the target, create a | ||
| 751 | configuration file (e.g. ``my_repo.conf``) inside the ``/etc/opkg/`` | ||
| 752 | directory containing the following: | ||
| 753 | |||
| 754 | .. code-block:: none | ||
| 755 | |||
| 756 | src/gz all http://my.server/ipk/all | ||
| 757 | src/gz i586 http://my.server/ipk/i586 | ||
| 758 | src/gz qemux86 http://my.server/ipk/qemux86 | ||
| 759 | |||
| 760 | Next, instruct ``opkg`` to fetch the | ||
| 761 | repository information: | ||
| 762 | |||
| 763 | .. code-block:: none | ||
| 764 | |||
| 765 | # opkg update | ||
| 766 | |||
| 767 | The ``opkg`` application is now able to find, install, and upgrade packages | ||
| 768 | from the specified repository. | ||
| 769 | |||
| 770 | Using DEB | ||
| 771 | ~~~~~~~~~ | ||
| 772 | |||
| 773 | The ``apt`` application performs runtime package management of DEB | ||
| 774 | packages. This application uses a source list file to find available | ||
| 775 | package databases. You must perform an initial setup for ``apt`` on the | ||
| 776 | target machine if the | ||
| 777 | :term:`PACKAGE_FEED_ARCHS`, | ||
| 778 | :term:`PACKAGE_FEED_BASE_PATHS`, | ||
| 779 | and | ||
| 780 | :term:`PACKAGE_FEED_URIS` | ||
| 781 | variables have not been set or the target image was built before the | ||
| 782 | variables were set. | ||
| 783 | |||
| 784 | To inform ``apt`` of the repository you want to use, you might create a | ||
| 785 | list file (e.g. ``my_repo.list``) inside the | ||
| 786 | ``/etc/apt/sources.list.d/`` directory. As an example, suppose you are | ||
| 787 | serving packages from a ``deb/`` directory containing the ``i586``, | ||
| 788 | ``all``, and ``qemux86`` databases through an HTTP server named | ||
| 789 | ``my.server``. The list file should contain: | ||
| 790 | |||
| 791 | .. code-block:: none | ||
| 792 | |||
| 793 | deb http://my.server/deb/all ./ | ||
| 794 | deb http://my.server/deb/i586 ./ | ||
| 795 | deb http://my.server/deb/qemux86 ./ | ||
| 796 | |||
| 797 | Next, instruct the ``apt`` application | ||
| 798 | to fetch the repository information: | ||
| 799 | |||
| 800 | .. code-block:: none | ||
| 801 | |||
| 802 | $ sudo apt update | ||
| 803 | |||
| 804 | After this step, | ||
| 805 | ``apt`` is able to find, install, and upgrade packages from the | ||
| 806 | specified repository. | ||
| 807 | |||
| 808 | Generating and Using Signed Packages | ||
| 809 | ==================================== | ||
| 810 | |||
| 811 | In order to add security to RPM packages used during a build, you can | ||
| 812 | take steps to securely sign them. Once a signature is verified, the | ||
| 813 | OpenEmbedded build system can use the package in the build. If security | ||
| 814 | fails for a signed package, the build system stops the build. | ||
| 815 | |||
| 816 | This section describes how to sign RPM packages during a build and how | ||
| 817 | to use signed package feeds (repositories) when doing a build. | ||
| 818 | |||
| 819 | Signing RPM Packages | ||
| 820 | -------------------- | ||
| 821 | |||
| 822 | To enable signing RPM packages, you must modify the ``rpm`` | ||
| 823 | recipe configuration to include support for OpenPGP signing. | ||
| 824 | That may be done either in a ``.bbappend`` for the ``rpm`` recipe:: | ||
| 825 | |||
| 826 | PACKAGECONFIG:append = " sequoia" | ||
| 827 | |||
| 828 | or in a :term:`Configuration File`:: | ||
| 829 | |||
| 830 | PACKAGECONFIG:append:pn-rpm-native = " sequoia" | ||
| 831 | PACKAGECONFIG:append:pn-rpm = " sequoia" | ||
| 832 | |||
| 833 | You must also set up the following settings in a | ||
| 834 | :term:`Configuration File`:: | ||
| 835 | |||
| 836 | # Inherit sign_rpm.bbclass to enable signing functionality | ||
| 837 | INHERIT += " sign_rpm" | ||
| 838 | # Define the GPG key that will be used for signing. | ||
| 839 | RPM_GPG_NAME = "key_name" | ||
| 840 | # Provide passphrase for the key | ||
| 841 | RPM_GPG_PASSPHRASE = "passphrase" | ||
| 842 | |||
| 843 | .. note:: | ||
| 844 | |||
| 845 | Be sure to supply appropriate values for both `key_name` and | ||
| 846 | `passphrase`. | ||
| 847 | |||
| 848 | Aside from the ``RPM_GPG_NAME`` and ``RPM_GPG_PASSPHRASE`` variables in | ||
| 849 | the previous example, two optional variables related to signing are available: | ||
| 850 | |||
| 851 | - *GPG_BIN:* Specifies a ``gpg`` binary/wrapper that is executed | ||
| 852 | when the package is signed. | ||
| 853 | |||
| 854 | - *GPG_PATH:* Specifies the ``gpg`` home directory used when the | ||
| 855 | package is signed. | ||
| 856 | |||
| 857 | Processing Package Feeds | ||
| 858 | ------------------------ | ||
| 859 | |||
| 860 | In addition to being able to sign RPM packages, you can also enable | ||
| 861 | signed package feeds for IPK and RPM packages. | ||
| 862 | |||
| 863 | The steps you need to take to enable signed package feed use are similar | ||
| 864 | to the steps used to sign RPM packages. You must define the following in | ||
| 865 | your ``local.config`` or ``distro.config`` file:: | ||
| 866 | |||
| 867 | INHERIT += "sign_package_feed" | ||
| 868 | PACKAGE_FEED_GPG_NAME = "key_name" | ||
| 869 | PACKAGE_FEED_GPG_PASSPHRASE_FILE = "path_to_file_containing_passphrase" | ||
| 870 | |||
| 871 | For signed package feeds, the passphrase must be specified in a separate file, | ||
| 872 | which is pointed to by the ``PACKAGE_FEED_GPG_PASSPHRASE_FILE`` | ||
| 873 | variable. Regarding security, keeping a plain text passphrase out of the | ||
| 874 | configuration is more secure. | ||
| 875 | |||
| 876 | Aside from the ``PACKAGE_FEED_GPG_NAME`` and | ||
| 877 | ``PACKAGE_FEED_GPG_PASSPHRASE_FILE`` variables, three optional variables | ||
| 878 | related to signed package feeds are available: | ||
| 879 | |||
| 880 | - *GPG_BIN* Specifies a ``gpg`` binary/wrapper that is executed | ||
| 881 | when the package is signed. | ||
| 882 | |||
| 883 | - *GPG_PATH:* Specifies the ``gpg`` home directory used when the | ||
| 884 | package is signed. | ||
| 885 | |||
| 886 | - *PACKAGE_FEED_GPG_SIGNATURE_TYPE:* Specifies the type of ``gpg`` | ||
| 887 | signature. This variable applies only to RPM and IPK package feeds. | ||
| 888 | Allowable values for the ``PACKAGE_FEED_GPG_SIGNATURE_TYPE`` are | ||
| 889 | "ASC", which is the default and specifies ascii armored, and "BIN", | ||
| 890 | which specifies binary. | ||
| 891 | |||
| 892 | Testing Packages With ptest | ||
| 893 | =========================== | ||
| 894 | |||
| 895 | See the :ref:`test-manual/ptest:Testing Packages With ptest` section of the | ||
| 896 | Yocto Project Test Environment Manual. | ||
| 897 | |||
| 898 | Creating Node Package Manager (NPM) Packages | ||
| 899 | ============================================ | ||
| 900 | |||
| 901 | :wikipedia:`NPM <Npm_(software)>` is a package manager for the JavaScript | ||
| 902 | programming language. The Yocto Project supports the NPM | ||
| 903 | :ref:`fetcher <bitbake-user-manual/bitbake-user-manual-fetching:fetchers>`. | ||
| 904 | You can use this fetcher in combination with | ||
| 905 | :doc:`devtool </ref-manual/devtool-reference>` to create recipes that produce | ||
| 906 | NPM packages. | ||
| 907 | |||
| 908 | There are two workflows that allow you to create NPM packages using | ||
| 909 | ``devtool``: the NPM registry modules method and the NPM project code | ||
| 910 | method. | ||
| 911 | |||
| 912 | .. note:: | ||
| 913 | |||
| 914 | While it is possible to create NPM recipes manually, using | ||
| 915 | ``devtool`` is far simpler. | ||
| 916 | |||
| 917 | Additionally, some requirements and caveats exist. | ||
| 918 | |||
| 919 | Requirements and Caveats | ||
| 920 | ------------------------ | ||
| 921 | |||
| 922 | You need to be aware of the following before using ``devtool`` to create | ||
| 923 | NPM packages: | ||
| 924 | |||
| 925 | - Of the two methods that you can use ``devtool`` to create NPM | ||
| 926 | packages, the registry approach is slightly simpler. However, you | ||
| 927 | might consider the project approach because you do not have to | ||
| 928 | publish your module in the `NPM registry <https://docs.npmjs.com/misc/registry>`__, | ||
| 929 | which is NPM's public registry. | ||
| 930 | |||
| 931 | - Be familiar with | ||
| 932 | :doc:`devtool </ref-manual/devtool-reference>`. | ||
| 933 | |||
| 934 | - The NPM host tools need the native ``nodejs-npm`` package, which is | ||
| 935 | part of the OpenEmbedded environment. You need to get the package by | ||
| 936 | cloning the :oe_git:`meta-openembedded </meta-openembedded>` | ||
| 937 | repository. Be sure to add the path to your local copy | ||
| 938 | to your ``bblayers.conf`` file. | ||
| 939 | |||
| 940 | - ``devtool`` cannot detect native libraries in module dependencies. | ||
| 941 | Consequently, you must manually add packages to your recipe. | ||
| 942 | |||
| 943 | - While deploying NPM packages, ``devtool`` cannot determine which | ||
| 944 | dependent packages are missing on the target (e.g. the node runtime | ||
| 945 | ``nodejs``). Consequently, you need to find out what files are | ||
| 946 | missing and be sure they are on the target. | ||
| 947 | |||
| 948 | - Although you might not need NPM to run your node package, it is | ||
| 949 | useful to have NPM on your target. The NPM package name is | ||
| 950 | ``nodejs-npm``. | ||
| 951 | |||
| 952 | Using the Registry Modules Method | ||
| 953 | --------------------------------- | ||
| 954 | |||
| 955 | This section presents an example that uses the ``cute-files`` module, | ||
| 956 | which is a file browser web application. | ||
| 957 | |||
| 958 | .. note:: | ||
| 959 | |||
| 960 | You must know the ``cute-files`` module version. | ||
| 961 | |||
| 962 | The first thing you need to do is use ``devtool`` and the NPM fetcher to | ||
| 963 | create the recipe:: | ||
| 964 | |||
| 965 | $ devtool add "npm://registry.npmjs.org;package=cute-files;version=1.0.2" | ||
| 966 | |||
| 967 | The | ||
| 968 | ``devtool add`` command runs ``recipetool create`` and uses the same | ||
| 969 | fetch URI to download each dependency and capture license details where | ||
| 970 | possible. The result is a generated recipe. | ||
| 971 | |||
| 972 | After running for quite a long time, in particular building the | ||
| 973 | ``nodejs-native`` package, the command should end as follows:: | ||
| 974 | |||
| 975 | INFO: Recipe /home/.../build/workspace/recipes/cute-files/cute-files_1.0.2.bb has been automatically created; further editing may be required to make it fully functional | ||
| 976 | |||
| 977 | The recipe file is fairly simple and contains every license that | ||
| 978 | ``recipetool`` finds and includes the licenses in the recipe's | ||
| 979 | :term:`LIC_FILES_CHKSUM` | ||
| 980 | variables. You need to examine the variables and look for those with | ||
| 981 | "unknown" in the :term:`LICENSE` | ||
| 982 | field. You need to track down the license information for "unknown" | ||
| 983 | modules and manually add the information to the recipe. | ||
| 984 | |||
| 985 | ``recipetool`` creates a "shrinkwrap" file for your recipe. Shrinkwrap | ||
| 986 | files capture the version of all dependent modules. Many packages do not | ||
| 987 | provide shrinkwrap files but ``recipetool`` will create a shrinkwrap file as it | ||
| 988 | runs. | ||
| 989 | |||
| 990 | .. note:: | ||
| 991 | |||
| 992 | A package is created for each sub-module. This policy is the only | ||
| 993 | practical way to have the licenses for all of the dependencies | ||
| 994 | represented in the license manifest of the image. | ||
| 995 | |||
| 996 | The ``devtool edit-recipe`` command lets you take a look at the recipe:: | ||
| 997 | |||
| 998 | $ devtool edit-recipe cute-files | ||
| 999 | # Recipe created by recipetool | ||
| 1000 | # This is the basis of a recipe and may need further editing in order to be fully functional. | ||
| 1001 | # (Feel free to remove these comments when editing.) | ||
| 1002 | |||
| 1003 | SUMMARY = "Turn any folder on your computer into a cute file browser, available on the local network." | ||
| 1004 | # WARNING: the following LICENSE and LIC_FILES_CHKSUM values are best guesses - it is | ||
| 1005 | # your responsibility to verify that the values are complete and correct. | ||
| 1006 | # | ||
| 1007 | # NOTE: multiple licenses have been detected; they have been separated with & | ||
| 1008 | # in the LICENSE value for now since it is a reasonable assumption that all | ||
| 1009 | # of the licenses apply. If instead there is a choice between the multiple | ||
| 1010 | # licenses then you should change the value to separate the licenses with | | ||
| 1011 | # instead of &. If there is any doubt, check the accompanying documentation | ||
| 1012 | # to determine which situation is applicable. | ||
| 1013 | |||
| 1014 | SUMMARY = "Turn any folder on your computer into a cute file browser, available on the local network." | ||
| 1015 | LICENSE = "BSD-3-Clause & ISC & MIT" | ||
| 1016 | LIC_FILES_CHKSUM = "file://LICENSE;md5=71d98c0a1db42956787b1909c74a86ca \ | ||
| 1017 | file://node_modules/accepts/LICENSE;md5=bf1f9ad1e2e1d507aef4883fff7103de \ | ||
| 1018 | file://node_modules/array-flatten/LICENSE;md5=44088ba57cb871a58add36ce51b8de08 \ | ||
| 1019 | ... | ||
| 1020 | file://node_modules/cookie-signature/Readme.md;md5=57ae8b42de3dd0c1f22d5f4cf191e15a" | ||
| 1021 | |||
| 1022 | SRC_URI = " \ | ||
| 1023 | npm://registry.npmjs.org/;package=cute-files;version=${PV} \ | ||
| 1024 | npmsw://${THISDIR}/${BPN}/npm-shrinkwrap.json \ | ||
| 1025 | " | ||
| 1026 | |||
| 1027 | S = "${UNPACKDIR}/npm" | ||
| 1028 | |||
| 1029 | inherit npm | ||
| 1030 | |||
| 1031 | LICENSE:${PN} = "MIT" | ||
| 1032 | LICENSE:${PN}-accepts = "MIT" | ||
| 1033 | LICENSE:${PN}-array-flatten = "MIT" | ||
| 1034 | ... | ||
| 1035 | LICENSE:${PN}-vary = "MIT" | ||
| 1036 | |||
| 1037 | Three key points in the previous example are: | ||
| 1038 | |||
| 1039 | - :term:`SRC_URI` uses the NPM | ||
| 1040 | scheme so that the NPM fetcher is used. | ||
| 1041 | |||
| 1042 | - ``recipetool`` collects all the license information. If a | ||
| 1043 | sub-module's license is unavailable, the sub-module's name appears in | ||
| 1044 | the comments. | ||
| 1045 | |||
| 1046 | - The ``inherit npm`` statement causes the :ref:`ref-classes-npm` class to | ||
| 1047 | package up all the modules. | ||
| 1048 | |||
| 1049 | You can run the following command to build the ``cute-files`` package:: | ||
| 1050 | |||
| 1051 | $ devtool build cute-files | ||
| 1052 | |||
| 1053 | Remember that ``nodejs`` must be installed on | ||
| 1054 | the target before your package. | ||
| 1055 | |||
| 1056 | Assuming 192.168.7.2 for the target's IP address, use the following | ||
| 1057 | command to deploy your package:: | ||
| 1058 | |||
| 1059 | $ devtool deploy-target -s cute-files root@192.168.7.2 | ||
| 1060 | |||
| 1061 | Once the package is installed on the target, you can | ||
| 1062 | test the application to show the contents of any directory:: | ||
| 1063 | |||
| 1064 | $ cd /usr/lib/node_modules/cute-files | ||
| 1065 | $ cute-files | ||
| 1066 | |||
| 1067 | On a browser, | ||
| 1068 | go to ``http://192.168.7.2:3000`` and you see the following: | ||
| 1069 | |||
| 1070 | .. image:: figures/cute-files-npm-example.png | ||
| 1071 | :width: 100% | ||
| 1072 | |||
| 1073 | You can find the recipe in ``workspace/recipes/cute-files``. You can use | ||
| 1074 | the recipe in any layer you choose. | ||
| 1075 | |||
| 1076 | Using the NPM Projects Code Method | ||
| 1077 | ---------------------------------- | ||
| 1078 | |||
| 1079 | Although it is useful to package modules already in the NPM registry, | ||
| 1080 | adding ``node.js`` projects under development is a more common developer | ||
| 1081 | use case. | ||
| 1082 | |||
| 1083 | This section covers the NPM projects code method, which is very similar | ||
| 1084 | to the "registry" approach described in the previous section. In the NPM | ||
| 1085 | projects method, you provide ``devtool`` with an URL that points to the | ||
| 1086 | source files. | ||
| 1087 | |||
| 1088 | Replicating the same example, (i.e. ``cute-files``) use the following | ||
| 1089 | command:: | ||
| 1090 | |||
| 1091 | $ devtool add https://github.com/martinaglv/cute-files.git | ||
| 1092 | |||
| 1093 | The recipe this command generates is very similar to the recipe created in | ||
| 1094 | the previous section. However, the :term:`SRC_URI` looks like the following:: | ||
| 1095 | |||
| 1096 | SRC_URI = " \ | ||
| 1097 | git://github.com/martinaglv/cute-files.git;protocol=https;branch=master \ | ||
| 1098 | npmsw://${THISDIR}/${BPN}/npm-shrinkwrap.json \ | ||
| 1099 | " | ||
| 1100 | |||
| 1101 | In this example, | ||
| 1102 | the main module is taken from the Git repository and dependencies are | ||
| 1103 | taken from the NPM registry. Other than those differences, the recipe is | ||
| 1104 | basically the same between the two methods. You can build and deploy the | ||
| 1105 | package exactly as described in the previous section that uses the | ||
| 1106 | registry modules method. | ||
| 1107 | |||
| 1108 | Adding custom metadata to packages | ||
| 1109 | ================================== | ||
| 1110 | |||
| 1111 | The variable | ||
| 1112 | :term:`PACKAGE_ADD_METADATA` | ||
| 1113 | can be used to add additional metadata to packages. This is reflected in | ||
| 1114 | the package control/spec file. To take the ipk format for example, the | ||
| 1115 | CONTROL file stored inside would contain the additional metadata as | ||
| 1116 | additional lines. | ||
| 1117 | |||
| 1118 | The variable can be used in multiple ways, including using suffixes to | ||
| 1119 | set it for a specific package type and/or package. Note that the order | ||
| 1120 | of precedence is the same as this list: | ||
| 1121 | |||
| 1122 | - ``PACKAGE_ADD_METADATA_<PKGTYPE>:<PN>`` | ||
| 1123 | |||
| 1124 | - ``PACKAGE_ADD_METADATA_<PKGTYPE>`` | ||
| 1125 | |||
| 1126 | - ``PACKAGE_ADD_METADATA:<PN>`` | ||
| 1127 | |||
| 1128 | - :term:`PACKAGE_ADD_METADATA` | ||
| 1129 | |||
| 1130 | `<PKGTYPE>` is a parameter and expected to be a distinct name of specific | ||
| 1131 | package type: | ||
| 1132 | |||
| 1133 | - IPK for .ipk packages | ||
| 1134 | |||
| 1135 | - DEB for .deb packages | ||
| 1136 | |||
| 1137 | - RPM for .rpm packages | ||
| 1138 | |||
| 1139 | `<PN>` is a parameter and expected to be a package name. | ||
| 1140 | |||
| 1141 | The variable can contain multiple [one-line] metadata fields separated | ||
| 1142 | by the literal sequence '\\n'. The separator can be redefined using the | ||
| 1143 | variable flag ``separator``. | ||
| 1144 | |||
| 1145 | Here is an example that adds two custom fields for ipk | ||
| 1146 | packages:: | ||
| 1147 | |||
| 1148 | PACKAGE_ADD_METADATA_IPK = "Vendor: CustomIpk\nGroup:Applications/Spreadsheets" | ||
| 1149 | |||
