diff options
author | Scott Rifenbark <scott.m.rifenbark@intel.com> | 2014-03-19 07:27:09 -0600 |
---|---|---|
committer | Richard Purdie <richard.purdie@linuxfoundation.org> | 2014-03-25 12:29:43 +0000 |
commit | 914b3e061b0288e80a33d16961abd1810124e4eb (patch) | |
tree | da02df6c03c71a83418d7f1dd6d526676e818fb3 | |
parent | 128cdcf85d9f5d719bae8d641fe91f1db37dd8c9 (diff) | |
download | poky-914b3e061b0288e80a33d16961abd1810124e4eb.tar.gz |
dev-manual: Read-thru edits for "Performing Automated Runtime Testing"
Minor edits.
(From yocto-docs rev: 29b999f259bc9c87ad0b2e3c1d54f5473b66edbc)
Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
-rw-r--r-- | documentation/dev-manual/dev-manual-common-tasks.xml | 36 |
1 files changed, 18 insertions, 18 deletions
diff --git a/documentation/dev-manual/dev-manual-common-tasks.xml b/documentation/dev-manual/dev-manual-common-tasks.xml index 5223aba158..b2dfc52a2d 100644 --- a/documentation/dev-manual/dev-manual-common-tasks.xml +++ b/documentation/dev-manual/dev-manual-common-tasks.xml | |||
@@ -5575,8 +5575,7 @@ | |||
5575 | </note> | 5575 | </note> |
5576 | These tests are written in Python making use of the | 5576 | These tests are written in Python making use of the |
5577 | <filename>unittest</filename> module, and the majority of them | 5577 | <filename>unittest</filename> module, and the majority of them |
5578 | run commands on the target system over | 5578 | run commands on the target system over SSH. |
5579 | <filename>ssh</filename>. | ||
5580 | This section describes how you set up the environment to use these | 5579 | This section describes how you set up the environment to use these |
5581 | tests, run available tests, and write and add your own tests. | 5580 | tests, run available tests, and write and add your own tests. |
5582 | </para> | 5581 | </para> |
@@ -5623,7 +5622,7 @@ | |||
5623 | <listitem><para><emphasis>Be sure your host's firewall | 5622 | <listitem><para><emphasis>Be sure your host's firewall |
5624 | accepts incoming connections from | 5623 | accepts incoming connections from |
5625 | 192.168.7.0/24:</emphasis> | 5624 | 192.168.7.0/24:</emphasis> |
5626 | Some of the tests (in particular smart tests) start a | 5625 | Some of the tests (in particular smart tests) start an |
5627 | HTTP server on a random high number port, which is | 5626 | HTTP server on a random high number port, which is |
5628 | used to serve files to the target. | 5627 | used to serve files to the target. |
5629 | The smart module serves | 5628 | The smart module serves |
@@ -5649,7 +5648,7 @@ | |||
5649 | <para> | 5648 | <para> |
5650 | You can start the tests automatically or manually: | 5649 | You can start the tests automatically or manually: |
5651 | <itemizedlist> | 5650 | <itemizedlist> |
5652 | <listitem><para><emphasis>Automatically Running Tests:</emphasis> | 5651 | <listitem><para><emphasis>Automatically running tests:</emphasis> |
5653 | To run the tests automatically after the | 5652 | To run the tests automatically after the |
5654 | OpenEmbedded build system successfully creates an image, | 5653 | OpenEmbedded build system successfully creates an image, |
5655 | first set the | 5654 | first set the |
@@ -5660,16 +5659,17 @@ | |||
5660 | <literallayout class='monospaced'> | 5659 | <literallayout class='monospaced'> |
5661 | TEST_IMAGE = "1" | 5660 | TEST_IMAGE = "1" |
5662 | </literallayout> | 5661 | </literallayout> |
5663 | Next, simply build your image. | 5662 | Next, build your image. |
5664 | If the image successfully builds, the tests will be | 5663 | If the image successfully builds, the tests will be |
5665 | run: | 5664 | run: |
5666 | <literallayout class='monospaced'> | 5665 | <literallayout class='monospaced'> |
5667 | bitbake core-image-sato | 5666 | bitbake core-image-sato |
5668 | </literallayout></para></listitem> | 5667 | </literallayout></para></listitem> |
5669 | <listitem><para><emphasis>Manually Running Tests:</emphasis> | 5668 | <listitem><para><emphasis>Manually running tests:</emphasis> |
5670 | To manually run the tests, first globally inherit | 5669 | To manually run the tests, first globally inherit the |
5671 | <ulink url='&YOCTO_DOCS_REF_URL;#ref-classes-testimage'><filename>testimage.class</filename></ulink> | 5670 | <ulink url='&YOCTO_DOCS_REF_URL;#ref-classes-testimage'><filename>testimage</filename></ulink> |
5672 | by editing your <filename>local.conf</filename> file: | 5671 | class by editing your <filename>local.conf</filename> |
5672 | file: | ||
5673 | <literallayout class='monospaced'> | 5673 | <literallayout class='monospaced'> |
5674 | INHERIT += "testimage" | 5674 | INHERIT += "testimage" |
5675 | </literallayout> | 5675 | </literallayout> |
@@ -5704,7 +5704,7 @@ | |||
5704 | <listitem><para>Each test module loads in the order found | 5704 | <listitem><para>Each test module loads in the order found |
5705 | in <filename>TEST_SUITES</filename>. | 5705 | in <filename>TEST_SUITES</filename>. |
5706 | You can find the full output of the commands run over | 5706 | You can find the full output of the commands run over |
5707 | <filename>ssh</filename> in | 5707 | SSH in |
5708 | <filename>${WORKDIR}/testimgage/ssh_target_log</filename>. | 5708 | <filename>${WORKDIR}/testimgage/ssh_target_log</filename>. |
5709 | </para></listitem> | 5709 | </para></listitem> |
5710 | <listitem><para>If no failures occur, the task running the | 5710 | <listitem><para>If no failures occur, the task running the |
@@ -5723,7 +5723,7 @@ | |||
5723 | A test name maps directly to a Python module. | 5723 | A test name maps directly to a Python module. |
5724 | Each test module may contain a number of individual tests. | 5724 | Each test module may contain a number of individual tests. |
5725 | Tests are usually grouped together by the area | 5725 | Tests are usually grouped together by the area |
5726 | tested (e.g tests for <filename>systemd</filename> reside in | 5726 | tested (e.g tests for Systemd reside in |
5727 | <filename>meta/lib/oeqa/runtime/systemd.py</filename>). | 5727 | <filename>meta/lib/oeqa/runtime/systemd.py</filename>). |
5728 | </para> | 5728 | </para> |
5729 | 5729 | ||
@@ -5749,7 +5749,7 @@ | |||
5749 | required test for the image. | 5749 | required test for the image. |
5750 | Test modules named within <filename>TEST_SUITES</filename> | 5750 | Test modules named within <filename>TEST_SUITES</filename> |
5751 | cannot be skipped even if a test is not suitable for an image | 5751 | cannot be skipped even if a test is not suitable for an image |
5752 | (e.g. running the rpm tests on an image without | 5752 | (e.g. running the RPM tests on an image without |
5753 | <filename>rpm</filename>). | 5753 | <filename>rpm</filename>). |
5754 | Appending "auto" to <filename>TEST_SUITES</filename> causes the | 5754 | Appending "auto" to <filename>TEST_SUITES</filename> causes the |
5755 | build system to try to run all tests that are suitable for the | 5755 | build system to try to run all tests that are suitable for the |
@@ -5758,13 +5758,13 @@ | |||
5758 | 5758 | ||
5759 | <para> | 5759 | <para> |
5760 | The order you list tests in <filename>TEST_SUITES</filename> | 5760 | The order you list tests in <filename>TEST_SUITES</filename> |
5761 | is important. | 5761 | is important and influences test dependencies. |
5762 | The order influences test dependencies. | ||
5763 | Consequently, tests that depend on other tests should be added | 5762 | Consequently, tests that depend on other tests should be added |
5764 | after the test on which they depend. | 5763 | after the test on which they depend. |
5765 | For example, since <filename>ssh</filename> depends on the | 5764 | For example, since the <filename>ssh</filename> test |
5766 | <filename>ping</filename> test, <filename>ssh</filename> | 5765 | depends on the |
5767 | needs to come after <filename>ping</filename> in the list. | 5766 | <filename>ping</filename> test, "ssh" needs to come after |
5767 | "ping" in the list. | ||
5768 | The test class provides no re-ordering or dependency handling. | 5768 | The test class provides no re-ordering or dependency handling. |
5769 | <note> | 5769 | <note> |
5770 | Each module can have multiple classes with multiple test | 5770 | Each module can have multiple classes with multiple test |
@@ -5887,7 +5887,7 @@ | |||
5887 | following attributes: | 5887 | following attributes: |
5888 | <itemizedlist> | 5888 | <itemizedlist> |
5889 | <listitem><para><emphasis><filename>d</filename>:</emphasis> | 5889 | <listitem><para><emphasis><filename>d</filename>:</emphasis> |
5890 | The BitBake data store, which allows you to | 5890 | The BitBake datastore, which allows you to |
5891 | use stuff such as | 5891 | use stuff such as |
5892 | <filename>oeRuntimeTest.tc.d.getVar("VIRTUAL-RUNTIME_init_manager")</filename>. | 5892 | <filename>oeRuntimeTest.tc.d.getVar("VIRTUAL-RUNTIME_init_manager")</filename>. |
5893 | </para></listitem> | 5893 | </para></listitem> |