Lines Matching +full:files +full:- +full:exclude
21 When using (at least) one ``-v`` option, twister's console output
26 - The test is marked as ``build_only: true`` in its ``.yaml``
28 - The test configuration has defined a ``harness`` but you don't have
30 - The target device is not connected and not available for flashing
31 - You or some higher level automation invoked twister with
32 ``--build-only``.
38 .. group-tab:: Linux
40 .. code-block:: bash
42 $ source zephyr-env.sh
45 .. group-tab:: Windows
47 .. code-block:: bat
49 zephyr-env.cmd
58 .. group-tab:: Linux
60 .. code-block:: bash
62 $ ./scripts/twister --all --enable-slow
64 .. group-tab:: Windows
66 .. code-block:: bat
68 python .\scripts\twister --all --enable-slow
74 the ``--platform`` option, it is a platform filter for testing, with this
77 you can use ``--platform board@revision`` to test on a specific revision.
83 .. group-tab:: Linux
85 .. code-block:: bash
87 $ ./scripts/twister --help
89 .. group-tab:: Windows
91 .. code-block:: bat
93 python .\scripts\twister --help
109 .. code-block:: yaml
112 name: NXP FRDM-K64F
116 - zephyr
117 - gnuarmemb
118 - xtools
120 - arduino_gpio
121 - arduino_i2c
122 - netif:eth
123 - adc
124 - i2c
125 - nvs
126 - spi
127 - gpio
128 - usb_device
129 - watchdog
130 - can
131 - pwm
141 .. code-block:: console
144 west build -b reel_board
146 cmake -DBOARD=reel_board ..
169 .. code-block:: yaml
172 - pci
177 .. code-block:: yaml
180 - netif:eth
181 - sensor:bmi16
205 power-efficient but slow CPU or simulation platform which can perform instruction accurate
212 files in the application's project directory. This file may contain one or more
249 .. code-block:: yaml
268 .. code-block:: yaml
299 Don't run this test case unless ``--enable-slow`` or ``--enable-slow-only`` was
300 passed in on the command line. Intended for time-consuming test cases that
312 .. code-block:: yaml
321 - CONFIG_ADC_ASYNC=y
326 .. code-block:: yaml
335 - arch:x86:CONFIG_ADC_ASYNC=y
336 - platform:qemu_x86:CONFIG_DEBUG=y
362 test will be selectable using the command line option ``--level <level name>``
392 invoked with the ``--integration`` option. Use this instead of
408 the images onto the target. The ``--erase`` option of west flash is
426 - ztest
427 - test
428 - console
429 - pytest
430 - gtest
431 - robot
444 - keyboard
445 - net
446 - bluetooth
448 Harness ``bsim`` is implemented in limited way - it helps only to copy the
467 .. code-block:: yaml
470 - arch
471 - simulation
509 .. code-block:: yaml
528 Specify a list of pytest directories, files or subtests that need to be
534 .. code-block:: yaml
538 - "pytest/test_shell_help.py"
539 - "../shell/pytest/test_shell.py"
540 - "/tmp/test_shell.py"
541 - "~/tmp/test_shell.py"
542 - "$ZEPHYR_BASE/samples/subsys/testsuite/pytest/shell/pytest/test_shell.py"
543 - "pytest/test_shell_help.py::test_shell2_sample" # select pytest subtest
544 … - "pytest/test_shell_help.py::test_shell2_sample[param_a]" # select pytest parametrized subtest
550 ``pytest_args: [‘-k=test_method’, ‘--log-level=DEBUG’]``. Note that
551 ``--pytest-args`` can be passed multiple times to pass several arguments
571 .. code-block:: yaml
582 - "Temperature:(.*)C"
583 - "Relative Humidity:(.*)%"
594 .. code-block:: yaml
602 - pytest_dir1
603 - $ENV_VAR/samples/test/pytest_dir2
607 - pytest/test_file_1.py
608 - test_file_2.py::test_A
609 - test_file_2.py::test_B[param_a]
613 .. code-block:: yaml
625 .. code-block:: none
641 .. code-block:: antlr
665 if the symbol is defined to a non-empty string.
672 * all comparison operators (non-associative)
677 .. code-block:: none
683 .. code-block:: none
691 .. code-block:: none
707 .. code-block:: yaml
712 - cdc-acm-console
713 - user-snippet-example
717 running with ``-v`` or examining the discard report
723 To update this, pass the ``--all --release`` options.
740 * ``--timeout-multiplier`` twister option which can be used to adjust timeouts in exact twister run.
752 be activated using the ``--integration`` option of twister and narrows down
762 supports running any out-of-tree custom emulator defined in the board's :file:`board.cmake`.
766 .. code-block:: yaml
776 .. code-block:: cmake
783 .. code-block:: cmake
810 .. group-tab:: Linux
812 .. code-block:: bash
814 scripts/twister --device-testing --device-serial /dev/ttyACM0 \
815 --device-serial-baud 115200 -p frdm_k64f -T tests/kernel
817 .. group-tab:: Windows
819 .. code-block:: bat
821 python .\scripts\twister --device-testing --device-serial COM1 \
822 --device-serial-baud 115200 -p frdm_k64f -T tests/kernel
824 The ``--device-serial`` option denotes the serial device the board is connected to.
826 only one board at a time, specified using the ``--platform`` option.
828 The ``--device-serial-baud`` option is only needed if your device does not run at
831 To support devices without a physical serial port, use the ``--device-serial-pty``
837 .. group-tab:: Linux
839 .. code-block:: bash
841 scripts/twister --device-testing --device-serial-pty "script.py" \
842 -p intel_adsp_cavs25 -T tests/kernel
844 .. group-tab:: Windows
850 The script is user-defined and handles delivering the messages which can be
853 The ``--device-flash-timeout`` option allows to set explicit timeout on the
857 The ``--device-flash-with-test`` option indicates that on the platform
871 .. group-tab:: Linux
873 .. code-block:: bash
875 ./scripts/twister --generate-hardware-map map.yml
877 .. group-tab:: Windows
879 .. code-block:: bat
881 python .\scripts\twister --generate-hardware-map map.yml
888 .. group-tab:: Linux
890 .. code-block:: yaml
892 - connected: true
895 product: DAPLink CMSIS-DAP
898 - connected: true
901 product: J-Link
905 .. group-tab:: Windows
907 .. code-block:: yaml
909 - connected: true
915 - connected: true
930 .. group-tab:: Linux
932 .. code-block:: yaml
934 - connected: true
937 product: DAPLink CMSIS-DAP
941 - connected: true
944 product: J-Link
949 .. group-tab:: Windows
951 .. code-block:: yaml
953 - connected: true
956 product: DAPLink CMSIS-DAP
960 - connected: true
963 product: J-Link
978 .. group-tab:: Linux
980 .. code-block:: bash
982 ./scripts/twister --device-testing --hardware-map map.yml -T samples/hello_world/
984 .. group-tab:: Windows
986 .. code-block:: bat
988 python .\scripts\twister --device-testing --hardware-map map.yml -T samples\hello_world
1000 Hardware map allows to set ``--device-flash-timeout`` and ``--device-flash-with-test``
1001 command line options as ``flash-timeout`` and ``flash-with-test`` fields respectively.
1004 Serial PTY support using ``--device-serial-pty`` can also be used in the
1007 .. code-block:: yaml
1009 - connected: true
1016 - --remote-host=remote_host_ip_addr
1017 - --key=/path/to/key.pem
1026 .. group-tab:: Linux
1028 .. code-block:: bash
1030 west flash --remote-host remote_host_ip_addr --key /path/to/key.pem
1032 twister -p intel_adsp_cavs25 --device-testing --device-serial-pty script.py
1033 --west-flash="--remote-host=remote_host_ip_addr,--key=/path/to/key.pem"
1035 .. group-tab:: Windows
1043 For serial PTY, the "--generate-hardware-map" option cannot scan it out
1059 .. code-block:: yaml
1061 - connected: true
1063 - gpio_loopback
1066 product: DAPLink CMSIS-DAP
1070 When running ``twister`` with ``--device-testing``, the configured fixture
1075 :figclass: align-center
1077 Fixtures can also be provided via twister command option ``--fixture``, this option
1089 .. code-block:: yaml
1091 - connected: false
1093 - gpio_loopback
1101 product: J-Link
1108 When (re-)generated the hardware map file will contain an ``id`` keyword
1109 that serves as the argument to ``--board-id`` when flashing. In some
1111 using an external J-Link probe. The ``probe_id`` keyword overrides the
1114 .. code-block:: yaml
1116 - connected: false
1120 product: DAPLink CMSIS-DAP
1127 Twister allows user to provide configuration files defining a list of tests or
1134 ``--quarantine-list <PATH_TO_QUARANTINE_YAML>`` to a twister call.
1135 Multiple quarantine files can be used.
1137 ``--quarantine-verify`` to the above argument. This will make twister skip all tests
1153 .. code-block:: yaml
1155 - scenarios:
1156 - sample.basic.helloworld
1157 comment: "Link to the issue: https://github.com/zephyrproject-rtos/zephyr/pull/33287"
1159 - scenarios:
1160 - kernel.common
1161 - kernel.common.(misra|tls)
1162 - kernel.common.nano64
1164 - .*_cortex_.*
1165 - native_sim
1167 To exclude a platform, use the following syntax:
1169 .. code-block:: yaml
1171 - platforms:
1172 - qemu_x86
1202 - Ability to ignore default platforms as defined in board definitions
1205 - Option to specify your own list of default platforms overriding what
1207 - Ability to override `build_on_all` options used in some testcases.
1210 - Ignore some logic in twister to expand platform coverage in cases where
1219 - `override_default_platforms`: override default key a platform sets in board
1223 - `increased_platform_scope`: This option is set to True by default, when
1226 - `default_platforms`: A list of additional default platforms to add. This list
1232 .. code-block:: yaml
1238 - qemu_x86
1254 .. code-block:: yaml
1257 - name: my-test-level
1261 - kernel.threads.*
1262 - kernel.timer.behavior
1263 - arch.interrupt
1264 - boards.*
1274 .. code-block:: yaml
1279 - frdm_k64f
1281 - name: smoke
1284 - name: unit
1287 - name: integration
1290 - name: acceptance
1293 - name: system
1296 - name: regression
1306 .. group-tab:: Linux
1308 .. code-block:: bash
1310 scripts/twister --test-config=<path to>/test_config.yaml
1311 -T tests --level="smoke"
1320 the seed to the random number generator by providing ``-seed=value`` as an
1328 Robot files allow you to express interactive test scenarios in human-readable text format and execu…
1335 .. group-tab:: Linux
1337 .. code-block:: bash
1339 …$ ./scripts/twister --platform hifive1 --test samples/subsys/shell/shell_module/sample.shell.shell…
1341 .. group-tab:: Windows
1343 .. code-block:: bat
1345 …python .\scripts\twister --platform hifive1 --test samples/subsys/shell/shell_module/sample.shell.…
1349 .. code-block:: bash
1351 …$ ROBOT_FILES=shell_module.robot west build -p -b hifive1 -s samples/subsys/shell/shell_module -t …
1361 …essed directly in Robot test suite files, as an external Python library or, like Renode does it, d…
1362 …ramework.org/robotframework/latest/RobotFrameworkUserGuide.html#extending-robot-framework>`_ secti…
1369 .. code-block:: bash
1371 $ twister -p qemu_riscv32 -s tests/kernel/interrupt/arch.shared_interrupt