Lines Matching full:test
2 # GUIX and GUIX Studio Regression Test Guide
4 …io regression tests, along with effective debugging techniques for failed test cases. Regression t…
7 1. [GUIX Regression Test](#guix-regression-test)
9 2. [Types of Test Cases](#types-of-test-cases)
11 4. [Run Regression Test](#run-regression-test)
12 5. [Run One Test Case](#run-one-test-case)
13 6. [Debug Failed Test](#debug-failed-test)
14 7. [Add New Test](#add-new-test)
16 2. [GUIX Studio Regression Test](#guix-studio-regression-test)
18 2. [GUIX Studio Test Demo](#guix-studio-test-demo)
19 1. [Run GUIX Studio Test Demo](#run-guix-studio-test-demo)
20 2. [Debug Failed Test](#debug-failed-test)
21 3. [Add New Test Case](#add-new-test-case)
22 3. [GUIX Studio Test View](#guix-studio-test-view)
24 2. [Run GUIX Studio Test View](#run-guix-studio-test-view)
25 3. [Debug Failed Test](#debug-failed-test-1)
26 4. [Add New Test Case](#add-new-test-case-1)
28 ## GUIX Regression Test
32 The GUIX regression test is built on top of the CMake build system and organize its code in `test\g…
33 - **cmake\CMakeLists.txt:** The CMake file that defines the build types and the test suites.
34 - **cmake\regression\CMakeLists.txt:** The CMake file that defines the test cases for each test sui…
40 - **regression_test\utility:** This directory hosts utility files used by the regression test.
43 ### Types of Test Cases argument
45 1. **Test case with output:**
46 - In the generation mode, after each test point, a specified area of the GUIX canvas is saved to a …
48 - The binary file is used for checking the correctness of the test case visually.
51 2. **Test case without output:**
52 …his type of test code, the test code typically checks the API return status or the values of a var…
59 ### Run Regression Test argument
60 1. Navigate to the `test\guix_test\cmake` directory.
68 3. To build and run a specific test suite, use the following commands.
98 The **test reports** for each build type will be generated in the `test\guix_test\cmake\build\<buil…
100 …lt_build_covearge` and `no_utf8_build_coverage` will be generated in the `test\guix_test\cmake\cov…
102 ### Run One Test Case argument
104 Follow these steps to execute an individual test case:
106 1. Build the test using the instructions provided in the previous section.
107 2. Navigate to the `test\guix_test\cmake\build\<build_type>\regression` directory, where the test e…
109 3. Run the test without output, where the test name is ended with `no_output`.
119 ### Debug Failed Test argument
122 1. Navigate to the `test\guix_test\cmake\build\<build_type>\regression` directory, where the test e…
127 2. Set configuration parameter `-r` to run test without comparison.
132 3. Set breakpoints as needed and run the test.
135 1. Navigate to the `test\guix_test\cmake\build\<build_type>\regression\output_files` directory, whe…
137 …test\guix_test\regression_test` to display the content in the failed output binary file. Compare i…
141 ### Add New Test argument
143 Follow these steps to add a new test:
145 - Generate a Win32 demo project under the `test\example_internal` directory.
148 2. Add Test Source File:
149 - Place the test source file in the `test\guix_test\regression_test\tests` directory.
150 - Name the test file start with `validation_guix`.
152 3. Implement the Test Case:
153 - In the test source file, include the necessary header files:
161 - Set test parameters:
164 "", /* Test name */
197 - Create the test thread:
205 /* Termiante the test if it runs for more than 100 ticks */
216 - Include the test example source code:
226 …he test example source code also contains a main function, The header file `gx_validation_wrapper.…
228 - Thread entry example for test case without output:
255 - Thread entry example for test case with output:
284 /* Signal the end of the test case. Verify the output. */
291 4. Add Test Case to GUIX Regression Test System:
292 - Open the `test\guix_test\cmake\regression\CMakeLists.txt` file.
293 - Add test demo project to the appropriate demo list based on the demo build configuration settings…
316 - Define test case for demo project:
324 - Build GUIX regression test with the appropriate build type based on the demo build configuration …
326 - Generate golden files for the test case. If the test has no output, this step can be skipped.
327 …- Navigate to the `test\guix_test\cmake\build\<build_type>\regression` directory, where the test e…
329 - Generate output files for the test case with the following command.
333 …>.bin` and checksum file `<test_name>.checksum` will be generated in the `test\guix_test\cmake\bui…
335 …tness of the test by checking the content of the output binary file `<test_name>.bin` with the **g…
342 …- Copy the 7z file `<test_name>.7z` and `<test_name>.checksum` to the `test\guix_test\golden_files…
344 - Run the GUIX regression test to see if the test case passes.
346 - Now the test case is ready to be submitted to the GUIX repository.
350 If the available build types lack the configuration settings required for your test, you can add a …
352 1. Open the `test\guix_test\cmake\CMakeLists.txt` file.
366 - Open the `test\guix_test\cmake\regression\CMakeLists.txt` file.
384 …able according to the build type. This variable will later be used to add test cases for the build…
392 …ng logic to set regression test program's SOURCE as `validation_*.c` and related source files, exc…
394 # Set regression test program's SOURCE as validation_*.c and related source
404 ## GUIX Studio Regression Test
412 ### GUIX Studio Test Demo argument
414 The demo tests are located in the `test\guix_studio_test\test_demo` directory.
416 Target Directories: `examples`, `tutorials` and `test\example_internal`.
418 #### Run GUIX Studio Test Demo
420 2. Navigate to the `test\guix_studio_test\test_demo` directory.
428 4. To test the compilation of the Visual Studio project under the target directories, run the follo…
449 #### Debug Failed Test
451 After test execution, a test log file named `output_files_test_log.txt` will be generated in the cu…
453 #### Add New Test Case
455 …r the target directories, this project will be automatically added to the test system. However, if…
458 ### GUIX Studio Test View argument
460 The test view tests are located in the `test\guix_studio_test\test_view` directory.
463 
464 *Figure 1: GUIX Studio Test View Architecture*
466 …dio provides a test message handler for each function component, enabling interaction with the GUI…
468 GUIX Studio Test View verifies the correctness of the test through two aspects:
469 …compare_result()` function, which facilitates this comparison process. In test mode, it checks the…
473 #### Run GUIX Studio Test View
475 2. Navigate to the `test\guix_studio_test\test_view` directory.
476 3. Run the entire test with the following command.
480 4. Run a specific test by specifying its name with the following command.
485 To explore the available test cases and obtain more information, use the following command to displ…
490 #### Debug Failed Test
491 …test execution, a test log file named `studio_view_test_log.txt` will be generated in the current …
493 #### Add New Test Case
494 1. Add a new test file.
504 3. Define test header for the test information.
507 notes = "* <Test Name> *\n"
513 4. Define test case.
519 # Test code goes here.
524 5. Import the new test case to `test_main.py`.
526 - Import the new test module:
531 - Add argument for the new test case:
533 ….add_argument('--<test_name>', action='store_true', dest='<test_name>' help='Run <test_name> test')
536 - Update existing logic to set the new test case to run when the user doesn't specify tests to run:
545 - Add logic to run test case:
551 - Generate golden files for the new test case:
556 - Copy the golden files to the `test\guix_studio_test\golden_files` directory.
557 - Run the new test case to see if it passes.
561 - Now the test case is ready to be submitted to the GUIX repository.