Commit Graph

6 Commits

Author SHA1 Message Date
lorry li
96b55c1d11 Make sure the web server process can be closed properly when run web tests on automation tool, to fix the pipeline not closed warning;
Fix the low level report parser error, when there are sections in test cases.

#jira UE-182678
[REVIEW] [at]chris.constantinescu [at]stephen.ma

[CL 27596208 by lorry li in ue5-main branch]
2023-09-05 10:35:43 -04:00
chris constantinescu
7bd4b51df9 Catch xml report parsing error to warning
#rb Jerome.Delattre, Adam.Miezianko, Rob.Huyett
#preflight skip

[CL 24877541 by chris constantinescu in ue5-main branch]
2023-03-31 16:03:39 -04:00
chris constantinescu
7859a6cdb4 Catch2 feature introduced: test groups and group events at global, group and test group before/after levels
#preflight 636ab505450be1d9f83e90e4
#rb Jerome.Delattre

[CL 23039159 by chris constantinescu in ue5-main branch]
2022-11-08 16:02:46 -05:00
chris constantinescu
ae281656f2 Tests converted from 18848115 made to work multi-platform.
Not all were converted because they were designed for packaged applications whereas low level tests are designed to run as "native" non-packaged applications.
- reporting support for non-desktop platforms, for the moment Catch2 report type "console" is used that is sent to a .out file
- most number of tests possible running multi platform, slower tests excluded on incremental builds
- slow tests are moved to run on the monolithic build
- Catch2 report failure event listener such that Horde detects them as build errors. Must add new Horde matcher for Catch2 failures

#rb Mark.Lintott
#preflight 623c8de389625f0612dabd64

[CL 19498448 by chris constantinescu in ue5-main branch]
2022-03-24 13:28:25 -04:00
chris constantinescu
410d45be21 Low level tests - platform fixes and presubmit default compilation to prevent breaking
- Addressed remaining NDA platform code that was present in public facing folders
- Compile LowLevelTests target by default on presubmits and incremental builds for Main and 5.0
- Add dummy test on LowLevelTetsts and run it on consoles daily - this test is called "Self" and it's a sanity check run for Catch2
- Fixed Switch indefinite hang - Self test run successfully on this console
- Added IRunningStateOptions to control app run state: startup and check running state options
- AudioUnitTests run successfully on XboxOneGDK and XSX
- XSX Self and AudioUnitTests run successfully but XSX reports VideoEscape errors - JIRA UE-131334

#jira UEENGQA-52681, UE-127449
#rb Jerome.Delattre
#robomerge 5.0

[CL 17830364 by chris constantinescu in ue5-main branch]
2021-10-15 12:15:53 -04:00
chris constantinescu
cd6530efad Low Level Tests: code tests built on Catch2 with multi-platform support.
Intended for writing unit, integration, functional and all types of tests.

#jira UEENGQA-49764
#rb Jerome.Delattre

[CL 17666358 by chris constantinescu in ue5-main branch]
2021-09-29 15:50:07 -04:00