* + avoid flooding the console output with empty lines when reporting tests that did not run.
#preflight 629fa516f73a9b013dce8152
#rb Chris.Constantinescu
#rnx
#jira none
[CL 20545218 by Jerome Delattre in ue5-main branch]
* + When looking for fatal error, keep last callstack with the most lines.
* + Catch "critical error" callstack report
#preflight 629fa597521254896f6a2b20
#rb Chris.Constantinescu
#jira none
#rnx
[CL 20543897 by Jerome Delattre in ue5-main branch]
#rb chris.babcock
#jira UE-151756
#tests Ran ReplayRun preflight and the job no longer had issues with build copy
#preflight 6297b1f6e809e387be23529b
[CL 20456799 by j baumgartner in ue5-main branch]
* Support multiple devices on a test (ie: network tests)
* Support log attached to device app instance
* Make Incomplete run flagged as failure when session is finishing
* Critical failure tag as crash in the test report
#preflight 627bffe71e749933439e54ba
#rb Chris.Constantinescu
#jira none
[CL 20378481 by Jerome Delattre in ue5-main branch]
[REVIEW] [at]eric.knapik
#preflight 624f5058f10bcc0f4f84a6ba
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 19680155 via CL 19681068 via CL 19681084 via CL 19681091
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v938-19570697)
[CL 19681818 by andrew grant in ue5-main branch]
Not all were converted because they were designed for packaged applications whereas low level tests are designed to run as "native" non-packaged applications.
- reporting support for non-desktop platforms, for the moment Catch2 report type "console" is used that is sent to a .out file
- most number of tests possible running multi platform, slower tests excluded on incremental builds
- slow tests are moved to run on the monolithic build
- Catch2 report failure event listener such that Horde detects them as build errors. Must add new Horde matcher for Catch2 failures
#rb Mark.Lintott
#preflight 623c8de389625f0612dabd64
[CL 19498448 by chris constantinescu in ue5-main branch]
* avoid attaching reference and delta of passed image comparison
* add warning instead of error when attaching image compare failed to work
* fix an issue with image artifacts being attached to the wrong event when attaching artifact failed...
#preflight 62363f9bb43f22036e1ee910
#jira none
#rnx
[CL 19447670 by Jerome Delattre in ue5-main branch]
#rb andrew.grant,j.baumgartner,clayton.langford,tony.louthan
#ROBOMERGE-OWNER: ben.salem
#ROBOMERGE-AUTHOR: ben.salem
#ROBOMERGE-SOURCE: CL 19435399 via CL 19435736 via CL 19437281 via CL 19439090 via CL 19439629
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v930-19419903)
[CL 19442469 by ben salem in ue5-main branch]