* Support multiple devices on a test (ie: network tests)
* Support log attached to device app instance
* Make Incomplete run flagged as failure when session is finishing
* Critical failure tag as crash in the test report
#preflight 627bffe71e749933439e54ba
#rb Chris.Constantinescu
#jira none
[CL 20378481 by Jerome Delattre in ue5-main branch]
[REVIEW] [at]eric.knapik
#preflight 624f5058f10bcc0f4f84a6ba
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 19680155 via CL 19681068 via CL 19681084 via CL 19681091
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v938-19570697)
[CL 19681818 by andrew grant in ue5-main branch]
Not all were converted because they were designed for packaged applications whereas low level tests are designed to run as "native" non-packaged applications.
- reporting support for non-desktop platforms, for the moment Catch2 report type "console" is used that is sent to a .out file
- most number of tests possible running multi platform, slower tests excluded on incremental builds
- slow tests are moved to run on the monolithic build
- Catch2 report failure event listener such that Horde detects them as build errors. Must add new Horde matcher for Catch2 failures
#rb Mark.Lintott
#preflight 623c8de389625f0612dabd64
[CL 19498448 by chris constantinescu in ue5-main branch]
#rb andrew.grant,j.baumgartner,clayton.langford,tony.louthan
#ROBOMERGE-OWNER: ben.salem
#ROBOMERGE-AUTHOR: ben.salem
#ROBOMERGE-SOURCE: CL 19435399 via CL 19435736 via CL 19437281 via CL 19439090 via CL 19439629
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v930-19419903)
[CL 19442469 by ben salem in ue5-main branch]
* Introduce Automated Test Session data model for Horde TestData
* Introduce Suite and Type to UnrealTestNode to have better control over Session naming
* Add PreflightChange option to discriminate Session that are not official run
* Add test Duration and DateTime to UE json report model
* Accomodate for posting New and Old report models
#jira UEENGQA-29178
#preflight 622bb8ec46679d56c323f49a
#rb Chris.Constantinescu
[CL 19367745 by Jerome Delattre in ue5-main branch]
Made DOD self-abort if it thinks there's an issue instead of waiting for the timeout
#preflight https://horde.devtools.epicgames.com/log/622a980f32749f363c5f52d5
[REVIEW] [at]erik.knapik
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 19347702 via CL 19348799 via CL 19352331 via CL 19353055 via CL 19355827
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v926-19321884)
[CL 19357776 by andrew grant in ue5-main branch]
- Updated ios-deploy to latest from Github.
- Add fallback path for when Dns.GetHostEntry() throws an exception.
- Do not attempt to add empty/null objects to GC.
#rb jack.porter
#jira UE-126859
#rnx
#preflight none
#ROBOMERGE-AUTHOR: will.damon
#ROBOMERGE-SOURCE: CL 19197725 in //UE5/Release-5.0/... via CL 19197800
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v921-19075845)
[CL 19213049 by will damon in ue5-main branch]
The Engine currently no longer spits out a binary for Editor (it does for game) with -ASan appended. Something to resolve at a later date
We can still run ASan tests, but now the binary will be UnrealEditor vs UnrealEditor-ASan
#jira none
#rb none
#fyi Jerome.Delattre
#preflight none
[CL 19113559 by Brandon Schaefer in ue5-main branch]
Fix some test/asserts when running offscreen rendering. We use a GenericWindow which was hitting some fatal logs
#jira none
#rb none
#preflight 620ed89bc91bcd0017af2295
[CL 19044653 by Brandon Schaefer in ue5-main branch]
Allow cooked editor to run in cooked for in gauntlet and uncooked form.
Switch to using the -cookedEditor commandline argument for game specific cooked editor.
Adjusted parameters to allow the game to override exes to look for and name their module type
#preflight: 620df1e0f44e27e076620baf
[REVIEW] [at]Andrew.Grant [at]Jerome.Delattre [at]Chris.Constantinescu
#ROBOMERGE-AUTHOR: eric.knapik
#ROBOMERGE-SOURCE: CL 19035750 via CL 19037678 via CL 19038828 via CL 19039124 via CL 19039805
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v918-19018356)
[CL 19040295 by eric knapik in ue5-main branch]