#rb andrew.grant,j.baumgartner,clayton.langford,tony.louthan
#ROBOMERGE-OWNER: ben.salem
#ROBOMERGE-AUTHOR: ben.salem
#ROBOMERGE-SOURCE: CL 19435399 via CL 19435736 via CL 19437281 via CL 19439090 via CL 19439629
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v930-19419903)
[CL 19442469 by ben salem in ue5-main branch]
* Implement loading Json report and resume from last know failure
* Make Gauntlet uses the retry state when critical failure occured on UE automation test.
* Capture the callstack if any and update the json report
* Attached passed log before retrying
* Use enum in json serialization and desirialization
* Use one common Event class for json report and parsing from the log
* Use an unique path for artifact at each runs/retries
* Use Json report to generate the pass summary in Gauntlet
#jira UEENGQA-38051
#rb Chris.Constantinescu, Eric.Knapick
[CL 17160450 by Jerome Delattre in ue5-main branch]
Introduce Gauntlet.ITestReport interface
- enable attaching artifact to report through ITestReport.AttachArtifact(string)
- enable reporting errors and warnings to ITestReport
Deprecate CreateReport(TestResult, Context, Build, Artifacts, ArtifactPath) and favor to CreateReport(ITestReport)
Generate a simplified report for Horde Test Data
Better support copying artifacts with long path on Windows
#jira none
#rb Andrew.Grant
[CL 14859929 by Jerome Delattre in ue5-main branch]
Avoid redundant error report in the log by implementing a new property LogWarningsAndErrorsAfterSummary to ITestNode
#jira none
#rnx
#rb josh.engebretson, andrew.grant
[CL 14809680 by Jerome Delattre in ue5-main branch]
#rb clayton.langford
#ROBOMERGE-SOURCE: CL 12646231 via CL 12646246 via CL 12649255 via CL 12649452 via CL 12649499 via CL 12649616
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v675-12543919)
[CL 12649737 by ben salem in Main branch]
ITestNode now defines GetWarnings and GetErrors calls for tests to return instances that occurred during a test.
Split creation of Summary report in UnrealTestNode into Header/Body functions to allow tests to more easily customize these.
Added GetLogChannels() function to UnrealLogParser that will return all lines from multiple channels
Added AutomatonLogParser that specifically parses the output of automation (non-Gauntlet) tests.
#rb CRd
[at]josh.engebretson [at]clayton.langford [at]ben.salem
#ROBOMERGE-SOURCE: CL 6241133 via CL 6246005
[CL 6246055 by andrew grant in Main branch]