This should yield a call stack showing the explicit reason for failure to help track down intermittent issues.
#rb adolf.stary
[CL 25997394 by brendan lienau in ue5-main branch]
+ Use PathUtils.FindRelevantPath to search for the FPSChartStats folder within the artifacts dir. Then copy out the newest csv each iteration.
+ Remove deletion of saved dir between iterations as it's no longer needed since we grab the latest csv file.
+ Pass in the build name as it's not reliably set in Gauntlet on all platforms.
#jira UE-186796
#rnx
#rb clayton.langford
[CL 25945245 by tyler staples in ue5-main branch]
Make these utilities accessible for engine projects.
#rnx
[REVIEW] clayton.langford,brendan.lienau
#rb clayton.langford
[CL 25824160 by tyler staples in ue5-main branch]
* Create UsedPlatform HashSet as we add target devices in case their unregistered before we get to dispose().
#rb michael.wanderson
[FYI] [at]brian.white, [at]michael.wanderson
[CL 25241522 by joe barnes in ue5-main branch]
+ limit the number of reported not run tests
+ clean up some part of summary report
#jira UE-176042
#preflight 63f661449129b42b256eef3d
#rb Chris.Constantinescu
#rnx
[CL 25024749 by Jerome Delattre in ue5-main branch]
Defaults to empty (vanilla)
If the specified role-configuration-flavor cannot be found, Gauntlet returns an error and does not use another flavor as a fallback.
Flavor can be specified on the command line (-<role>flavor=<flavor>, e.g. -clientflavor=clang -serverflavor=asan)
#rb mickael.gilabert
#tests on multiple combination of builds/platforms/tests, including ReplayRun, EditorTests, EngineTests, ASan PS5.
[CL 24924648 by nicolas mercier in ue5-main branch]
- this can be used to update the command line for a particular role based on output from another role, for example.
- add new interface to Windows app install to allow the command line to be updated before launch.
#rnx
#rb Andrew.Grant, Jerome.Delattre, Eric.Knapik
#preflight 640700988c0039bbf793298d
[CL 24537804 by david harvey in ue5-main branch]
#preflight 63fe91f8ae54ee4ce9e7a51a
** Had to do a new CL because of the move rules preventing me from submitting the previous CL**
So that the new Gauntlet RPC tools do not go out to licensees prematurely, moving all RPC related files to:
FortniteGame/Build/Scripts/Automation/Utility/RPC/Gauntlet/Framework/
FortniteGame/Build/Scripts/Automation/Utility/RPC/Gauntlet/Framework/Utils
FortniteGame/Build/Scripts/Automation/Utility/RPC/Gauntlet/Framework/Utils/RPC
This preserves Gauntlet's file structure, meaning that if we decide to make this available to license holders, we can simply move the contents of the Gauntlet folder into the Gauntlet project and the structure will be compatible. There are two classes that needed a file created to be moved - GauntletHttpClient and GauntletHttpResponse - they are now in Gauntlet.GauntletHttpClient.cs
[CL 24465068 by tim kennedy in ue5-main branch]
[REVIEW] [at]david.harvey
[RN] Extended gauntlet role to support different build flavor for the same configuration (i.e ASan or others)
[CL 24251615 by mickael gilabert in ue5-main branch]
* Implement a way to write and run top-down tests in Gauntlet easily.
* Genericize and write tools around existing RPC functionality to allow it to be easily used.
* Create a generic timer that can enable test execution to wait for specific events and time out if they take too long.
**Note** Tests pass, but roles often shows failed due to the test finishing before the Unreal Process(es) have initialized.
#preflight n/a
#rb
[REVIEW] [at]gary.yuan [at]eric.knapik [at]ben.salem [at]zorin.abner
[CL 23935012 by tim kennedy in ue5-main branch]
The some artifacts are read-only, so they fail to get cleaned up by Directory.Delete() unless the read-only attribute is removed.
#rb Ben.Salem
[FYI] Jerome.Delattre
#preflight 63c971a12a6acaf16290fcdb
[CL 23782216 by anna fukutome in ue5-main branch]